00010000:00010000:0.0F:1788309576.810933:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309577.834931:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309578.858068:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0F:1788309578.858134:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788309578.858166:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30ff4d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875178048137344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788309578.858231:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309578.858300:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048137344 00000100:00100000:1.0:1788309578.858307:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048137344 00000100:00100000:1.0:1788309578.858359:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788309578.858370:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875178048137344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788309578.858410:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788309578.858453:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875178048137344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309578.858460:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788309578.858508:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30ff4d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875178048137344:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0F:1788309578.858866:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788309578.858907:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc4191880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048137472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788309578.858936:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309578.858966:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048137472 00000100:00100000:1.0:1788309578.858970:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048137472 00000100:00100000:1.0:1788309578.858995:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788309578.859002:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048137472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788309578.859013:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788309578.859044:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048137472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309578.859051:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788309578.859082:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc4191880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048137472:0@lo:13:osp-pre-0-1.0 00000001:00080000:1.0:1788309578.860012:0:17144:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:1.0:1788309578.860024:0:17144:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c30f0336300 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:1.0:1788309578.860029:0:17144:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c30f7736f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c30f5364240 00000020:00080000:1.0:1788309578.860041:0:17144:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c30f7736000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c2fc359c400 00000020:00080000:0.0:1788309578.860111:0:17203:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00010000:00010000:3.0:1788309578.860122:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30c83dbc00/0x98c38120c44af38b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.860133:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30c83dbc00/0x98c38120c44af38b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.860141:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30c83dbc00/0x98c38120c44af38b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.860147:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30c83dbc00 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:3.0:1788309578.860152:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30c83dbc00/0x98c38120c44af38b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.860159:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30c83dbc00/0x98c38120c44af38b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19499 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788309578.860171:0:17203:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1788309578.860296:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c30f9ac2500) 00010000:00010000:3.0:1788309578.860301:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309578.860306:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30c83dbc00/0x98c38120c44af38b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309578.860313:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30c83dbc00/0x98c38120c44af38b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309578.991526:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309578.991605:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037585152 00000100:00100000:3.0:1788309578.991615:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037585152 00000100:00080000:1.0:1788309578.991743:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309578.991789:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 65 00000100:00100000:3.0:1788309578.991801:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dfa805c-a92c-4a7c-bdec-be167269c5fb+13:15578:x1875178037585152:12345-192.168.206.32@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788309578.991932:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dfa805c-a92c-4a7c-bdec-be167269c5fb+13:15578:x1875178037585152:12345-192.168.206.32@tcp:60:lhsmtool_posix.0 Request processed in 133us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309578.991940:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 65 00000100:00100000:3.0:1788309578.994783:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309578.994881:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037585280 00000100:00100000:1.0:1788309578.994890:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037585280 00000100:00100000:1.0:1788309578.994960:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 66 00000100:00100000:1.0:1788309578.994970:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9dfa805c-a92c-4a7c-bdec-be167269c5fb+5:15578:x1875178037585280:12345-192.168.206.32@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788309578.995119:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9dfa805c-a92c-4a7c-bdec-be167269c5fb+5:15578:x1875178037585280:12345-192.168.206.32@tcp:60:lhsmtool_posix.0 Request processed in 149us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309578.995127:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 66 00000100:00080000:3.0:1788309578.995228:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788309579.004822:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309579.004933:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037585536 00000100:00100000:1.0:1788309579.004943:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037585536 00000100:00100000:1.0:1788309579.005136:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 12 00000100:00100000:1.0:1788309579.005147:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9dfa805c-a92c-4a7c-bdec-be167269c5fb+13:15578:x1875178037585536:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788309579.005666:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9dfa805c-a92c-4a7c-bdec-be167269c5fb+14:15578:x1875178037585536:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 Request processed in 519us (851us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1788309579.005674:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 12 00000100:00100000:0.0:1788309579.188262:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309579.188383:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309579.188474:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309579.188818:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0F:1788309579.188901:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037585664 00000100:00100000:2.0:1788309579.188923:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037585664 00000100:00100000:2.0:1788309579.188971:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 164 00000100:00100000:2.0:1788309579.188982:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc371e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ad72364-ddd9-4210-a701-276084475d0c+13:2389:x1875178037585664:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1788309579.189048:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc371e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ad72364-ddd9-4210-a701-276084475d0c+13:2389:x1875178037585664:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 67us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309579.189055:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 164 00000100:00100000:0.0:1788309579.190474:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309579.190538:0:19499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037586176 00000100:00100000:3.0:1788309579.190549:0:19499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037586176 00000100:00100000:1.0:1788309579.190678:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037585920 00000100:00100000:1.0:1788309579.190684:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037585920 00000100:00100000:1.0:1788309579.190725:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037586432 00000100:00100000:1.0:1788309579.190729:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037586432 00000100:00100000:3.0:1788309579.190752:0:19499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 55 00000100:00100000:1.0:1788309579.190762:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 20 00000100:00100000:3.0:1788309579.190767:0:19499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19ee7afc-7cd6-4884-ada8-19dc985ede5f+5:2389:x1875178037586176:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1788309579.190776:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9dfa805c-a92c-4a7c-bdec-be167269c5fb+5:2389:x1875178037585920:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1788309579.190861:0:19499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19ee7afc-7cd6-4884-ada8-19dc985ede5f+5:2389:x1875178037586176:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 97us (2384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309579.190862:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9dfa805c-a92c-4a7c-bdec-be167269c5fb+5:2389:x1875178037585920:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 64us (2463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309579.190883:0:19499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 55 00000100:00100000:1.0:1788309579.190883:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 20 00000100:00080000:3.0:1788309579.190911:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788309579.190916:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 21 00000100:00080000:3.0:1788309579.190918:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788309579.190926:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19ee7afc-7cd6-4884-ada8-19dc985ede5f+5:2389:x1875178037586432:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1788309579.190957:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19ee7afc-7cd6-4884-ada8-19dc985ede5f+5:2389:x1875178037586432:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 33us (2139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309579.190964:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 21 00000100:00100000:0.0:1788309579.191790:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309579.191823:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309579.191987:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037586048 00000100:00100000:1.0:1788309579.191993:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037586048 00000100:00100000:1.0:1788309579.192046:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 56 00000100:00100000:1.0:1788309579.192054:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19ee7afc-7cd6-4884-ada8-19dc985ede5f+6:2389:x1875178037586048:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1788309579.192100:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19ee7afc-7cd6-4884-ada8-19dc985ede5f+6:2389:x1875178037586048:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 47us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309579.192107:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 56 00000100:00100000:1.0:1788309579.192353:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037585792 00000100:00100000:1.0:1788309579.192358:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037585792 00000100:00100000:1.0:1788309579.192393:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037586304 00000100:00100000:1.0:1788309579.192396:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037586304 00000100:00100000:1.0:1788309579.192413:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 22 00000100:00100000:1.0:1788309579.192419:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9dfa805c-a92c-4a7c-bdec-be167269c5fb+5:2389:x1875178037585792:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1788309579.192451:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9dfa805c-a92c-4a7c-bdec-be167269c5fb+5:2389:x1875178037585792:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 32us (1986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309579.192458:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 22 00000100:00100000:1.0:1788309579.192469:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 23 00000100:00100000:1.0:1788309579.192475:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19ee7afc-7cd6-4884-ada8-19dc985ede5f+5:2389:x1875178037586304:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1788309579.192599:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19ee7afc-7cd6-4884-ada8-19dc985ede5f+5:2389:x1875178037586304:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 123us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309579.192619:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 23 00000100:00080000:0.0:1788309579.193813:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788309579.193820:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788309579.370500:0:17199:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788309579.370509:0:17199:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788309579.370540:0:17199:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788309579.370549:0:17199:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788309579.882219:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30f03d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048137600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788309579.882291:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309579.882418:0:17904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048137600 00000100:00100000:3.0:1788309579.882426:0:17904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048137600 00000100:00100000:3.0:1788309579.882490:0:17904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788309579.882501:0:17904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048137600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788309579.882542:0:17904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788309579.882588:0:17904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048137600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309579.882595:0:17904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788309579.882731:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30f03d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048137600:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788309579.882925:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309579.884881:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788309579.884899:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30ff4d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875178048137728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788309579.884956:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309579.885008:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048137728 00000100:00100000:2.0:1788309579.885026:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048137728 00000100:00100000:2.0:1788309579.885072:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788309579.885081:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875178048137728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788309579.885109:0:17169:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788309579.885153:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875178048137728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309579.885160:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788309579.885179:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30ff4d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875178048137728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788309580.394392:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc4192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048137856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788309580.394441:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc4292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048137984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788309580.394469:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309580.394496:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048137856 00000100:00100000:3.0:1788309580.394502:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048137856 00000100:00100000:3.0:1788309580.394568:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788309580.394580:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048137856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788309580.394606:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788309580.394628:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875178048138240:0@lo:400:kworker.0 00000100:00080000:0.0:1788309580.394712:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788309580.394726:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30f03d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3617:1875178048138112:0@lo:400:kworker.0 00000100:00100000:3.0:1788309580.395027:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048137856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 450us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309580.395053:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788309580.395088:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309580.395112:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875178048138496:0@lo:400:kworker.0 00000100:00100000:3.0:1788309580.395137:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309580.395155:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048139008:0@lo:400:kworker.0 00000100:00100000:3.0:1788309580.395175:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309580.395316:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875178048139520:0@lo:400:kworker.0 00000100:00100000:3.0:1788309580.395344:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309580.395380:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788309580.395386:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048138880:0@lo:400:kworker.0 00000100:00100000:3.0:1788309580.395409:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309580.395427:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875178048139392:0@lo:400:kworker.0 00000100:00100000:3.0:1788309580.395450:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309580.395478:0:19862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048138496 00000100:00100000:3.0:1788309580.395483:0:19862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048138496 00000100:00100000:3.0:1788309580.395512:0:19862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048139008 00000100:00100000:3.0:1788309580.395515:0:19862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048139008 00000100:00100000:3.0:1788309580.395607:0:19862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048138880 00000100:00100000:3.0:1788309580.395610:0:19862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048138880 00000100:00100000:3.0:1788309580.395628:0:19862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788309580.395635:0:19862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875178048138496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309580.395678:0:19862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875178048138496:12345-0@lo:400:kworker.0 Request processed in 43us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309580.395684:0:19862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788309580.395697:0:19862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788309580.395703:0:19862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048139008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309580.395740:0:19862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048139008:12345-0@lo:400:kworker.0 Request processed in 38us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309580.395747:0:19862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788309580.395759:0:19862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788309580.395765:0:19862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d70d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048138880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309580.395792:0:19862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d70d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048138880:12345-0@lo:400:kworker.0 Request processed in 27us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309580.395798:0:19862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788309580.395817:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048139520 00000100:00100000:3.0:1788309580.395821:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048139520 00000100:00100000:3.0:1788309580.395871:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048139392 00000100:00100000:3.0:1788309580.395875:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048139392 00000100:00100000:3.0:1788309580.395896:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788309580.395903:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875178048139520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309580.395935:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875178048139520:12345-0@lo:400:kworker.0 Request processed in 33us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309580.395942:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788309580.395954:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788309580.395960:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d70d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875178048139392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309580.395987:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d70d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875178048139392:12345-0@lo:400:kworker.0 Request processed in 28us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309580.395992:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788309580.396073:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048137984 00000100:00100000:3.0:1788309580.396077:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048137984 00000100:00100000:3.0:1788309580.396098:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788309580.396104:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048137984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788309580.396126:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788309580.396160:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048137984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309580.396166:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788309580.396510:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048138880:0@lo:400:kworker.0 00010000:00080000:3.0:1788309580.396593:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c30fbbf0000 x1875178048139392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309580.396606:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875178048139392:0@lo:400:kworker.0 00000100:00100000:3.0:1788309580.396627:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc4292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048137984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788309580.396638:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875178048138496:0@lo:400:kworker.0 00000100:00100000:3.0:1788309580.396648:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048139008:0@lo:400:kworker.0 00000100:00100000:3.0:1788309580.396658:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875178048139520:0@lo:400:kworker.0 00000100:00080000:3.0:1788309580.396756:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788309580.396760:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788309580.396763:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788309580.396766:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788309580.397198:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc4192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048137856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788309580.397210:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048138368:0@lo:400:kworker.0 00000100:00100000:1.0:1788309580.397648:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309580.397733:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309580.397933:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875178048138752:0@lo:400:kworker.0 00000100:00100000:2.0:1788309580.397972:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309580.398401:0:19862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048138368 00000100:00100000:3.0:1788309580.398409:0:19862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048138368 00000100:00100000:3.0:1788309580.398466:0:19862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788309580.398476:0:19862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048138368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309580.398610:0:19862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048138368:12345-0@lo:400:kworker.0 Request processed in 135us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309580.398619:0:19862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788309580.398643:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788309580.399917:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309580.399963:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875178048138624:0@lo:400:kworker.0 00000100:00100000:0.0:1788309580.400000:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309580.400036:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875178048139136:0@lo:400:kworker.0 00000100:00100000:0.0:1788309580.400061:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309580.400079:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc4186a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875178048139648:0@lo:400:kworker.0 00000100:00100000:0.0:1788309580.400103:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309580.400143:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048138624 00000100:00100000:0.0:1788309580.400159:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048138624 00000100:00100000:0.0:1788309580.400209:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048139136 00000100:00100000:0.0:1788309580.400212:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048139136 00000100:00100000:0.0:1788309580.400225:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048139648 00000100:00100000:0.0:1788309580.400227:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048139648 00000100:00100000:0.0:1788309580.400267:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788309580.400275:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875178048138624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309580.400325:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875178048138624:12345-0@lo:400:kworker.0 Request processed in 52us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309580.400332:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788309580.400346:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788309580.400351:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875178048139136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309580.400389:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875178048139136:12345-0@lo:400:kworker.0 Request processed in 38us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309580.400395:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788309580.400407:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788309580.400413:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875178048139648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309580.400439:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875178048139648:12345-0@lo:400:kworker.0 Request processed in 27us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309580.400445:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1788309580.400474:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788309580.400512:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875178048138624:0@lo:400:kworker.0 00000100:00100000:0.0:1788309580.400523:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875178048139136:0@lo:400:kworker.0 00010000:00080000:0.0:1788309580.400546:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c2fc4186a00 x1875178048139648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309580.400557:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc4186a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875178048139648:0@lo:400:kworker.0 00000100:00100000:0.0:1788309580.400632:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048138368:0@lo:400:kworker.0 00000100:00100000:3.0:1788309580.401030:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048138112 00000100:00100000:3.0:1788309580.401035:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048138112 00000100:00100000:3.0:1788309580.401077:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788309580.401084:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc36ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42218ed5-7e96-4e9d-b9da-f92649f6b56e+24:3617:x1875178048138112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309580.401131:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc36ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42218ed5-7e96-4e9d-b9da-f92649f6b56e+24:3617:x1875178048138112:12345-0@lo:400:kworker.0 Request processed in 48us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309580.401138:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788309580.401376:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30f03d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3617:1875178048138112:0@lo:400:kworker.0 00000100:00100000:2.0:1788309580.402272:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875178048139264:0@lo:400:kworker.0 00000100:00100000:2.0:1788309580.402315:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309580.403975:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048139264 00000100:00100000:0.0:1788309580.403993:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048139264 00000100:00100000:0.0:1788309580.404084:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788309580.404095:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875178048139264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309580.404172:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875178048139264:12345-0@lo:400:kworker.0 Request processed in 79us (1856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309580.404179:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788309580.404305:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788309580.404337:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875178048139264:0@lo:400:kworker.0 00000100:00100000:1.0:1788309580.407076:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048138240 00000100:00100000:1.0:1788309580.407089:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048138240 00000100:00100000:1.0:1788309580.407170:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048138752 00000100:00100000:1.0:1788309580.407174:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048138752 00000100:00100000:1.0:1788309580.407195:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788309580.407204:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875178048138240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309580.407328:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875178048138240:12345-0@lo:400:kworker.0 Request processed in 125us (9882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309580.408536:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875178048138240:0@lo:400:kworker.0 00000100:00100000:1.0:1788309580.409104:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788309580.410361:0:17904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788309580.410393:0:17904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875178048138752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309580.410658:0:17904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875178048138752:12345-0@lo:400:kworker.0 Request processed in 266us (12675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309580.410666:0:17904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788309580.410828:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875178048138752:0@lo:400:kworker.0 00010000:00010000:0.0:1788309580.906341:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788309581.738739:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788309581.930048:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788309582.655490:0:20540:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 20:39:40 (1788309580) 00010000:00010000:0.0:1788309582.953994:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309583.978504:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309583.978575:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788309583.978594:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30ff4d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875178048139776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788309583.978656:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309583.978936:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048139776 00000100:00100000:2.0:1788309583.979136:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788309583.979149:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d70d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048139904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788309583.979224:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309583.979260:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048139904 00000100:00100000:2.0:1788309583.979266:0:18673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048139904 00000100:00100000:2.0:1788309583.979310:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788309583.979319:0:18673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048139904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788309583.979343:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788309583.979393:0:18673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048139904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309583.979399:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1788309583.979418:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788309583.979446:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d70d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048139904:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788309583.979495:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048139776 00000100:00100000:3.0:1788309583.979529:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788309583.979535:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875178048139776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788309583.979545:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788309583.979579:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875178048139776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309583.979585:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788309583.979613:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30ff4d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875178048139776:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788309583.979704:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788309584.311560:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309584.312785:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037586560 00000100:00100000:2.0:1788309584.312797:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037586560 00000100:00100000:0.0:1788309584.312802:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309584.312962:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 166 00000100:00100000:2.0:1788309584.312975:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc36ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ad72364-ddd9-4210-a701-276084475d0c+13:2388:x1875178037586560:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1788309584.312985:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037586688 00000100:00100000:1.0:1788309584.312991:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037586688 00000100:00100000:2.0:1788309584.313042:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc36ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ad72364-ddd9-4210-a701-276084475d0c+13:2388:x1875178037586560:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 70us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309584.313050:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 166 00000100:00100000:1.0:1788309584.313130:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 63 00000100:00100000:1.0:1788309584.313141:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dfa805c-a92c-4a7c-bdec-be167269c5fb+14:2388:x1875178037586688:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1788309584.313178:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9dfa805c-a92c-4a7c-bdec-be167269c5fb+14:2388:x1875178037586688:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 40us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309584.313185:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 63 00000100:00080000:1.0:1788309584.313457:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309584.315459:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309584.316063:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037586816 00000100:00100000:0.0:1788309584.316072:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037586816 00000100:00100000:0.0:1788309584.316130:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 64 00000100:00100000:0.0:1788309584.316140:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9dfa805c-a92c-4a7c-bdec-be167269c5fb+5:2389:x1875178037586816:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1788309584.316241:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9dfa805c-a92c-4a7c-bdec-be167269c5fb+5:2389:x1875178037586816:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 83us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309584.316254:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 64 00000100:00080000:1.0:1788309584.316867:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788309584.321267:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309584.321301:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309584.321331:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309584.321366:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309584.321390:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309584.321414:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309584.321440:0:19862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037586944 00000100:00100000:1.0:1788309584.321449:0:19862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037586944 00000100:00100000:1.0:1788309584.321512:0:19862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037587456 00000100:00100000:1.0:1788309584.321516:0:19862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037587456 00000100:00100000:1.0:1788309584.321532:0:19862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037587584 00000100:00100000:1.0:1788309584.321535:0:19862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037587584 00000100:00100000:0.0:1788309584.321543:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037587072 00000100:00100000:0.0:1788309584.321550:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037587072 00000100:00100000:1.0:1788309584.321556:0:19862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 30 00000100:00100000:1.0:1788309584.321568:0:19862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9dfa805c-a92c-4a7c-bdec-be167269c5fb+5:2387:x1875178037586944:12345-192.168.206.32@tcp:9:kworker.0 00000100:00100000:0.0:1788309584.321586:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 28 00000100:00100000:0.0:1788309584.321596:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9dfa805c-a92c-4a7c-bdec-be167269c5fb+5:2389:x1875178037587072:12345-192.168.206.32@tcp:400:kworker.0 00000020:00000080:1.0:1788309584.321611:0:19862:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44af0ba 00000100:00080000:1.0:1788309584.321627:0:19862:0:(import.c:65:import_set_state_nolock()) ffff8c30f093e000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788309584.321661:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9dfa805c-a92c-4a7c-bdec-be167269c5fb+5:2389:x1875178037587072:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 66us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309584.322778:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 28 00000100:00100000:0.0:1788309584.322812:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 31 00000100:00100000:0.0:1788309584.322823:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19ee7afc-7cd6-4884-ada8-19dc985ede5f+5:2387:x1875178037587456:12345-192.168.206.32@tcp:9:kworker.0 00000020:00000080:0.0:1788309584.322868:0:18670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44af0f9 00000100:00080000:0.0:1788309584.322877:0:18670:0:(import.c:65:import_set_state_nolock()) ffff8c2fc2b8e000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788309584.323753:0:18670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000001:00000004:1.0:1788309584.324905:0:19862:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788309584.325276:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19ee7afc-7cd6-4884-ada8-19dc985ede5f+2:2387:x1875178037587456:12345-192.168.206.32@tcp:9:kworker.0 Request processed in 2450us (3967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309584.325289:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 31 00000100:00100000:0.0:1788309584.325323:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 32 00000100:00100000:0.0:1788309584.325335:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19ee7afc-7cd6-4884-ada8-19dc985ede5f+5:2387:x1875178037587584:12345-192.168.206.32@tcp:9:kworker.0 00000020:00000080:0.0:1788309584.325369:0:18670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44af100 00000100:00080000:0.0:1788309584.325381:0:18670:0:(import.c:65:import_set_state_nolock()) ffff8c30fbbc9000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788309584.325418:0:18670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1788309584.325755:0:19862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9dfa805c-a92c-4a7c-bdec-be167269c5fb+2:2387:x1875178037586944:12345-192.168.206.32@tcp:9:kworker.0 Request processed in 4188us (4494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309584.325763:0:19862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 30 00000100:00100000:1.0:1788309584.325793:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037587328 00000100:00100000:1.0:1788309584.325800:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037587328 00000100:00100000:0.0:1788309584.326049:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:19ee7afc-7cd6-4884-ada8-19dc985ede5f+2:2387:x1875178037587584:12345-192.168.206.32@tcp:9:kworker.0 Request processed in 715us (4714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309584.326057:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 32 00000100:00100000:1.0:1788309584.326076:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037587200 00000100:00100000:1.0:1788309584.326081:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037587200 00000100:00100000:3.0:1788309584.326127:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 65 00000100:00100000:3.0:1788309584.326140:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19ee7afc-7cd6-4884-ada8-19dc985ede5f+5:2389:x1875178037587328:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1788309584.326184:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19ee7afc-7cd6-4884-ada8-19dc985ede5f+5:2389:x1875178037587328:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 48us (4792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309584.326193:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 65 00000100:00100000:3.0:1788309584.326215:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 66 00000100:00100000:3.0:1788309584.326223:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19ee7afc-7cd6-4884-ada8-19dc985ede5f+6:2389:x1875178037587200:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1788309584.326252:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19ee7afc-7cd6-4884-ada8-19dc985ede5f+6:2389:x1875178037587200:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 31us (4837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309584.326269:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 66 00010000:00010000:0.0:1788309584.326295:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309584.326373:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788309584.326384:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788309584.326387:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788309584.326390:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788309584.326392:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788309584.326968:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309585.002963:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309585.003773:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788309585.003795:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3101bb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048140032:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788309585.003931:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309585.005216:0:17904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048140032 00000100:00100000:1.0:1788309585.005226:0:17904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048140032 00000100:00100000:1.0:1788309585.005282:0:17904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788309585.005292:0:17904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048140032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788309585.005324:0:17904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788309585.005374:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d70d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048140160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788309585.005409:0:17904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048140032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309585.005410:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309585.005417:0:17904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788309585.005430:0:17904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048140160 00000100:00100000:1.0:1788309585.005434:0:17904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048140160 00000100:00100000:1.0:1788309585.005449:0:17904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788309585.005454:0:17904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048140160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788309585.005469:0:17904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788309585.005509:0:17904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048140160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309585.005515:0:17904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788309585.005722:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d70d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048140160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788309585.005804:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3101bb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048140032:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1788309585.006194:0:17144:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1788309585.006212:0:17144:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:2.0:1788309585.006636:0:17203:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:2.0:1788309585.006647:0:17203:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000100:00100000:2.0:1788309585.514139:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788309585.514162:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc4190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875178048140288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788309585.514320:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788309585.514331:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048140416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788309585.514361:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309585.514405:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875178048140672:0@lo:400:kworker.0 00000100:00100000:2.0:1788309585.514430:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309585.514446:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875178048141184:0@lo:400:kworker.0 00000100:00100000:2.0:1788309585.514466:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309585.514479:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875178048141696:0@lo:400:kworker.0 00000100:00100000:2.0:1788309585.514499:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309585.514518:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788309585.514523:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875178048140800:0@lo:400:kworker.0 00000100:00100000:2.0:1788309585.514543:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309585.514559:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875178048141312:0@lo:400:kworker.0 00000100:00100000:2.0:1788309585.514578:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309585.514610:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048141184 00000100:00100000:2.0:1788309585.514616:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048141184 00000100:00100000:2.0:1788309585.514647:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048141696 00000100:00100000:2.0:1788309585.514649:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048141696 00000100:00100000:2.0:1788309585.514667:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048140800 00000100:00100000:2.0:1788309585.514670:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048140800 00000100:00100000:2.0:1788309585.514680:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048141312 00000100:00100000:2.0:1788309585.514692:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048141312 00000100:00100000:2.0:1788309585.514713:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788309585.514722:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875178048141184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309585.514770:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875178048141184:12345-0@lo:400:kworker.0 Request processed in 48us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309585.514776:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788309585.514791:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788309585.514798:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875178048141696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309585.514824:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875178048141696:12345-0@lo:400:kworker.0 Request processed in 27us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309585.514830:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788309585.514866:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788309585.514873:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875178048140800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309585.514900:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875178048140800:12345-0@lo:400:kworker.0 Request processed in 28us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309585.514906:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788309585.514917:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788309585.514923:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875178048141312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309585.514960:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875178048141312:12345-0@lo:400:kworker.0 Request processed in 38us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309585.514966:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1788309585.514981:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788309585.514985:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788309585.515010:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875178048140800:0@lo:400:kworker.0 00000100:00100000:2.0:1788309585.515019:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875178048141312:0@lo:400:kworker.0 00000100:00100000:2.0:1788309585.515039:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875178048141184:0@lo:400:kworker.0 00010000:00080000:2.0:1788309585.515050:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c2fc414e680 x1875178048141696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309585.515236:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048140288 00000100:00100000:3.0:1788309585.515241:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048140288 00000100:00100000:3.0:1788309585.515275:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788309585.515282:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875178048140288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788309585.515304:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788309585.515330:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309585.515353:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875178048140288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309585.515359:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788309585.515364:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3620:1875178048140544:0@lo:400:kworker.0 00000100:00100000:3.0:1788309585.515368:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048140416 00000100:00100000:3.0:1788309585.515371:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048140416 00000100:00100000:3.0:1788309585.515385:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788309585.515390:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3101bb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048140416:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788309585.515394:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788309585.515400:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788309585.515419:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048141056:0@lo:400:kworker.0 00000100:00100000:3.0:1788309585.515422:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3101bb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048140416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309585.515427:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788309585.515439:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309585.515469:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875178048141696:0@lo:400:kworker.0 00000100:00100000:2.0:1788309585.515490:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc4190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875178048140288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788309585.515534:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875178048140928:0@lo:400:kworker.0 00000100:00100000:2.0:1788309585.515557:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309585.515578:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875178048141568:0@lo:400:kworker.0 00000100:00100000:1.0:1788309585.515607:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309585.515635:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048140416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788309585.515655:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048140544 00000100:00100000:1.0:1788309585.515658:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048140544 00000100:00100000:1.0:1788309585.515685:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788309585.515691:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc36eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42218ed5-7e96-4e9d-b9da-f92649f6b56e+24:3620:x1875178048140544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309585.515725:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc36eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42218ed5-7e96-4e9d-b9da-f92649f6b56e+24:3620:x1875178048140544:12345-0@lo:400:kworker.0 Request processed in 34us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309585.515731:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788309585.515750:0:19499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048141568 00000100:00100000:0.0:1788309585.515754:0:19499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048141568 00000100:00100000:0.0:1788309585.515789:0:19499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788309585.515797:0:19499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3101bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875178048141568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309585.515830:0:19499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3101bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875178048141568:12345-0@lo:400:kworker.0 Request processed in 34us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309585.516015:0:19499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788309585.516068:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3620:1875178048140544:0@lo:400:kworker.0 00000100:00100000:0.0:1788309585.516080:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875178048141568:0@lo:400:kworker.0 00000100:00080000:0.0:1788309585.517488:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788309585.517497:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788309585.519480:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048140672 00000100:00100000:3.0:1788309585.519493:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048140672 00000100:00100000:3.0:1788309585.519572:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048141056 00000100:00100000:3.0:1788309585.519576:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048141056 00000100:00100000:3.0:1788309585.519604:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788309585.519614:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875178048140672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309585.519716:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875178048140672:12345-0@lo:400:kworker.0 Request processed in 104us (5284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309585.519738:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788309585.519754:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788309585.519760:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3101bb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048141056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309585.519797:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3101bb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048141056:12345-0@lo:400:kworker.0 Request processed in 37us (4357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309585.519804:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788309585.519883:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048141056:0@lo:400:kworker.0 00000100:00100000:3.0:1788309585.519917:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875178048140672:0@lo:400:kworker.0 00000100:00080000:0.0:1788309585.520616:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788309585.521387:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875178048141440:0@lo:400:kworker.0 00000100:00100000:2.0:1788309585.521437:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309585.521531:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048140928 00000100:00100000:0.0:1788309585.521531:0:19499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048141440 00000100:00100000:3.0:1788309585.521537:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048140928 00000100:00100000:0.0:1788309585.521537:0:19499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048141440 00000100:00100000:3.0:1788309585.521592:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788309585.523089:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875178048140928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309585.523195:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875178048140928:12345-0@lo:400:kworker.0 Request processed in 1595us (7636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309585.524015:0:19499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788309585.524027:0:19499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875178048141440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309585.524151:0:19499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875178048141440:12345-0@lo:400:kworker.0 Request processed in 127us (2713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309585.524158:0:19499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788309585.524300:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875178048140928:0@lo:400:kworker.0 00010000:00080000:0.0:1788309585.524315:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c2fc414e300 x1875178048141440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309585.524326:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875178048141440:0@lo:400:kworker.0 00000100:00100000:3.0:1788309585.526965:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1788309585.527073:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788309585.527080:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788309586.026686:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309586.243300:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309586.243727:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037587840 00000100:00100000:1.0:1788309586.243738:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037587840 00000100:00100000:1.0:1788309586.243817:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 13 00000100:00100000:1.0:1788309586.243830:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d70d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9dfa805c-a92c-4a7c-bdec-be167269c5fb+13:16341:x1875178037587840:12345-192.168.206.32@tcp:35:umount.0 00000001:00080000:1.0:1788309586.244072:0:17167:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000100:00080000:2.0:1788309586.244130:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1788309586.244162:0:17167:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:1.0:1788309586.244284:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d70d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9dfa805c-a92c-4a7c-bdec-be167269c5fb+16:16341:x1875178037587840:12345-192.168.206.32@tcp:35:umount.0 Request processed in 456us (991us total) trans 8589934626 rc 0/0 00000100:00100000:1.0:1788309586.244292:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 13 00000020:00080000:1.0:1788309586.244297:0:17167:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788309586.256398:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309586.256484:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309586.259829:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309586.260690:0:18317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037588096 00000100:00100000:3.0:1788309586.260702:0:18317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037588096 00000100:00100000:1.0:1788309586.262812:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037587968 00000100:00100000:1.0:1788309586.262825:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037587968 00000100:00100000:1.0:1788309586.263077:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 3 00000100:00100000:1.0:1788309586.263089:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ad72364-ddd9-4210-a701-276084475d0c+14:2389:x1875178037588096:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788309586.263105:0:17151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309586.263125:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30c83da800/0x98c38120c44af09e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc1938b0 expref: 14 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309586.263143:0:17151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309586.263200:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ad72364-ddd9-4210-a701-276084475d0c+13:2389:x1875178037588096:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 113us (6880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309586.263207:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 3 00000100:00100000:1.0:1788309586.263222:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037588224 00000100:00100000:1.0:1788309586.263226:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037588224 00000100:00100000:1.0:1788309586.263251:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 4 00000100:00100000:1.0:1788309586.263257:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ad72364-ddd9-4210-a701-276084475d0c+13:2389:x1875178037587968:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788309586.263286:0:17151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309586.263296:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c2fc337da00/0x98c38120c44af097 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc19387f expref: 13 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309586.263304:0:17151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309586.263322:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ad72364-ddd9-4210-a701-276084475d0c+12:2389:x1875178037587968:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 66us (6839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309586.263329:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 4 00000100:00100000:1.0:1788309586.263356:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 5 00000100:00100000:1.0:1788309586.263363:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c3124450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ad72364-ddd9-4210-a701-276084475d0c+11:2389:x1875178037588224:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788309586.263370:0:17151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309586.263385:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c2fc337de00/0x98c38120c44af123 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193966 expref: 11 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309586.263394:0:17151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309586.263413:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c3124450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ad72364-ddd9-4210-a701-276084475d0c+10:2389:x1875178037588224:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 51us (3594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309586.263419:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 5 00000100:00100000:2.0:1788309586.263492:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309586.263526:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037588352 00000100:00100000:2.0:1788309586.263531:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037588352 00000100:00100000:2.0:1788309586.263577:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 33 00000100:00100000:2.0:1788309586.263587:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9dfa805c-a92c-4a7c-bdec-be167269c5fb+5:2387:x1875178037588352:12345-192.168.206.32@tcp:9:umount.0 00000020:00000080:2.0:1788309586.263619:0:18672:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44af0c1 00000100:00080000:2.0:1788309586.263629:0:18672:0:(import.c:65:import_set_state_nolock()) ffff8c2fc2b8b800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1788309586.263634:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788309586.263651:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788309586.263671:0:18672:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1788309586.263792:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9dfa805c-a92c-4a7c-bdec-be167269c5fb+2:2387:x1875178037588352:12345-192.168.206.32@tcp:9:umount.0 Request processed in 207us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309586.263805:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 33 00000100:00100000:1.0:1788309586.282461:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309586.282635:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037589248 00000100:00100000:0.0:1788309586.282644:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037589248 00000100:00100000:0.0:1788309586.282698:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 67 00000100:00100000:0.0:1788309586.282708:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3101bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9dfa805c-a92c-4a7c-bdec-be167269c5fb+16:2387:x1875178037589248:12345-192.168.206.32@tcp:39:umount.0 00000020:00000080:0.0:1788309586.282738:0:17165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44af0ac 00000020:00010000:0.0:1788309586.282754:0:17165:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c30f54ea800: total 0 00000100:00080000:0.0:1788309586.282758:0:17165:0:(import.c:65:import_set_state_nolock()) ffff8c30f54eb800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788309586.282785:0:17165:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000020:00010000:1.0:1788309586.282822:0:18806:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c30f54ea800: total 0 00010000:00010000:1.0:1788309586.282828:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309586.282921:0:18806:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c30f54ea800, canceled 0 locks, left on hash table 8. 00000100:00100000:0.0:1788309586.282936:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3101bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9dfa805c-a92c-4a7c-bdec-be167269c5fb+15:2387:x1875178037589248:12345-192.168.206.32@tcp:39:umount.0 Request processed in 228us (483us total) trans 8589934627 rc 0/0 00000100:00100000:0.0:1788309586.282944:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 67 00010000:00010000:1.0:1788309586.282988:0:18806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c30f9ac2500) 00010000:00010000:1.0:1788309586.282993:0:18806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788309586.283001:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30c1512e00/0x98c38120c44af361 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193a00 expref: 14 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309586.283042:0:18806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c2fc3362a00) 00010000:00010000:1.0:1788309586.283046:0:18806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788309586.283051:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5b600/0x98c38120c44af3ae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193a1c expref: 13 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309586.283069:0:18806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c2fc3362f00) 00010000:00010000:1.0:1788309586.283072:0:18806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788309586.283076:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6aa00/0x98c38120c44af177 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc19396d expref: 12 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309586.283093:0:18806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c30f9abad00) 00010000:00010000:1.0:1788309586.283105:0:18806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788309586.283110:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44af257 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc1939ac expref: 11 pid: 19499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309586.283128:0:18806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c2fc3362a00) 00010000:00010000:1.0:1788309586.283131:0:18806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788309586.283135:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ae00/0x98c38120c44af306 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc1939eb expref: 10 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309586.283146:0:18806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c2fc3362a00) 00010000:00010000:1.0:1788309586.283148:0:18806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788309586.283151:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30c1513200/0x98c38120c44af2d5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc1939d6 expref: 9 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309586.283164:0:18806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c2fc3362800) 00010000:00010000:1.0:1788309586.283166:0:18806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788309586.283169:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b200/0x98c38120c44af1d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193982 expref: 8 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309586.283180:0:18806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c30f9abae00) 00010000:00010000:1.0:1788309586.283182:0:18806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309586.283186:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44af193 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193974 expref: 7 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309586.283196:0:18806:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c30f54ea800, canceled 8 locks, left on hash table 0. 00010000:00010000:1.0:1788309586.283211:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309586.283213:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309586.283215:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309586.294947:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309586.295053:0:19499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037589376 00000100:00100000:0.0:1788309586.295063:0:19499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037589376 00000100:00080000:1.0:1788309586.295124:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788309586.295137:0:19499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 68 00000100:00100000:0.0:1788309586.295150:0:19499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9dfa805c-a92c-4a7c-bdec-be167269c5fb+5:2387:x1875178037589376:12345-192.168.206.32@tcp:39:umount.0 00000020:00000080:0.0:1788309586.295180:0:19499:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44af0b3 00000100:00080000:0.0:1788309586.295198:0:19499:0:(import.c:65:import_set_state_nolock()) ffff8c30f58ad800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788309586.295227:0:19499:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1788309586.295270:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309586.295466:0:19499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9dfa805c-a92c-4a7c-bdec-be167269c5fb+3:2387:x1875178037589376:12345-192.168.206.32@tcp:39:umount.0 Request processed in 318us (528us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788309586.295609:0:19499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 68 00010000:00010000:1.0:1788309587.050210:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309588.003811:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309588.003900:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309588.003939:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309588.004008:0:20192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037589504 00000100:00100000:2.0:1788309588.004022:0:20192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037589504 00000100:00100000:2.0:1788309588.004091:0:20192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037589760 00000100:00100000:2.0:1788309588.004096:0:20192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037589760 00000100:00100000:0.0:1788309588.004132:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037589632 00000100:00100000:2.0:1788309588.004147:0:20192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 6 00000100:00100000:2.0:1788309588.004160:0:20192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1ad72364-ddd9-4210-a701-276084475d0c+11:2389:x1875178037589504:12345-192.168.206.32@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788309588.004169:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037589632 00010000:00010000:2.0:1788309588.004176:0:20192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309588.004199:0:20192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c2fc337d400/0x98c38120c44af0d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc1938ef expref: 12 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309588.004220:0:20192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309588.004227:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:0.0:1788309588.004240:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ad72364-ddd9-4210-a701-276084475d0c+11:2389:x1875178037589760:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309588.004260:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309588.004282:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30c83db000/0x98c38120c44af11c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc19395f expref: 11 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309588.004293:0:20192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1ad72364-ddd9-4210-a701-276084475d0c+11:2389:x1875178037589504:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 129us (488us total) trans 0 rc 0/0 00010000:00010000:0.0:1788309588.004309:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309588.004310:0:20192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 6 00000100:00100000:2.0:1788309588.004347:0:20192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 8 00000100:00100000:2.0:1788309588.004359:0:20192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1ad72364-ddd9-4210-a701-276084475d0c+9:2389:x1875178037589632:12345-192.168.206.32@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788309588.004368:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ad72364-ddd9-4210-a701-276084475d0c+9:2389:x1875178037589760:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 129us (465us total) trans 0 rc 0/0 00010000:00010000:2.0:1788309588.004370:0:20192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788309588.004384:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 7 00010000:00010000:2.0:1788309588.004391:0:20192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30c83da400/0x98c38120c44af0dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193920 expref: 9 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309588.004407:0:20192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309588.004435:0:20192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1ad72364-ddd9-4210-a701-276084475d0c+7:2389:x1875178037589632:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 77us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309588.004442:0:20192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 8 00000100:00100000:1.0:1788309588.018119:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309588.018448:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037590016 00000100:00100000:3.0:1788309588.018462:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037590016 00000100:00100000:3.0:1788309588.018694:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 69 00000100:00100000:3.0:1788309588.018708:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3101bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19ee7afc-7cd6-4884-ada8-19dc985ede5f+6:2387:x1875178037590016:12345-192.168.206.32@tcp:39:umount.0 00000020:00000080:3.0:1788309588.018784:0:17166:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44af0eb 00000020:00010000:3.0:1788309588.018794:0:17166:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c30fbbcd000: total 0 00000100:00080000:3.0:1788309588.018799:0:17166:0:(import.c:65:import_set_state_nolock()) ffff8c30fbbc8000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1788309588.018930:0:18806:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c30fbbcd000: total 0 00000001:00000004:3.0:1788309588.018995:0:17166:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00010000:00010000:2.0:1788309588.019011:0:18806:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c30fbbcd000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788309588.019067:0:18806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c2fc3362800) 00010000:00010000:2.0:1788309588.019072:0:18806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788309588.019083:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b400/0x98c38120c44af1e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193989 expref: 6 pid: 19499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309588.019241:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3101bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19ee7afc-7cd6-4884-ada8-19dc985ede5f+4:2387:x1875178037590016:12345-192.168.206.32@tcp:39:umount.0 Request processed in 533us (1133us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1788309588.019250:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 69 00000100:00080000:1.0:1788309588.019306:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788309588.019356:0:18806:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c30fbbcd000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788309588.019378:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309588.019380:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309588.019384:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309588.037591:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309588.039085:0:19499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037590144 00000100:00100000:2.0:1788309588.039103:0:19499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037590144 00000100:00100000:2.0:1788309588.039377:0:19499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 70 00000100:00100000:2.0:1788309588.039391:0:19499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19ee7afc-7cd6-4884-ada8-19dc985ede5f+5:2387:x1875178037590144:12345-192.168.206.32@tcp:39:umount.0 00000020:00000080:2.0:1788309588.039443:0:19499:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44af0f2 00000100:00080000:2.0:1788309588.039455:0:19499:0:(import.c:65:import_set_state_nolock()) ffff8c2fc2b8d000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788309588.039506:0:19499:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788309588.039721:0:19499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:19ee7afc-7cd6-4884-ada8-19dc985ede5f+3:2387:x1875178037590144:12345-192.168.206.32@tcp:39:umount.0 Request processed in 332us (2333us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788309588.039730:0:19499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 70 00010000:00010000:3.0:1788309588.039920:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788309588.040360:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788309588.080935:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309588.087299:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309588.089374:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037590400 00000100:00100000:2.0:1788309588.089392:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037590400 00000100:00100000:2.0:1788309588.089495:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 168 00000100:00100000:2.0:1788309588.089508:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc36ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ad72364-ddd9-4210-a701-276084475d0c+7:2387:x1875178037590400:12345-192.168.206.32@tcp:251:umount.0 00000020:00000080:2.0:1788309588.089568:0:17158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44af089 00000020:00010000:2.0:1788309588.089577:0:17158:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c30f54eb000: total 0 00000100:00080000:2.0:1788309588.089583:0:17158:0:(import.c:65:import_set_state_nolock()) ffff8c2fc1924000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788309588.089710:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc36ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ad72364-ddd9-4210-a701-276084475d0c+3:2387:x1875178037590400:12345-192.168.206.32@tcp:251:umount.0 Request processed in 204us (2426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309588.089720:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 168 00000020:00010000:3.0:1788309588.089899:0:18806:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c30f54eb000: total 0 00010000:00010000:3.0:1788309588.089969:0:18806:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c30f54eb000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788309588.090013:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30c83da000/0x98c38120c44af090 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193878 expref: 2 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309588.090029:0:18806:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c30f54eb000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788309588.090039:0:18806:0:(genops.c:885:class_export_put()) final put ffff8c30f54eb000/1ad72364-ddd9-4210-a701-276084475d0c 00010000:00010000:3.0:1788309588.090054:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309588.090056:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309588.090058:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788309588.090310:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f54eb000/1ad72364-ddd9-4210-a701-276084475d0c for MGS 00000020:00000080:2.0:1788309588.090371:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c2fc1924000 for MGS 00010000:00010000:2.0:1788309589.098125:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309589.098858:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788309589.098874:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3101bb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875178048141824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788309589.098876:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048141952:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788309589.098949:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309589.098979:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048141824 00000100:00100000:3.0:1788309589.098988:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048141824 00000100:00100000:3.0:1788309589.099040:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788309589.099051:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875178048141824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788309589.099078:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788309589.099127:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875178048141824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (178us total) trans 0 rc 0/0 00000100:00080000:1.0:1788309589.099133:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788309589.099135:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788309589.099149:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309589.099150:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3101bb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875178048141824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788309589.099170:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048141952 00000100:00100000:3.0:1788309589.099174:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048141952 00000100:00080000:1.0:1788309589.099194:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788309589.099202:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788309589.099210:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3101bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048141952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788309589.099219:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788309589.099256:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3101bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048141952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309589.099262:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788309589.099474:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048141952:0@lo:13:osp-pre-0-1.0 00000020:01000004:3.0:1788309589.481551:0:20735:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1788309589.495715:0:20735:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788309589.495771:0:20735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30fba6a400/0x98c38120c44aec4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44aec53 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309589.495785:0:20735:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30fba6a400/0x98c38120c44aec4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44aec53 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309589.495792:0:20735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30fba6a400/0x98c38120c44aec4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44aec53 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309589.495799:0:20735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff8c30fba6a400/0x98c38120c44aec4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44aec53 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309589.495816:0:20735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788309589.495834:0:20735:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788309589.495883:0:20735:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788309589.495888:0:20735:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788309589.495894:0:20735:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788309589.495918:0:20735:0:(import.c:65:import_set_state_nolock()) ffff8c2fc2a6c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788309589.496102:0:17152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309589.496109:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c30fba6a400/0x98c38120c44aec4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44aec53 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.496117:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30fba6a400 already unused, calling callback (ffffffffc1507c20) 10000000:00010000:2.0:1788309589.496120:0:17152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c30fba6a400/0x98c38120c44aec4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44aec53 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.496129:0:17152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c30fba6a400/0x98c38120c44aec4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x98c38120c44aec53 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309589.496136:0:17152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c30fba6a400/0x98c38120c44aec4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x98c38120c44aec53 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309589.496142:0:17152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788309589.496152:0:17152:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788309589.496155:0:17152:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788309589.496184:0:17152:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff8c30fba6a400/0x98c38120c44aec4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44aec53 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.496201:0:17152:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788309589.496228:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c30fba6a400/0x98c38120c44aec4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44aec53 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.496235:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c30fba6a400/0x98c38120c44aec4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44aec53 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.496246:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309589.496248:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309589.496249:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309589.496257:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788309589.496275:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc41d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3619:1875178048142208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788309589.496346:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309589.496402:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048142208 00000100:00100000:2.0:1788309589.496409:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048142208 00000100:00100000:2.0:1788309589.496451:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788309589.496459:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42218ed5-7e96-4e9d-b9da-f92649f6b56e+24:3619:x1875178048142208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788309589.496471:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309589.496609:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c2fc337c800/0x98c38120c44aec53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x98c38120c44aec4c expref: 24 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.496622:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309589.496658:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42218ed5-7e96-4e9d-b9da-f92649f6b56e+23:3619:x1875178048142208:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309589.496665:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788309589.496701:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc41d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3619:1875178048142208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309589.496928:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3101bb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875178048142080:0@lo:39:umount.0 00000100:00100000:1.0:1788309589.496965:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309589.497041:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048142080 00000100:00100000:2.0:1788309589.497053:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048142080 00000100:00100000:2.0:1788309589.497092:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788309589.497100:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3101bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875178048142080:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788309589.497122:0:17165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aec7d 00000100:00080000:2.0:1788309589.497130:0:17165:0:(import.c:65:import_set_state_nolock()) ffff8c30c7feb000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788309589.497289:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3101bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3616:x1875178048142080:12345-0@lo:39:umount.0 Request processed in 189us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309589.497295:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:2.0:1788309589.497302:0:17165:0:(genops.c:885:class_export_put()) final put ffff8c30c7fec800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1788309589.497334:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788309589.497342:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30c7fec800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788309589.497389:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c30c7feb000 for lustre-MDT0000 00000100:00080000:1.0:1788309589.497446:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c2fc2a6c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788309589.497465:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3101bb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875178048142080:0@lo:39:umount.0 00000100:00080000:2.0:1788309589.497790:0:20735:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788309589.497794:0:20735:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788309589.497799:0:20735:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788309589.499286:0:20735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44aeb9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44aeba4 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499303:0:20735:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44aeb9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44aeba4 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499310:0:20735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44aeb9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44aeba4 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499326:0:20735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44aeb9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44aeba4 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499351:0:20735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788309589.499358:0:20735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc337d600/0x98c38120c44aefb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44aefb7 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499371:0:20735:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc337d600/0x98c38120c44aefb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44aefb7 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499378:0:20735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc337d600/0x98c38120c44aefb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44aefb7 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499383:0:20735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff8c2fc337d600/0x98c38120c44aefb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44aefb7 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499399:0:20735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788309589.499412:0:17152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788309589.499417:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44aeb9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44aeba4 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499425:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc35f0c00 already unused, calling callback (ffffffffc1507c20) 10000000:00010000:2.0:1788309589.499428:0:17152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44aeb9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44aeba4 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499436:0:17152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44aeb9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x98c38120c44aeba4 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309589.499443:0:17152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44aeb9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x98c38120c44aeba4 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309589.499448:0:17152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788309589.499450:0:17152:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788309589.499543:0:17152:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44aeb9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44aeba4 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499561:0:17152:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788309589.499581:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44aeb9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44aeba4 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499587:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44aeb9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44aeba4 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499599:0:17152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309589.499602:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c2fc337d600/0x98c38120c44aefb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44aefb7 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499607:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337d600 already unused, calling callback (ffffffffc1507c20) 10000000:00010000:2.0:1788309589.499610:0:17152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c2fc337d600/0x98c38120c44aefb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44aefb7 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499616:0:17152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c2fc337d600/0x98c38120c44aefb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x98c38120c44aefb7 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309589.499621:0:17152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c2fc337d600/0x98c38120c44aefb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x98c38120c44aefb7 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309589.499625:0:17152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788309589.499627:0:17152:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788309589.499629:0:17152:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788309589.499642:0:17152:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff8c2fc337d600/0x98c38120c44aefb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44aefb7 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499647:0:17152:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788309589.499652:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c2fc337d600/0x98c38120c44aefb0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44aefb7 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499666:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c2fc337d600/0x98c38120c44aefb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44aefb7 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499674:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309589.499675:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309589.499677:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309589.499693:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc41d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3618:1875178048142464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788309589.499753:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309589.499787:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788309589.499792:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc41d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3618:1875178048142336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788309589.499808:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788309589.499864:0:20735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc337ca00/0x98c38120c44af154 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af15b expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499874:0:20735:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc337ca00/0x98c38120c44af154 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af15b expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499879:0:20735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc337ca00/0x98c38120c44af154 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44af15b expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499886:0:20735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff8c2fc337ca00/0x98c38120c44af154 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44af15b expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499898:0:20735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788309589.499907:0:18806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309589.499911:0:18806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c2fc337ca00/0x98c38120c44af154 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44af15b expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499928:0:18806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337ca00 already unused, calling callback (ffffffffc1507c20) 10000000:00010000:2.0:1788309589.499931:0:18806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c2fc337ca00/0x98c38120c44af154 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44af15b expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499938:0:18806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c2fc337ca00/0x98c38120c44af154 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x98c38120c44af15b expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309589.499944:0:18806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c2fc337ca00/0x98c38120c44af154 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x98c38120c44af15b expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309589.499949:0:18806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788309589.499951:0:18806:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788309589.499953:0:18806:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788309589.499968:0:18806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff8c2fc337ca00/0x98c38120c44af154 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44af15b expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499974:0:18806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788309589.499987:0:18806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c2fc337ca00/0x98c38120c44af154 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44af15b expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.499993:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c2fc337ca00/0x98c38120c44af154 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44af15b expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.500002:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309589.500003:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309589.500004:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309589.500013:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc41d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3619:1875178048142592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788309589.500038:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788309589.500062:0:20735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0600/0x98c38120c44aeb8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44aeb96 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.500075:0:20735:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0600/0x98c38120c44aeb8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44aeb96 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.500081:0:20735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0600/0x98c38120c44aeb8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44aeb96 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.500087:0:20735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0600/0x98c38120c44aeb8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44aeb96 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.500096:0:20735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788309589.500099:0:20735:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788309589.500102:0:20735:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1788309589.500127:0:17152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309589.500131:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0600/0x98c38120c44aeb8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44aeb96 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.500136:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc35f0600 already unused, calling callback (ffffffffc1507c20) 10000000:00010000:2.0:1788309589.500139:0:17152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0600/0x98c38120c44aeb8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44aeb96 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.500425:0:17152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0600/0x98c38120c44aeb8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x98c38120c44aeb96 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309589.500432:0:17152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0600/0x98c38120c44aeb8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x98c38120c44aeb96 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309589.500438:0:17152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788309589.500440:0:17152:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788309589.500442:0:17152:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788309589.500467:0:17152:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0600/0x98c38120c44aeb8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44aeb96 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.500472:0:17152:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788309589.500546:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0600/0x98c38120c44aeb8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44aeb96 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.500554:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0600/0x98c38120c44aeb8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44aeb96 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.500563:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309589.500564:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309589.500566:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309589.500574:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788309589.500581:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc41d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3619:1875178048142720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788309589.500606:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309589.500639:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048142464 00000100:00100000:2.0:1788309589.500644:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048142464 00000100:00100000:2.0:1788309589.500676:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048142336 00000100:00100000:2.0:1788309589.500679:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048142336 00000100:00100000:2.0:1788309589.500688:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048142592 00000100:00100000:2.0:1788309589.500690:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048142592 00000100:00100000:2.0:1788309589.500698:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048142720 00000100:00100000:2.0:1788309589.500700:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048142720 00000100:00100000:2.0:1788309589.500711:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788309589.500718:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42218ed5-7e96-4e9d-b9da-f92649f6b56e+26:3618:x1875178048142464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788309589.500729:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309589.500741:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30edf5b400/0x98c38120c44aefb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x98c38120c44aefb0 expref: 26 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.500753:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309589.500788:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42218ed5-7e96-4e9d-b9da-f92649f6b56e+25:3618:x1875178048142464:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309589.500795:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788309589.500809:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788309589.500814:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42218ed5-7e96-4e9d-b9da-f92649f6b56e+24:3618:x1875178048142336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788309589.500820:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309589.500827:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c2fc337d000/0x98c38120c44aeba4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x98c38120c44aeb9d expref: 24 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.500835:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309589.500874:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42218ed5-7e96-4e9d-b9da-f92649f6b56e+23:3618:x1875178048142336:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309589.500880:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788309589.500890:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788309589.500894:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c3124050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42218ed5-7e96-4e9d-b9da-f92649f6b56e+22:3619:x1875178048142592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788309589.500901:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309589.500907:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c2fc337dc00/0x98c38120c44af15b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x98c38120c44af154 expref: 22 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.500915:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309589.500934:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c3124050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42218ed5-7e96-4e9d-b9da-f92649f6b56e+21:3619:x1875178048142592:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309589.500939:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788309589.500984:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788309589.500989:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42218ed5-7e96-4e9d-b9da-f92649f6b56e+20:3619:x1875178048142720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788309589.500994:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309589.501001:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c2fc337d200/0x98c38120c44aeb96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x98c38120c44aeb8f expref: 20 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309589.501014:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309589.501032:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42218ed5-7e96-4e9d-b9da-f92649f6b56e+19:3619:x1875178048142720:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309589.501037:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788309589.501065:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc41d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3618:1875178048142336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788309589.501072:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc41d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3618:1875178048142464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788309589.501091:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc41d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3619:1875178048142720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788309589.501098:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc41d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3619:1875178048142592:0@lo:103:ldlm_bl.0 00000020:01000004:2.0:1788309589.501132:0:20735:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788309589.501135:0:20735:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788309589.501139:0:20735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788309589.501157:0:20735:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1788309589.501162:0:20735:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8c2fc2b8e800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788309589.501168:0:20735:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8c2fc1a2d800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788309589.501172:0:20735:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8c30c53e4800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788309589.501176:0:20735:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8c30f6147000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788309589.501182:0:20735:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8c30fbbcd000 19ee7afc-7cd6-4884-ada8-19dc985ede5f 192.168.206.32@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:2.0:1788309589.501187:0:20735:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8c30f54ea800 9dfa805c-a92c-4a7c-bdec-be167269c5fb 192.168.206.32@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:2.0:1788309589.501192:0:20735:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8c2fc23ab370) has exports, disconnecting them 00000020:00080000:2.0:1788309589.501196:0:20735:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c2fc2b8e800), last request at 1788309585 00000020:00000080:2.0:1788309589.501202:0:20735:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aef7f 00000100:00080000:2.0:1788309589.501216:0:20735:0:(import.c:65:import_set_state_nolock()) ffff8c2fc2b8c000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788309589.501259:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788309589.501272:0:20735:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c2fc2b8e800): rc 0 00000020:00000080:2.0:1788309589.501275:0:20735:0:(genops.c:885:class_export_put()) final put ffff8c2fc2b8e800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788309589.501284:0:20735:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c2fc1a2d800), last request at 1788309585 00000020:00000080:2.0:1788309589.501287:0:20735:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aee1a 00000100:00080000:2.0:1788309589.501291:0:20735:0:(import.c:65:import_set_state_nolock()) ffff8c2fc1977800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788309589.501302:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc2b8e800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788309589.501344:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c2fc2b8c000 for lustre-MDT0000 00010000:00010000:2.0:1788309589.501354:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788309589.501361:0:20735:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c2fc1a2d800): rc 0 00000020:00000080:2.0:1788309589.501363:0:20735:0:(genops.c:885:class_export_put()) final put ffff8c2fc1a2d800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788309589.501369:0:20735:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c30c53e4800), last request at 1788309528 00000020:00000080:2.0:1788309589.501372:0:20735:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aed6b 00000100:00080000:2.0:1788309589.501375:0:20735:0:(import.c:65:import_set_state_nolock()) ffff8c2fc35ae800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788309589.501382:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc1a2d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788309589.501403:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c2fc1977800 for lustre-MDT0000 00010000:00010000:2.0:1788309589.501408:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788309589.501415:0:20735:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c30c53e4800): rc 0 00000020:00000080:2.0:1788309589.501416:0:20735:0:(genops.c:885:class_export_put()) final put ffff8c30c53e4800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788309589.501421:0:20735:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c30f6147000), last request at 1788309528 00000020:00000080:2.0:1788309589.501424:0:20735:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aed02 00000100:00080000:2.0:1788309589.501427:0:20735:0:(import.c:65:import_set_state_nolock()) ffff8c3101369000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788309589.501433:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30c53e4800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788309589.501455:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c2fc35ae800 for lustre-MDT0000 00010000:00010000:2.0:1788309589.501462:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309589.501604:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788309589.501815:0:20735:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:2.0:1788309589.501956:0:20735:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c30f6147000): rc 0 00000004:00000080:2.0:1788309589.501962:0:20735:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa2ea014d3ae0 00000100:00080000:2.0:1788309589.501978:0:20735:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788309589.501988:0:20735:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788309589.505007:0:20735:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788309589.505041:0:20735:0:(import.c:65:import_set_state_nolock()) ffff8c2fc2a6a000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788309589.505096:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc41d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048142848:0@lo:39:umount.0 00000100:00100000:1.0:1788309589.505186:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788309589.506047:0:20735:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788309589.506052:0:20735:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1788309589.506104:0:20735:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788309589.506187:0:20735:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788309589.506205:0:20735:0:(import.c:65:import_set_state_nolock()) ffff8c30f0d6d000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788309589.506293:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc41d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048142976:0@lo:9:umount.0 00000100:00100000:1.0:1788309589.506348:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309589.506390:0:17904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048142848 00000100:00100000:1.0:1788309589.506397:0:17904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048142848 00000100:00100000:1.0:1788309589.506457:0:17904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788309589.506467:0:17904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3101bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875178048142848:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788309589.506505:0:17904:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aed95 00000100:00080000:1.0:1788309589.506512:0:17904:0:(import.c:65:import_set_state_nolock()) ffff8c30f54b0800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788309589.506535:0:17904:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788309589.506654:0:17904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3101bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3616:x1875178048142848:12345-0@lo:39:umount.0 Request processed in 188us (1468us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788309589.506662:0:17904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788309589.506684:0:19862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048142976 00000100:00100000:1.0:1788309589.506688:0:19862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048142976 00000100:00100000:1.0:1788309589.506714:0:19862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788309589.506721:0:19862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3101bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1875178048142976:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788309589.506736:0:19862:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aee59 00000100:00080000:1.0:1788309589.506742:0:19862:0:(import.c:65:import_set_state_nolock()) ffff8c30f5f86800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788309589.506775:0:19862:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788309589.506890:0:19862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3101bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3616:x1875178048142976:12345-0@lo:9:umount.0 Request processed in 168us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309589.506897:0:19862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1788309589.506917:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309589.506926:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788309589.507168:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30f0d6d000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788309589.507675:0:20735:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788309589.507680:0:20735:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:2.0:1788309589.507693:0:20735:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788309589.507767:0:20735:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788309589.507785:0:20735:0:(import.c:65:import_set_state_nolock()) ffff8c2fc365d800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788309589.507828:0:20735:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8c2fc23ab370) has no exports 00000004:00080000:1.0:1788309589.508347:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788309589.508352:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788309589.508357:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc41d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048142976:0@lo:9:umount.0 00000100:00080000:1.0:1788309589.508383:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c2fc2a6a000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788309589.508388:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc41d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048142848:0@lo:39:umount.0 00000100:00100000:1.0:1788309589.508409:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc41d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048143104:0@lo:9:umount.0 00000100:00100000:1.0:1788309589.508664:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309589.510615:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048143104 00000100:00100000:0.0:1788309589.510627:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048143104 00000100:00100000:0.0:1788309589.510685:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788309589.510695:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3101bb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875178048143104:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788309589.510720:0:18670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aefbe 00000100:00080000:0.0:1788309589.510729:0:18670:0:(import.c:65:import_set_state_nolock()) ffff8c30f54ee800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788309589.510764:0:18670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1788309589.510930:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3101bb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3616:x1875178048143104:12345-0@lo:9:umount.0 Request processed in 237us (2265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309589.510937:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1788309589.510962:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788309589.511730:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c2fc365d800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788309589.511744:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788309589.511746:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788309589.511750:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc41d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048143104:0@lo:9:umount.0 00000100:00080000:0.0:1788309589.512022:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1788309589.512647:0:19483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788309589.512652:0:19483:0:(genops.c:885:class_export_put()) final put ffff8c30f54ef800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788309589.512670:0:19483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9dfa805c-a92c-4a7c-bdec-be167269c5fb 00000020:00000080:0.0:1788309589.512672:0:19483:0:(genops.c:885:class_export_put()) final put ffff8c2fc2b8a800/9dfa805c-a92c-4a7c-bdec-be167269c5fb 00000001:00100000:0.0:1788309589.512680:0:19483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 19ee7afc-7cd6-4884-ada8-19dc985ede5f 00000020:00000080:0.0:1788309589.512682:0:19483:0:(genops.c:885:class_export_put()) final put ffff8c30fbbce000/19ee7afc-7cd6-4884-ada8-19dc985ede5f 00000020:00000080:0.0:1788309589.512695:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f54ef800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788309589.512731:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc2b8a800/9dfa805c-a92c-4a7c-bdec-be167269c5fb for lustre-OST0001 00000020:00000080:0.0:1788309589.512749:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30fbbce000/19ee7afc-7cd6-4884-ada8-19dc985ede5f for lustre-OST0001 00000020:00000080:0.0:1788309589.512764:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c30f54ee800 for lustre-OST0001 00000020:00000080:0.0:1788309589.512768:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c2fc2b8b800 for lustre-OST0001 00000020:00000080:0.0:1788309589.512772:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c30fbbc9000 for lustre-OST0001 00000001:00100000:2.0:1788309589.515557:0:18666:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788309589.515566:0:18666:0:(genops.c:885:class_export_put()) final put ffff8c30f5f83000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788309589.515593:0:18666:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9dfa805c-a92c-4a7c-bdec-be167269c5fb 00000020:00000080:2.0:1788309589.515597:0:18666:0:(genops.c:885:class_export_put()) final put ffff8c30f0939000/9dfa805c-a92c-4a7c-bdec-be167269c5fb 00000001:00100000:2.0:1788309589.515603:0:18666:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 19ee7afc-7cd6-4884-ada8-19dc985ede5f 00000020:00000080:2.0:1788309589.515605:0:18666:0:(genops.c:885:class_export_put()) final put ffff8c2fc2b88000/19ee7afc-7cd6-4884-ada8-19dc985ede5f 00000020:00000080:0.0:1788309589.515649:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f5f83000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788309589.515697:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f0939000/9dfa805c-a92c-4a7c-bdec-be167269c5fb for lustre-OST0000 00000020:00000080:0.0:1788309589.515713:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc2b88000/19ee7afc-7cd6-4884-ada8-19dc985ede5f for lustre-OST0000 00000020:00000080:0.0:1788309589.515728:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c30f5f86800 for lustre-OST0000 00000020:00000080:0.0:1788309589.515733:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c30f093e000 for lustre-OST0000 00000020:00000080:0.0:1788309589.515736:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c2fc2b8e000 for lustre-OST0000 00000020:00080000:2.0:1788309589.521667:0:20735:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8c2fc23ab370) has no exports 00000020:00000080:2.0:1788309589.572724:0:20735:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aebea 00000020:00000080:2.0:1788309589.572738:0:20735:0:(genops.c:885:class_export_put()) final put ffff8c30c7b74800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788309589.572859:0:20735:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788309589.573805:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30c7b74800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788309589.573867:0:20735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788309589.573877:0:20735:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788309589.573882:0:20735:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8c2fc23acd28) has no exports 00000020:00000080:3.0:1788309589.574137:0:20735:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aebe3 00000020:00000080:3.0:1788309589.574144:0:20735:0:(genops.c:885:class_export_put()) final put ffff8c30f0d68000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788309589.574197:0:20735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788309589.574204:0:20735:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788309589.574207:0:20735:0:(genops.c:885:class_export_put()) final put ffff8c30f0d66800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788309589.574209:0:20735:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f0d66800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788309589.574216:0:20735:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788309589.574401:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f0d68000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1788309590.122051:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788309590.122073:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875178048143232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788309590.122141:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788309590.122949:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309590.126203:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048143232 00000100:00100000:3.0:1788309590.126217:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048143232 00000100:00100000:3.0:1788309590.126328:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788309590.126337:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1875178048143232:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1788309590.126345:0:17170:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788309590.126454:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1875178048143232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (4304us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788309590.126470:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:02020000:1.0:1788309590.126776:0:3618:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1788309590.130242:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788309590.130249:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8c30f0d6c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788309590.130253:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788309590.140267:0:3618:0:(import.c:65:import_set_state_nolock()) ffff8c30f0d6c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788309590.140279:0:3618:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 438 00000100:00080000:1.0:1788309590.140288:0:3618:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c30f0d6c000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:1.0:1788309590.140337:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3101bb4a80 x1875178048143360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788309590.140406:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3101bb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048143360:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788309590.140647:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309590.141361:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048143360 00000100:00100000:3.0:1788309590.141370:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048143360 00000100:00100000:3.0:1788309590.141469:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788309590.141499:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1875178048143360:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1788309590.141516:0:17169:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788309590.147575:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1875178048143360:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 5940us (6791us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788309590.147591:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1788309590.147696:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30f0d6c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788309590.147701:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788309590.147705:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3101bb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048143360:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788309590.634044:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788309590.634067:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048143488:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788309590.634283:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309590.634354:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048143488 00000100:00100000:0.0:1788309590.634367:0:18673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048143488 00000100:00100000:0.0:1788309590.634436:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788309590.634442:0:18674:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788309590.634455:0:18674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788309590.634456:0:18673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3101bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048143488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788309590.634492:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788309590.634543:0:18673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3101bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048143488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309590.634553:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788309590.634662:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788309590.634708:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048143488:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788309590.635221:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc41d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3619:1875178048143616:0@lo:400:kworker.0 00000100:00100000:1.0:1788309590.635263:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309590.635265:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc41d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048143744:0@lo:400:kworker.0 00000100:00100000:1.0:1788309590.635307:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc41d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875178048144128:0@lo:400:kworker.0 00000100:00100000:2.0:1788309590.635323:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309590.635323:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048143616 00000100:00100000:0.0:1788309590.635329:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048143616 00000100:00100000:2.0:1788309590.635350:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc41d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875178048144256:0@lo:400:kworker.0 00000100:00100000:1.0:1788309590.635362:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309590.635366:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788309590.635374:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc36ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42218ed5-7e96-4e9d-b9da-f92649f6b56e+19:3619:x1875178048143616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309590.635385:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309590.635409:0:19862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048143744 00000100:00100000:1.0:1788309590.635414:0:19862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048143744 00000100:00100000:0.0:1788309590.635418:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc36ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42218ed5-7e96-4e9d-b9da-f92649f6b56e+19:3619:x1875178048143616:12345-0@lo:400:kworker.0 Request processed in 44us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309590.635422:0:19499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048144128 00000100:00100000:2.0:1788309590.635426:0:19499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048144128 00000100:00100000:0.0:1788309590.635426:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788309590.635452:0:19862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788309590.635461:0:19862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048143744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309590.635485:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048144256 00000100:00100000:0.0:1788309590.635490:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048144256 00000100:00100000:1.0:1788309590.635506:0:19862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048143744:12345-0@lo:400:kworker.0 Request processed in 45us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309590.635514:0:19862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788309590.635520:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788309590.635527:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1875178048144256:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788309590.635533:0:17164:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788309590.635555:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc41d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048143744:0@lo:400:kworker.0 00000100:00100000:0.0:1788309590.635571:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1875178048144256:12345-0@lo:400:kworker.0 Request processed in 42us (184us total) trans 0 rc -107/-107 00000100:00080000:1.0:1788309590.635574:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788309590.635582:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c2fc1926000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:0.0:1788309590.635582:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788309590.635590:0:19499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:02000400:1.0:1788309590.635590:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788309590.635598:0:3620:0:(import.c:65:import_set_state_nolock()) ffff8c2fc1926000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1788309590.635601:0:19499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875178048144128:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788309590.635605:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 464 00000100:00080000:1.0:1788309590.635613:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c2fc1926000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:0.0:1788309590.635617:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc41d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3619:1875178048143616:0@lo:400:kworker.0 00000100:00100000:2.0:1788309590.635635:0:19499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875178048144128:12345-0@lo:400:kworker.0 Request processed in 37us (276us total) trans 0 rc 0/0 00010000:00080000:0.0:1788309590.635637:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c2fc41d0700 x1875178048144128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309590.635639:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c2fc4019c00 x1875178048144512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788309590.635644:0:19499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788309590.635661:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc41d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875178048144128:0@lo:400:kworker.0 00000100:00100000:2.0:1788309590.635669:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc41d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875178048143872:0@lo:400:kworker.0 00000100:00100000:2.0:1788309590.635692:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788309590.635693:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788309590.635707:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc41d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875178048144384:0@lo:400:kworker.0 00000100:00100000:2.0:1788309590.635728:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309590.635745:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788309590.635747:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc41d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875178048144256:0@lo:400:kworker.0 00000100:00100000:2.0:1788309590.635752:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc41d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875178048144000:0@lo:400:kworker.0 00000100:00100000:2.0:1788309590.635783:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309590.635786:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048143872 00000100:00100000:1.0:1788309590.635791:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048143872 00000100:00100000:2.0:1788309590.635813:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048144384 00000100:00100000:1.0:1788309590.635816:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048144000 00000100:00100000:2.0:1788309590.635818:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048144384 00000100:00100000:1.0:1788309590.635822:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048144000 00000100:00100000:1.0:1788309590.635866:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788309590.635872:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d3b06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875178048143872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309590.636042:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc4019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1875178048144512:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788309590.636443:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788309590.636455:0:17166:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788309590.636490:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d3b06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875178048143872:12345-0@lo:400:kworker.0 Request processed in 617us (797us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788309590.636583:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048144512 00000100:00100000:0.0:1788309590.636588:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048144512 00000100:00100000:2.0:1788309590.636665:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788309590.636674:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d3b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875178048144384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309590.636683:0:19499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788309590.636691:0:19499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d3b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3617:x1875178048144000:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788309590.636697:0:19499:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788309590.636727:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d3b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875178048144384:12345-0@lo:400:kworker.0 Request processed in 54us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309590.636734:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788309590.636739:0:19499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d3b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3617:x1875178048144000:12345-0@lo:400:kworker.0 Request processed in 45us (954us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788309590.636748:0:19499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788309590.636756:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788309590.636782:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788309590.636794:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8c30c7d22000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788309590.636798:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788309590.636803:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8c30c7d22000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788309590.636807:0:3617:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 451 00000100:00080000:2.0:1788309590.636812:0:3617:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c30c7d22000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:2.0:1788309590.636832:0:3617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30d3b04e00 x1875178048144640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788309590.637059:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788309590.637135:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc41d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875178048144000:0@lo:400:kworker.0 00000100:00080000:2.0:1788309590.637150:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788309590.637152:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8c2fc2a6d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788309590.637155:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788309590.637158:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8c2fc2a6d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788309590.637161:0:3617:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 438 00000100:00080000:2.0:1788309590.637165:0:3617:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c2fc2a6d800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:2.0:1788309590.637179:0:3617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30d3b05880 x1875178048144768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788309590.637188:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc41d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875178048143872:0@lo:400:kworker.0 00000100:00100000:1.0:1788309590.637363:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1875178048144640:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788309590.637404:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309590.637464:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875178048144768:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788309590.637486:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788309590.637493:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c2fc41d2680 x1875178048144384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309590.637504:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc41d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875178048144384:0@lo:400:kworker.0 00000100:00100000:3.0:1788309590.637533:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048144640 00000100:00100000:3.0:1788309590.637539:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048144640 00000100:00100000:2.0:1788309590.637553:0:19499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048144768 00000100:00100000:2.0:1788309590.637559:0:19499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048144768 00000100:00100000:3.0:1788309590.637566:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788309590.637575:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1875178048144640:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1788309590.637591:0:17164:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788309590.637597:0:19499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788309590.637603:0:19499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1875178048144768:12345-0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788309590.637604:0:17166:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788309590.637614:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00010000:02000000:2.0:1788309590.637616:0:19499:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788309590.637629:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1875178048144640:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 52us (223us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788309590.637639:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788309590.637658:0:19499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1875178048144768:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 52us (168us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788309590.637666:0:19499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788309590.637780:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30c7d22000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788309590.638091:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788309590.638096:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1875178048144640:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788309590.638111:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c2fc2a6d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788309590.638114:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788309590.638116:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875178048144768:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788309590.639888:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788309590.639899:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1875178048144512:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1788309590.639915:0:17165:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788309590.640012:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1875178048144512:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 112us (3569us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788309590.640020:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1788309590.640059:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c2fc1926000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788309590.640064:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788309590.640069:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc4019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1875178048144512:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:1.0:1788309591.147217:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788309591.659363:0:17896:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788309591.659449:0:17896:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:3.0:1788309591.659454:0:17896:0:(genops.c:885:class_export_put()) final put ffff8c30f54b1800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788309591.660683:0:17144:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788309591.660689:0:17144:0:(genops.c:885:class_export_put()) final put ffff8c30f6147000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788309591.660754:0:17896:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 19ee7afc-7cd6-4884-ada8-19dc985ede5f 00000001:00080000:3.0:1788309591.660762:0:17896:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:3.0:1788309591.660766:0:17896:0:(genops.c:885:class_export_put()) final put ffff8c2fc2b8a000/19ee7afc-7cd6-4884-ada8-19dc985ede5f 00000001:00100000:2.0:1788309591.664456:0:17144:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 19ee7afc-7cd6-4884-ada8-19dc985ede5f 00000001:00080000:2.0:1788309591.664481:0:17144:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:2.0:1788309591.664486:0:17144:0:(genops.c:885:class_export_put()) final put ffff8c30fbbcd000/19ee7afc-7cd6-4884-ada8-19dc985ede5f 00000001:00100000:2.0:1788309591.664502:0:17144:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9dfa805c-a92c-4a7c-bdec-be167269c5fb 00000001:00080000:2.0:1788309591.664508:0:17144:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:2.0:1788309591.664514:0:17144:0:(genops.c:885:class_export_put()) final put ffff8c30f54ea800/9dfa805c-a92c-4a7c-bdec-be167269c5fb 00000001:00100000:3.0:1788309591.664559:0:17896:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9dfa805c-a92c-4a7c-bdec-be167269c5fb 00000001:00080000:3.0:1788309591.664580:0:17896:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:3.0:1788309591.664584:0:17896:0:(genops.c:885:class_export_put()) final put ffff8c30f54ed800/9dfa805c-a92c-4a7c-bdec-be167269c5fb 00000020:00000080:0.0:1788309591.664948:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f54b1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788309591.665016:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f6147000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788309591.665038:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc2b8a000/19ee7afc-7cd6-4884-ada8-19dc985ede5f for lustre-MDT0001 00000020:00000080:0.0:1788309591.665060:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30fbbcd000/19ee7afc-7cd6-4884-ada8-19dc985ede5f for lustre-MDT0000 00000020:00000080:0.0:1788309591.665086:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f54ea800/9dfa805c-a92c-4a7c-bdec-be167269c5fb for lustre-MDT0000 00000020:00000080:0.0:1788309591.665107:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f54ed800/9dfa805c-a92c-4a7c-bdec-be167269c5fb for lustre-MDT0001 00000020:00000080:0.0:1788309591.665125:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c30f54b0800 for lustre-MDT0001 00000020:00000080:0.0:1788309591.665130:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c3101369000 for lustre-MDT0000 00000020:00000080:0.0:1788309591.665133:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c2fc2b8d000 for lustre-MDT0001 00000020:00000080:0.0:1788309591.665136:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c30fbbc8000 for lustre-MDT0000 00000020:00000080:0.0:1788309591.665139:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c30f54eb800 for lustre-MDT0000 00000020:00000080:0.0:1788309591.665144:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c30f58ad800 for lustre-MDT0001 00000040:00080000:1.0:1788309591.978642:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788309592.170040:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309593.194576:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309594.218009:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309594.218220:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875178048144896:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788309594.218329:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309594.218776:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048144896 00000100:00100000:3.0:1788309594.218784:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048144896 00000100:00100000:3.0:1788309594.218932:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788309594.218943:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875178048144896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788309594.218971:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788309594.219021:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875178048144896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309594.219028:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788309594.219220:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875178048144896:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788309594.219375:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788309595.242253:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788309595.626191:0:20735:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c30d01c6420 - data ffff8c30e02dbd80/ffff8c30c83a1000 00000020:01000000:1.0:1788309595.626323:0:20735:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c2fc1b8ed80 - data ffff8c30ee6bf438/ffff8c30f5c8c800 00000001:00000004:1.0:1788309595.636099:0:20735:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:0.0:1788309595.672354:0:20735:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788309595.672362:0:20735:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788309595.672375:0:20735:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8c2fc41d1f80 x1875178048142848/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788309599 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309595.672409:0:20735:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788309595.674052:0:20735:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788309595.674057:0:20735:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788309595.674078:0:20735:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788309595.674080:0:20735:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788309595.674995:0:17188:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788309595.675000:0:17188:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1788309595.675009:0:17188:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1788309595.675836:0:20735:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788309595.675860:0:20735:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:0.0:1788309595.675872:0:20735:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788309595.675875:0:20735:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788309595.676304:0:17190:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788309595.676308:0:17190:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:3.0:1788309595.676317:0:17190:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788309595.677207:0:20735:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aebb2 00000020:00000080:0.0:1788309595.677217:0:20735:0:(genops.c:885:class_export_put()) final put ffff8c2fc4271000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788309595.677595:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc4271000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788309595.680116:0:20735:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aebc7 00000020:00000080:0.0:1788309595.680710:0:20735:0:(genops.c:885:class_export_put()) final put ffff8c30f0d64000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788309595.680755:0:20735:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788309595.680761:0:20735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788309595.680769:0:20735:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788309595.680773:0:20735:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8c2fc23a99b8) has no exports 00000004:01000000:0.0:1788309595.680951:0:20735:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788309595.680959:0:20735:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aec29 00000020:00000080:0.0:1788309595.680963:0:20735:0:(genops.c:885:class_export_put()) final put ffff8c2fc3659800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788309595.681956:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f0d64000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788309595.683612:0:20735:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788309595.683623:0:20735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788309595.683632:0:20735:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788309595.683637:0:20735:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8c30fb96b370) has no exports 00000020:00000080:0.0:1788309595.683645:0:20735:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aec22 00000020:00000080:0.0:1788309595.683661:0:20735:0:(genops.c:885:class_export_put()) final put ffff8c2fc365b000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788309595.684562:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc3659800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1788309595.688149:0:20735:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788309595.688157:0:20735:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788309595.688161:0:20735:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:0.0:1788309595.688168:0:20735:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788309595.688170:0:20735:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788309595.688693:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc365b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788309595.688812:0:20735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788309595.688822:0:20735:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788309595.688833:0:20735:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aec14 00000020:00000080:0.0:1788309595.688860:0:20735:0:(genops.c:885:class_export_put()) final put ffff8c2fc3659000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788309595.688907:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c2fc365d800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788309595.688914:0:36:0:(genops.c:885:class_export_put()) final put ffff8c2fc365c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788309595.688917:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc365c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788309595.688922:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788309595.689062:0:20735:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788309595.689067:0:20735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788309595.689074:0:20735:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788309595.689078:0:20735:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8c30f0d819b8) has no exports 00000020:00000080:0.0:1788309595.689084:0:20735:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aec0d 00000020:00000080:0.0:1788309595.689089:0:20735:0:(genops.c:885:class_export_put()) final put ffff8c30f0d6a000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788309595.689113:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc3659000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:0.0:1788309595.689750:0:20735:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788309595.689755:0:20735:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788309595.689758:0:20735:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788309595.689762:0:20735:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788309595.689765:0:20735:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788309595.690555:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f0d6a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788309595.690722:0:20735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788309595.690730:0:20735:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1788309595.690747:0:20735:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788309595.690754:0:20735:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aebff 00000020:00000080:0.0:1788309595.690761:0:20735:0:(genops.c:885:class_export_put()) final put ffff8c30f9a31800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788309595.690833:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c30f0d6d000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788309595.690854:0:36:0:(genops.c:885:class_export_put()) final put ffff8c30f0d69800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788309595.690857:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f0d69800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788309595.690870:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788309595.691031:0:20735:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1788309595.691036:0:20735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788309595.691041:0:20735:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788309595.691045:0:20735:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8c30fb968000) has no exports 00000020:00000080:0.0:1788309595.691050:0:20735:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aebf8 00000020:00000080:0.0:1788309595.691054:0:20735:0:(genops.c:885:class_export_put()) final put ffff8c2fc2a6f000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788309595.691361:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f9a31800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788309595.691368:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc2a6f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788309595.694055:0:20735:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1788309595.694064:0:20735:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788309595.694068:0:20735:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788309595.694076:0:20735:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788309595.694128:0:20735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788309595.694139:0:20735:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788309595.694164:0:20735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788309595.694167:0:20735:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788309595.694172:0:20735:0:(genops.c:885:class_export_put()) final put ffff8c2fc4277800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788309595.694177:0:20735:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc4277800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788309595.694184:0:20735:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788309595.694361:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c2fc2a6a000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788309595.694369:0:36:0:(genops.c:885:class_export_put()) final put ffff8c2fc2a69800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788309595.694371:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc2a69800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1788309595.694375:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788309595.694528:0:20735:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aebce 00000020:00000080:3.0:1788309595.694535:0:20735:0:(genops.c:885:class_export_put()) final put ffff8c30f0d60800/lustre-MDD0000_UUID 00000020:01000000:3.0:1788309595.694576:0:20735:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788309595.694589:0:20735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788309595.694595:0:20735:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788309595.694600:0:20735:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8c2fc23a8000) has no exports 00000020:00000080:3.0:1788309595.694619:0:20735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788309595.694622:0:20735:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788309595.694626:0:20735:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aebd5 00000020:00000080:3.0:1788309595.694630:0:20735:0:(genops.c:885:class_export_put()) final put ffff8c30f0d62800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788309595.694765:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f0d60800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788309595.694770:0:36:0:(genops.c:885:class_export_put()) final put ffff8c2fc4276000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788309595.694772:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc4276000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788309595.694776:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:3.0:1788309595.695132:0:20735:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c2fc4310800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788309595.695137:0:20735:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c2fc4310800 3 00000020:01000004:3.0:1788309595.695140:0:20735:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c2fc4310800 from lustre-MDT0000 00000020:00000080:3.0:1788309595.695156:0:20735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788309595.695175:0:20735:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788309595.695179:0:20735:0:(genops.c:885:class_export_put()) final put ffff8c2fc4274800/lustre-MDT0000_UUID 00000020:00000080:3.0:1788309595.695181:0:20735:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc4274800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788309595.695191:0:20735:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788309595.695227:0:20735:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1788309595.695232:0:20735:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788309595.695235:0:20735:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788309595.695238:0:20735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788309595.695241:0:20735:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788309595.695246:0:20735:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8c2fc3744000 42218ed5-7e96-4e9d-b9da-f92649f6b56e 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788309595.695251:0:20735:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8c30c7b33370) has exports, disconnecting them 00000020:00080000:3.0:1788309595.695255:0:20735:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8c2fc3744000), last request at 1788309517 00000020:00000080:3.0:1788309595.695280:0:20735:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aeb7a 00000020:00010000:3.0:1788309595.695292:0:20735:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c2fc3744000: total 1 00000100:00080000:3.0:1788309595.695296:0:20735:0:(import.c:65:import_set_state_nolock()) ffff8c2fc3741800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788309595.695312:0:20735:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c2fc3744000): rc 0 00000020:00080000:3.0:1788309595.695316:0:20735:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8c30c7b33370) has no exports 00000020:00010000:1.0:1788309595.695384:0:18806:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c2fc3744000: total 1 00010000:00010000:1.0:1788309595.695389:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309595.695427:0:18806:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c2fc3744000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788309595.695458:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30edf5a000/0x98c38120c44aef40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x98c38120c44aef39 expref: 14 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788309595.695459:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f0d62800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788309595.695480:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30d3d91400/0x98c38120c44af14d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x98c38120c44af146 expref: 13 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309595.695491:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30fba6a600/0x98c38120c44aef6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x98c38120c44aef63 expref: 12 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309595.695502:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30edf5aa00/0x98c38120c44aefa9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x98c38120c44aefa2 expref: 11 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309595.695514:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30edf5a800/0x98c38120c44aeddb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x98c38120c44aedd4 expref: 10 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309595.695524:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30edf5ba00/0x98c38120c44aec99 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x98c38120c44aec92 expref: 9 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309595.695535:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44aee05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x98c38120c44aedfe expref: 8 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309595.695545:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30d3d91800/0x98c38120c44af131 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x98c38120c44af12a expref: 7 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309595.695565:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30fba6bc00/0x98c38120c44aed56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x98c38120c44aed4f expref: 6 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309595.695578:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30fba6b000/0x98c38120c44aeca7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x98c38120c44aeca0 expref: 5 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309595.695589:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c2fc337c600/0x98c38120c44af13f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x98c38120c44af138 expref: 4 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309595.695603:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c2fc337c000/0x98c38120c44aecb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x98c38120c44aecae expref: 3 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309595.695633:0:17158:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8c2fc41d5800:17158] 1 exiting: rc = 0 00010000:00010000:1.0:1788309595.695694:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30edf5a400/0x98c38120c44aeb88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x98c38120c44aeb81 expref: 2 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309595.695715:0:18806:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c2fc3744000, canceled 13 locks, left on hash table 0. 00000100:00100000:3.0:1788309595.695735:0:17157:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8c30f026f600:17157] 0 exiting: rc = 1 00000100:00100000:3.0:1788309595.695794:0:17159:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8c2fc41d5600:17159] 2 exiting: rc = 0 00000020:00000080:1.0:1788309595.695804:0:18806:0:(genops.c:885:class_export_put()) final put ffff8c2fc3744000/42218ed5-7e96-4e9d-b9da-f92649f6b56e 00010000:00010000:1.0:1788309595.695817:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309595.695819:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309595.695821:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788309595.695829:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc3744000/42218ed5-7e96-4e9d-b9da-f92649f6b56e for MGS 00000020:00000080:1.0:1788309595.696012:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c2fc3741800 for MGS 00000100:00100000:2.0:1788309595.696160:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696168:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696175:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696181:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696187:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696193:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696199:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696205:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696212:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696218:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696224:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696230:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696235:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696241:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696248:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696253:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696259:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696264:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696291:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696307:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696313:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696318:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696324:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696329:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696335:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696339:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696344:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696349:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696354:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696359:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696365:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696369:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696373:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696489:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696501:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696510:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696517:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696524:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696532:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696538:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696547:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696555:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696561:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696569:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696576:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696583:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696589:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696594:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696598:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696603:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696607:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696611:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696616:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696622:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696636:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696641:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696647:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696652:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696657:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696662:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696667:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696672:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696677:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309595.696682:0:20735:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1788309595.698313:0:20735:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c30d01c6060 - data ffff8c30e02fb5e8/ffff8c30c83a1400 00000020:01000000:3.0:1788309595.698791:0:20735:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c2fc344e8a0 - data ffff8c30ee4ba000/ffff8c30f521a400 00000020:00000080:3.0:1788309595.702906:0:20735:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aeb5e 00000020:00000080:3.0:1788309595.702926:0:20735:0:(genops.c:885:class_export_put()) final put ffff8c2fc21e1000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788309595.702984:0:20735:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c2fc4310800 from MGS, refs=2 00000020:01000004:3.0:1788309595.702988:0:20735:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c2fc4310800 2 00000020:01000004:3.0:1788309595.702991:0:20735:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c2fc4310800 from MGS 00000020:00000080:3.0:1788309595.703018:0:20735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788309595.703027:0:20735:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788309595.703030:0:20735:0:(genops.c:885:class_export_put()) final put ffff8c2fc21e7800/MGS 00000020:00000080:3.0:1788309595.703033:0:20735:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc21e7800/MGS for MGS 00000020:01000000:3.0:1788309595.703041:0:20735:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788309595.703107:0:20735:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788309595.703111:0:20735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788309595.703116:0:20735:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788309595.703123:0:20735:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8c30d1458800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788309595.703128:0:20735:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8c30fb96cd28) has exports, disconnecting them 00000020:00080000:3.0:1788309595.703133:0:20735:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8c30d1458800), last request at 1788309517 00000020:00000080:3.0:1788309595.703137:0:20735:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aec61 00000020:00080000:3.0:1788309595.703147:0:20735:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c30d1458800): rc 0 00000020:00000080:3.0:1788309595.703151:0:20735:0:(genops.c:885:class_export_put()) final put ffff8c30d1458800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788309595.703548:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc21e1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788309595.704291:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30d1458800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788309595.714592:0:20735:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788309595.714601:0:20735:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788309595.714606:0:20735:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788309595.714612:0:20735:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788309595.714881:0:20735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788309595.714890:0:20735:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788309595.714896:0:20735:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c2fc4310800 1 00000020:00000080:3.0:1788309595.714903:0:20735:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aeb50 00000020:00000080:3.0:1788309595.714911:0:20735:0:(genops.c:885:class_export_put()) final put ffff8c2fc21e4000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788309595.715011:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c2fc2a6c000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788309595.715019:0:36:0:(genops.c:885:class_export_put()) final put ffff8c2fc4270800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788309595.715022:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc4270800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788309595.715029:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:3.0:1788309595.715183:0:20735:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788309595.715188:0:20735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788309595.715201:0:20735:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788309595.715205:0:20735:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8c31012619b8) has no exports 00000020:00000080:2.0:1788309595.715358:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc21e4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1788309595.754562:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788309595.755332:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3620:1875178048145152:0@lo:400:kworker.0 00000400:00000100:3.0:1788309595.755390:0:3620:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875178048145152 offset 0 length 224: 4 00000100:00100000:3.0:1788309595.755432:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048145024:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788309595.755473:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309595.755558:0:20737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048145024 00000100:00100000:0.0:1788309595.755567:0:20737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048145024 00000100:00100000:0.0:1788309595.755617:0:20737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788309595.755627:0:20737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048145024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788309595.755654:0:20737:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788309595.755700:0:20737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048145024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309595.755708:0:20737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788309595.755727:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788309595.755760:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048145024:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788309595.755998:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788309595.756004:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788309595.756007:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c30f0d6c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788309595.756013:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 500 00000100:00080000:2.0:1788309595.756018:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788309595.756024:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c30f0d6c000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:2.0:1788309595.756048:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30d3b06d80 x1875178048145280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788309595.756095:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1788309595.756098:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048145280:0@lo:38:kworker.0 00000100:00080000:2.0:1788309595.756100:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788309595.756104:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c2fc2a6d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788309595.756118:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 500 00000100:00080000:2.0:1788309595.756122:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788309595.756126:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c2fc2a6d800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:0.0:1788309595.756142:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309595.756144:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30d3b07b80 x1875178048145536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788309595.756186:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048145280 00000100:00100000:0.0:1788309595.756191:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048145280 00000100:00100000:0.0:1788309595.756220:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788309595.756226:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1875178048145280:12345-0@lo:38:kworker.0 00000100:00080000:2.0:1788309595.756227:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788309595.756234:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788309595.756236:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c30c7d22000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788309595.756240:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 500 00000100:00080000:2.0:1788309595.756242:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788309595.756246:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c30c7d22000 using connection 192.168.206.132@tcp/0@lo 00010000:00020000:0.0:1788309595.756249:0:17170:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788309595.756263:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30d3b05f80 x1875178048145664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788309595.756297:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788309595.756300:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788309595.756302:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c2fc1926000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788309595.756306:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 500 00000100:00080000:2.0:1788309595.756313:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788309595.756318:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c2fc1926000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:2.0:1788309595.756332:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30d3b05c00 x1875178048145920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788309595.756399:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048145408:0@lo:400:kworker.0 00000100:00100000:2.0:1788309595.756430:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309595.756453:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788309595.756543:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875178048145792:0@lo:400:kworker.0 00000100:00100000:2.0:1788309595.756643:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309595.756679:0:19499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048145792 00000100:00100000:2.0:1788309595.756684:0:19499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048145792 00000100:00100000:2.0:1788309595.756719:0:19499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788309595.756727:0:19499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d3b04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875178048145792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309595.756768:0:19499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d3b04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875178048145792:12345-0@lo:400:kworker.0 Request processed in 42us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309595.756774:0:19499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788309595.756796:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875178048146048:0@lo:400:kworker.0 00000100:00100000:2.0:1788309595.756819:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788309595.757059:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c30d3b07480 x1875178048145792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309595.757069:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875178048145792:0@lo:400:kworker.0 00000100:00100000:2.0:1788309595.757098:0:20738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048146048 00000100:00100000:2.0:1788309595.757101:0:20738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048146048 00000100:00100000:2.0:1788309595.757127:0:20738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788309595.757133:0:20738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d3b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875178048146048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309595.757249:0:20738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d3b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875178048146048:12345-0@lo:400:kworker.0 Request processed in 116us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309595.757256:0:20738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:2.0:1788309595.757282:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c30d3b05180 x1875178048146048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309595.757302:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875178048146048:0@lo:400:kworker.0 00000100:00100000:1.0:1788309595.768067:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048145408 00000100:00100000:1.0:1788309595.768081:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048145408 00000100:00100000:1.0:1788309595.768155:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788309595.768168:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d3b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048145408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309595.768263:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d3b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048145408:12345-0@lo:400:kworker.0 Request processed in 99us (11831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309595.768295:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788309595.768332:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788309595.768356:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875178048145536:0@lo:38:kworker.0 00000100:00100000:1.0:1788309595.768641:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309595.768681:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1875178048145664:0@lo:38:kworker.0 00000100:00100000:1.0:1788309595.768713:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309595.768737:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1875178048145920:0@lo:38:kworker.0 00000100:00100000:1.0:1788309595.768763:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309595.770806:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048145536 00000100:00100000:2.0:1788309595.770834:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048145536 00000100:00100000:2.0:1788309595.771171:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048145664 00000100:00100000:2.0:1788309595.771175:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048145664 00000100:00100000:2.0:1788309595.771192:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048145920 00000100:00100000:2.0:1788309595.771195:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048145920 00000100:00100000:2.0:1788309595.771208:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788309595.771224:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1875178048145536:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788309595.771248:0:17166:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788309595.771336:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1875178048145536:12345-0@lo:38:kworker.0 Request processed in 118us (2697us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788309595.771344:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788309595.771483:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788309595.771489:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1875178048145664:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788309595.771499:0:17166:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788309595.771530:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1875178048145664:12345-0@lo:38:kworker.0 Request processed in 40us (2819us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788309595.771536:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788309595.771548:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788309595.771553:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1875178048145920:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788309595.771562:0:17166:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788309595.771587:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1875178048145920:12345-0@lo:38:kworker.0 Request processed in 32us (2824us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788309595.771593:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1788309595.771634:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c2fc2a6d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788309595.771638:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788309595.771643:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875178048145536:0@lo:38:kworker.0 00000100:00080000:2.0:1788309595.771663:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30c7d22000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788309595.771667:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788309595.771670:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1875178048145664:0@lo:38:kworker.0 00000100:00080000:2.0:1788309595.771677:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c2fc1926000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788309595.771680:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788309595.771683:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1875178048145920:0@lo:38:kworker.0 00000100:00100000:0.0:1788309595.774786:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1875178048145280:12345-0@lo:38:kworker.0 Request processed in 18554us (18641us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788309595.774798:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788309595.774866:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30f0d6c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788309595.774871:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788309595.774875:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048145280:0@lo:38:kworker.0 00000100:00100000:2.0:1788309595.776645:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048145408:0@lo:400:kworker.0 00000020:00000080:2.0:1788309595.814186:0:20735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788309595.814198:0:20735:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788309595.814204:0:20735:0:(genops.c:885:class_export_put()) final put ffff8c2fc4314000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788309595.814209:0:20735:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc4314000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788309595.814218:0:20735:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788309595.814336:0:20735:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8c2fc4315800 00000020:02000400:2.0:1788309595.814406:0:20735:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788309596.267365:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309597.293253:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309598.314210:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788309598.904579:0:20939:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1788309598.909121:0:20939:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788309598.909177:0:20939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30fba6be00/0x98c38120c44aed4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44aed56 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.909191:0:20939:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30fba6be00/0x98c38120c44aed4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44aed56 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.909200:0:20939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30fba6be00/0x98c38120c44aed4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44aed56 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.909208:0:20939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff8c30fba6be00/0x98c38120c44aed4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44aed56 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.909246:0:20939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788309598.909252:0:20939:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788309598.909298:0:20939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788309598.909303:0:20939:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788309598.909309:0:20939:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788309598.909315:0:20939:0:(import.c:65:import_set_state_nolock()) ffff8c2fc2a6d800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788309598.909321:0:20939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788309598.909323:0:20939:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788309598.909326:0:20939:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788309598.910193:0:20939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1800/0x98c38120c44aecae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44aecb5 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.910205:0:20939:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1800/0x98c38120c44aecae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44aecb5 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.910212:0:20939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1800/0x98c38120c44aecae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44aecb5 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.910219:0:20939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1800/0x98c38120c44aecae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44aecb5 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.910245:0:20939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788309598.910250:0:20939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc337c200/0x98c38120c44aefa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44aefa9 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.910257:0:20939:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc337c200/0x98c38120c44aefa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44aefa9 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.910286:0:20939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc337c200/0x98c38120c44aefa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44aefa9 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.910291:0:20939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff8c2fc337c200/0x98c38120c44aefa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44aefa9 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.910303:0:20939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788309598.910309:0:20939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30d3d90c00/0x98c38120c44af146 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af14d expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.910315:0:20939:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30d3d90c00/0x98c38120c44af146 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af14d expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.910321:0:20939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30d3d90c00/0x98c38120c44af146 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44af14d expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.910326:0:20939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff8c30d3d90c00/0x98c38120c44af146 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44af14d expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.910332:0:20939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1788309598.910336:0:20939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0200/0x98c38120c44aeca0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44aeca7 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.910342:0:20939:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0200/0x98c38120c44aeca0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44aeca7 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.910348:0:20939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0200/0x98c38120c44aeca0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44aeca7 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.910360:0:17153:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788309598.910364:0:20939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0200/0x98c38120c44aeca0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44aeca7 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.910369:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c30fba6be00/0x98c38120c44aed4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44aed56 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309598.910376:0:20939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788309598.910383:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30fba6be00 already unused, calling callback (ffffffffc1507c20) 10000000:01000000:2.0:1788309598.910384:0:20939:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 10000000:00010000:3.0:1788309598.910390:0:17153:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c30fba6be00/0x98c38120c44aed4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44aed56 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.910401:0:17153:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c30fba6be00/0x98c38120c44aed4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x98c38120c44aed56 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788309598.910408:0:17153:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c30fba6be00/0x98c38120c44aed4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x98c38120c44aed56 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309598.910414:0:17153:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788309598.910416:0:17153:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788309598.910419:0:17153:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788309598.910652:0:17152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788309598.910658:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1800/0x98c38120c44aecae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44aecb5 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309598.910665:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc35f1800 already unused, calling callback (ffffffffc1507c20) 10000000:00010000:1.0:1788309598.910668:0:17152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1800/0x98c38120c44aecae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44aecb5 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309598.910675:0:17152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1800/0x98c38120c44aecae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x98c38120c44aecb5 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788309598.910682:0:17152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1800/0x98c38120c44aecae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x98c38120c44aecb5 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309598.910687:0:17152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788309598.910689:0:17152:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:1.0:1788309598.910691:0:17152:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:1.0:1788309598.910710:0:17152:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1800/0x98c38120c44aecae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44aecb5 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309598.910727:0:17152:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788309598.910751:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1800/0x98c38120c44aecae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44aecb5 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309598.910758:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1800/0x98c38120c44aecae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44aecb5 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309598.910768:0:17152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788309598.910771:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c2fc337c200/0x98c38120c44aefa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44aefa9 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309598.910777:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337c200 already unused, calling callback (ffffffffc1507c20) 10000000:00010000:1.0:1788309598.910780:0:17152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c2fc337c200/0x98c38120c44aefa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44aefa9 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309598.910787:0:17152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c2fc337c200/0x98c38120c44aefa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x98c38120c44aefa9 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788309598.910793:0:17152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c2fc337c200/0x98c38120c44aefa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x98c38120c44aefa9 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309598.910799:0:17152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788309598.910801:0:17152:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788309598.910803:0:17152:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788309598.910817:0:17152:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff8c2fc337c200/0x98c38120c44aefa2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44aefa9 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309598.910822:0:17152:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788309598.910829:0:17153:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff8c30fba6be00/0x98c38120c44aed4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44aed56 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309598.910858:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c2fc337c200/0x98c38120c44aefa2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44aefa9 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.910861:0:17153:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788309598.910873:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c30fba6be00/0x98c38120c44aed4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44aed56 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309598.910886:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c2fc337c200/0x98c38120c44aefa2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44aefa9 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.910906:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c30fba6be00/0x98c38120c44aed4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44aed56 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309598.910909:0:17152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788309598.910916:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c30d3d90c00/0x98c38120c44af146 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44af14d expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.910921:0:17153:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788309598.910923:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d3d90c00 already unused, calling callback (ffffffffc1507c20) 00010000:00010000:3.0:1788309598.910926:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0200/0x98c38120c44aeca0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44aeca7 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788309598.910929:0:17152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c30d3d90c00/0x98c38120c44af146 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44af14d expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.910939:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc35f0200 already unused, calling callback (ffffffffc1507c20) 00010000:00010000:1.0:1788309598.910943:0:17152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c30d3d90c00/0x98c38120c44af146 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x98c38120c44af14d expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788309598.910944:0:17153:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0200/0x98c38120c44aeca0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44aeca7 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788309598.910961:0:17152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c30d3d90c00/0x98c38120c44af146 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x98c38120c44af14d expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309598.910963:0:17153:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0200/0x98c38120c44aeca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x98c38120c44aeca7 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309598.910975:0:17152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:3.0:1788309598.910978:0:17153:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0200/0x98c38120c44aeca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x98c38120c44aeca7 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309598.910979:0:17152:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788309598.910983:0:17152:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788309598.910988:0:17153:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788309598.910990:0:17153:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788309598.910992:0:17153:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788309598.911000:0:17152:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff8c30d3d90c00/0x98c38120c44af146 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44af14d expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309598.911007:0:17152:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788309598.911013:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c30d3d90c00/0x98c38120c44af146 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44af14d expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309598.911019:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c30d3d90c00/0x98c38120c44af146 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44af14d expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309598.911038:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309598.911040:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309598.911042:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309598.911048:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309598.911066:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3620:1875178048146304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309598.911122:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309598.911162:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788309598.911167:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3620:1875178048146560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309598.911185:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309598.911208:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3617:1875178048146432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309598.911225:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309598.911239:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788309598.911243:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3617:1875178048146176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309598.911259:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309598.911303:0:20192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048146304 00000100:00100000:1.0:1788309598.911309:0:20192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048146304 00010000:00010000:3.0:1788309598.911337:0:17153:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0200/0x98c38120c44aeca0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44aeca7 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309598.911342:0:20192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048146560 00000100:00100000:1.0:1788309598.911346:0:20192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048146560 00010000:00010000:3.0:1788309598.911348:0:17153:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788309598.911356:0:20192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048146432 00000100:00100000:1.0:1788309598.911359:0:20192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048146432 00010000:00010000:3.0:1788309598.911366:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0200/0x98c38120c44aeca0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44aeca7 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309598.911367:0:20192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048146176 00000100:00100000:1.0:1788309598.911371:0:20192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048146176 00010000:00010000:3.0:1788309598.911378:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0200/0x98c38120c44aeca0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x98c38120c44aeca7 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309598.911385:0:20192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788309598.911393:0:20192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3620:x1875178048146304:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788309598.911404:0:20192:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788309598 with bad export cookie 11007783891955805050 00010000:00010000:3.0:1788309598.911412:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309598.911416:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309598.911418:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309598.911906:0:18317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788309598.911912:0:18317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3620:x1875178048146560:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788309598.911917:0:18317:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788309598 with bad export cookie 11007783891955805050 00000100:00100000:3.0:1788309598.911969:0:18317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3620:x1875178048146560:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (782us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788309598.911976:0:18317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788309598.911997:0:18317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788309598.912001:0:18317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3617:x1875178048146432:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788309598.912005:0:18317:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788309598 with bad export cookie 11007783891955805050 00000100:00100000:3.0:1788309598.912176:0:18317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3617:x1875178048146432:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (948us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788309598.912183:0:18317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788309598.912197:0:18317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788309598.912202:0:18317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3617:x1875178048146176:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788309598.912207:0:18317:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788309598 with bad export cookie 11007783891955805050 00000100:00100000:3.0:1788309598.912231:0:18317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3617:x1875178048146176:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (971us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788309598.912237:0:18317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000020:01000004:2.0:1788309598.913593:0:20939:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788309598.913602:0:20939:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788309598.913613:0:20939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788309598.913620:0:20939:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788309598.913627:0:20939:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8c2fc1927800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788309598.913634:0:20939:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8c30f5f81000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788309598.913639:0:20939:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8c3101263370) has exports, disconnecting them 00000020:00080000:2.0:1788309598.913644:0:20939:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8c2fc1927800), last request at 1788309595 00000020:00000080:2.0:1788309598.913651:0:20939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aef94 00000100:00080000:2.0:1788309598.913673:0:20939:0:(import.c:65:import_set_state_nolock()) ffff8c2fc1922800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788309598.913746:0:20939:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c2fc1927800): rc 0 00000020:00000080:2.0:1788309598.913748:0:20939:0:(genops.c:885:class_export_put()) final put ffff8c2fc1927800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1788309598.913760:0:20939:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8c30f5f81000), last request at 1788309595 00000020:00000080:2.0:1788309598.913763:0:20939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aee2f 00000100:00080000:2.0:1788309598.913770:0:20939:0:(import.c:65:import_set_state_nolock()) ffff8c30f5f85800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788309598.913780:0:20939:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c30f5f81000): rc 0 00000020:00000080:2.0:1788309598.913782:0:20939:0:(genops.c:885:class_export_put()) final put ffff8c30f5f81000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788309598.913788:0:20939:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa2ea01cf7ae0 00000100:00080000:2.0:1788309598.913807:0:20939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788309598.913815:0:20939:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8c30fbbf0000 x1875178048143232/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788309606 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309598.913852:0:20939:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:3.0:1788309598.913868:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788309598.914654:0:20939:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788309598.914660:0:20939:0:(import.c:65:import_set_state_nolock()) ffff8c30f0d6c000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788309598.915002:0:20939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788309598.915006:0:20939:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000004:00080000:2.0:1788309598.916998:0:20939:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788309598.917079:0:20939:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788309598.917100:0:20939:0:(import.c:65:import_set_state_nolock()) ffff8c30c7d26000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788309598.917115:0:20939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788309598.917119:0:20939:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1788309598.917126:0:20939:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788309598.917197:0:20939:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788309598.917203:0:20939:0:(import.c:65:import_set_state_nolock()) ffff8c30d70a8000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788309598.917238:0:20939:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8c3101263370) has no exports 00000100:00100000:0.0:1788309598.917308:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048146816:0@lo:9:umount.0 00000100:00100000:0.0:1788309598.917375:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309598.917444:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048146944:0@lo:9:umount.0 00000100:00100000:0.0:1788309598.917463:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309598.925404:0:19862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048146816 00000100:00100000:2.0:1788309598.925417:0:19862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048146816 00000100:00100000:2.0:1788309598.925477:0:19862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048146944 00000100:00100000:2.0:1788309598.925480:0:19862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048146944 00000100:00100000:2.0:1788309598.925505:0:19862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788309598.925514:0:19862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875178048146816:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788309598.925544:0:19862:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aef24 00000100:00080000:2.0:1788309598.925553:0:19862:0:(import.c:65:import_set_state_nolock()) ffff8c31011f1000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788309598.925595:0:19862:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788309598.925755:0:19862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3616:x1875178048146816:12345-0@lo:9:umount.0 Request processed in 242us (8379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309598.925762:0:19862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788309598.925778:0:19862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788309598.925784:0:19862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875178048146944:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788309598.925796:0:19862:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aefc5 00000100:00080000:2.0:1788309598.925813:0:19862:0:(import.c:65:import_set_state_nolock()) ffff8c30f093a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788309598.925836:0:19862:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1788309598.925935:0:19862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3616:x1875178048146944:12345-0@lo:9:umount.0 Request processed in 150us (8469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309598.925942:0:19862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1788309598.925961:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309598.925967:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788309598.926518:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30c7d26000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788309598.926532:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788309598.926534:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788309598.926538:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048146816:0@lo:9:umount.0 00000100:00080000:0.0:1788309598.926553:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30d70a8000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788309598.926560:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788309598.926562:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788309598.926566:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048146944:0@lo:9:umount.0 00000020:00000080:0.0:1788309598.927032:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc1927800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1788309598.927076:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f5f81000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1788309598.927097:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c2fc1922800 for lustre-MDT0001 00000020:00000080:0.0:1788309598.927100:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c30f5f85800 for lustre-MDT0001 00000100:00100000:0.0:1788309598.927112:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788309598.927125:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3619:1875178048146688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788309598.927171:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788309598.927220:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.132@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788309598.927224:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8c2fc4316000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788309598.927227:0:3617:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.132@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788309598.927816:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788309598.927821:0:17160:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788309598.927874:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875178048143232:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788309598.927911:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309598.928175:0:20192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3620:x1875178048146304:12345-0@lo:103:ldlm_bl.0 Request processed in 16781us (17052us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788309598.928185:0:20192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788309598.928204:0:20192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048146688 00000100:00100000:1.0:1788309598.928209:0:20192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048146688 00000100:00100000:1.0:1788309598.928239:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788309598.928245:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3619:x1875178048146688:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788309598.928250:0:17151:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788309598 with bad export cookie 11007783891955805050 00000100:00100000:1.0:1788309598.928293:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3619:x1875178048146688:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (1122us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788309598.928299:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788309598.928907:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.132@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788309598.938233:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.132@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788309598.938377:0:3617:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.132@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788309598.938381:0:3617:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788309598.938388:0:3617:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c30d3b04a80 x1875178048145152/t0(0) o400->MGC192.168.206.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788309611 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309598.938401:0:3617:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c30fba9e300 x1875178048146304/t0(0) o103->MGC192.168.206.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788309614 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309598.938429:0:3617:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c30fba9ea00 x1875178048146560/t0(0) o103->MGC192.168.206.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788309614 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309598.938437:0:3617:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c30fba9c700 x1875178048146432/t0(0) o103->MGC192.168.206.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788309614 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309598.938445:0:3617:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c30fbbf1f80 x1875178048146176/t0(0) o103->MGC192.168.206.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788309614 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309598.938451:0:3617:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c30fbbf2d80 x1875178048146688/t0(0) o103->MGC192.168.206.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788309614 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788309598.938459:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788309598.938461:0:3617:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788309598.938462:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788309598.938556:0:3620:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8c2fc4316000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1788309598.938572:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3620:1875178048146304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309598.938581:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3620:1875178048145152:0@lo:400:kworker.0 00000100:00100000:1.0:1788309598.938615:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3620:1875178048146560:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788309598.938638:0:3619:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8c2fc4316000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1788309598.938647:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3619:1875178048146688:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788309598.938688:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8c2fc4316000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788309598.938693:0:3617:0:(import.c:510:import_select_connection()) MGC192.168.206.132@tcp: connect to NID 0@lo last attempt 427 00000100:00080000:0.0:1788309598.938701:0:3617:0:(import.c:624:import_select_connection()) MGC192.168.206.132@tcp: import ffff8c2fc4316000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:0.0:1788309598.938728:0:3617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c2fc414ed80 x1875178048147072/t0(0) o250->MGC192.168.206.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788309598.938970:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3617:1875178048146432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788309598.938980:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3616:1875178048147072:0@lo:250:ptlrpcd_00_00.0 00000100:00100000:0.0:1788309598.938986:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3617:1875178048146176:0@lo:103:ldlm_bl.0 00000400:00000100:2.0:1788309598.939024:0:3616:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875178048147072 offset 0 length 520: 4 00000020:00080000:3.0:1788309598.944186:0:20939:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8c3101263370) has no exports 00000020:01000000:0.0:1788309598.995121:0:20939:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c30d01c6540 - data ffff8c30ee75e288/ffff8c30c83a0000 00000020:01000000:0.0:1788309598.995290:0:20939:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c30d01c6300 - data ffff8c30ee67a000/ffff8c30ee2ee800 00000001:00000004:0.0:1788309599.007234:0:20939:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1788309599.044905:0:20939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788309599.044913:0:20939:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788309599.044920:0:20939:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788309599.052835:0:20939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788309599.052905:0:20939:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1788309599.052927:0:20939:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788309599.052929:0:20939:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788309599.055308:0:17905:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788309599.055316:0:17905:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1788309599.055331:0:17905:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788309599.056165:0:20939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788309599.056170:0:20939:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788309599.056188:0:20939:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788309599.056191:0:20939:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788309599.056415:0:17907:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788309599.056418:0:17907:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1788309599.056480:0:17907:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1788309599.069179:0:20939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aecc3 00000020:00000080:3.0:1788309599.069194:0:20939:0:(genops.c:885:class_export_put()) final put ffff8c2fc365d000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788309599.069923:0:20939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aecd8 00000020:00000080:3.0:1788309599.069931:0:20939:0:(genops.c:885:class_export_put()) final put ffff8c30f6144000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788309599.071876:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc365d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788309599.075651:0:20939:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788309599.075666:0:20939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788309599.075676:0:20939:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788309599.075681:0:20939:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8c3101260000) has no exports 00000020:00000080:2.0:1788309599.075757:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f6144000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:3.0:1788309599.076141:0:20939:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788309599.076151:0:20939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aed2c 00000020:00000080:3.0:1788309599.076159:0:20939:0:(genops.c:885:class_export_put()) final put ffff8c30d70a9800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788309599.076176:0:20939:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788309599.076180:0:20939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788309599.076185:0:20939:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788309599.076188:0:20939:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8c30f0d83370) has no exports 00000020:00000080:3.0:1788309599.076195:0:20939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aed25 00000020:00000080:3.0:1788309599.076198:0:20939:0:(genops.c:885:class_export_put()) final put ffff8c30d6ec4000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1788309599.076772:0:20939:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788309599.076777:0:20939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788309599.076781:0:20939:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1788309599.076787:0:20939:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788309599.076789:0:20939:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788309599.077021:0:20939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788309599.077030:0:20939:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788309599.077037:0:20939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aed17 00000020:00000080:3.0:1788309599.077042:0:20939:0:(genops.c:885:class_export_put()) final put ffff8c30d3971800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788309599.077047:0:20939:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788309599.077052:0:20939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788309599.077055:0:20939:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788309599.077058:0:20939:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8c30c7b30000) has no exports 00000020:00000080:3.0:1788309599.077072:0:20939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aed10 00000020:00000080:3.0:1788309599.077076:0:20939:0:(genops.c:885:class_export_put()) final put ffff8c30c7d24000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1788309599.078247:0:20939:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788309599.078253:0:20939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788309599.078256:0:20939:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1788309599.078334:0:20939:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788309599.078336:0:20939:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788309599.078367:0:20939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788309599.078374:0:20939:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788309599.078445:0:20939:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788309599.078453:0:20939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aecfb 00000020:00000080:3.0:1788309599.078575:0:20939:0:(genops.c:885:class_export_put()) final put ffff8c30c7d20800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788309599.078580:0:20939:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788309599.078587:0:20939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788309599.078592:0:20939:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788309599.078595:0:20939:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8c30c7b34d28) has no exports 00000020:00000080:3.0:1788309599.078600:0:20939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aecf4 00000020:00000080:3.0:1788309599.078603:0:20939:0:(genops.c:885:class_export_put()) final put ffff8c30f9a1d800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788309599.079132:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30d70a9800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788309599.079143:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30d6ec4000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788309599.079149:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c30d70a8000 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788309599.079156:0:37:0:(genops.c:885:class_export_put()) final put ffff8c30d3975000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788309599.079158:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30d3975000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1788309599.079162:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788309599.079252:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30d3971800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788309599.079258:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30c7d24000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788309599.079262:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c30c7d26000 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788309599.079275:0:37:0:(genops.c:885:class_export_put()) final put ffff8c30c7d27000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788309599.079277:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30c7d27000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1788309599.079282:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788309599.079312:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30c7d20800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788309599.079317:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f9a1d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788309599.079887:0:20939:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1788309599.079892:0:20939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788309599.079895:0:20939:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788309599.079900:0:20939:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788309599.079948:0:20939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788309599.079956:0:20939:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788309599.079978:0:20939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788309599.079981:0:20939:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788309599.079984:0:20939:0:(genops.c:885:class_export_put()) final put ffff8c30f58ae000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788309599.079987:0:20939:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f58ae000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788309599.079991:0:20939:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788309599.080044:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c30f0d6c000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788309599.080051:0:37:0:(genops.c:885:class_export_put()) final put ffff8c30f9a1e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788309599.080053:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f9a1e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788309599.080070:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788309599.080384:0:20939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aecdf 00000020:00000080:2.0:1788309599.080391:0:20939:0:(genops.c:885:class_export_put()) final put ffff8c30f6144800/lustre-MDD0001_UUID 00000020:01000000:2.0:1788309599.080406:0:20939:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1788309599.080410:0:20939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788309599.080414:0:20939:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788309599.080418:0:20939:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8c30c7a1b370) has no exports 00000020:00000080:2.0:1788309599.080448:0:20939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788309599.080453:0:20939:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1788309599.080458:0:20939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aece6 00000020:00000080:2.0:1788309599.080461:0:20939:0:(genops.c:885:class_export_put()) final put ffff8c30f6143800/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1788309599.080475:0:20939:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c30f9a18000 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1788309599.080478:0:20939:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c30f9a18000 2 00000020:01000004:2.0:1788309599.080481:0:20939:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c30f9a18000 from lustre-MDT0001 00000020:00000080:2.0:1788309599.080498:0:20939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788309599.080501:0:20939:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1788309599.080503:0:20939:0:(genops.c:885:class_export_put()) final put ffff8c2fc365a000/lustre-MDT0001_UUID 00000020:00000080:2.0:1788309599.080506:0:20939:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc365a000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1788309599.080512:0:20939:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:00000080:1.0:1788309599.080625:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f6144800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788309599.080630:0:37:0:(genops.c:885:class_export_put()) final put ffff8c30f58aa000/lustre-MDD0001_UUID 00000020:00000080:1.0:1788309599.080632:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f58aa000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788309599.080637:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:01000004:2.0:1788309599.080655:0:20939:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1788309599.080658:0:20939:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1788309599.080661:0:20939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788309599.080664:0:20939:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788309599.080670:0:20939:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8c30c53e7000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788309599.080675:0:20939:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8c30edf7cd28) has exports, disconnecting them 00000020:00080000:2.0:1788309599.080679:0:20939:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8c30c53e7000), last request at 1788309528 00000020:00000080:2.0:1788309599.080682:0:20939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aed64 00000020:00080000:2.0:1788309599.080692:0:20939:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c30c53e7000): rc 0 00000020:00000080:2.0:1788309599.080695:0:20939:0:(genops.c:885:class_export_put()) final put ffff8c30c53e7000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788309599.080766:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f6143800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788309599.080771:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30c53e7000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788309599.147127:0:20939:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788309599.147136:0:20939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788309599.147174:0:20939:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788309599.147183:0:20939:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788309599.147461:0:20939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788309599.147469:0:20939:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788309599.147475:0:20939:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c30f9a18000 1 00000020:00000080:3.0:1788309599.147481:0:20939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aec8b 00000020:00000080:3.0:1788309599.147489:0:20939:0:(genops.c:885:class_export_put()) final put ffff8c30f58ae800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788309599.147515:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c2fc2a6d800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788309599.147523:0:36:0:(genops.c:885:class_export_put()) final put ffff8c3101368800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788309599.147525:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3101368800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788309599.147535:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000000:3.0:1788309599.147700:0:20939:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788309599.147705:0:20939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788309599.147711:0:20939:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788309599.147714:0:20939:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8c30edf78000) has no exports 00000020:00000080:1.0:1788309599.150151:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f58ae800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788309599.172369:0:20939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788309599.172381:0:20939:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788309599.172387:0:20939:0:(genops.c:885:class_export_put()) final put ffff8c30f0dd9800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788309599.172391:0:20939:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f0dd9800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788309599.172397:0:20939:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788309599.172510:0:20939:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8c30f0ddd800 00000020:01000000:1.0:1788309599.172533:0:20939:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788309599.172537:0:20939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788309599.172542:0:20939:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788309599.172546:0:20939:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8c30fb9699b8) has no exports 00000100:00100000:2.0:1788309599.172861:0:17166:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8c2fc35f2400:17166] 2 exiting: rc = 0 00000100:00100000:2.0:1788309599.172980:0:19499:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8c2fc2bad400:19499] 3 exiting: rc = 0 00000100:00100000:2.0:1788309599.173035:0:20738:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8c2fc3647400:20738] 4 exiting: rc = 0 00000100:00100000:3.0:1788309599.173185:0:17165:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8c2fc35f2200:17165] 1 exiting: rc = 0 00000100:00100000:3.0:1788309599.173338:0:17164:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8c2fc35f3600:17164] 0 exiting: rc = 1 00000100:00100000:2.0:1788309599.173432:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173440:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173446:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173457:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173470:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173476:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173481:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173487:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173495:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173503:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173519:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173527:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173536:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173544:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173552:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173560:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173568:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173576:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173584:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173592:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173599:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173607:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173614:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173622:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173629:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173636:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173644:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173650:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173658:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173672:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173683:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173690:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173780:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173791:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173798:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173806:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173814:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173821:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173829:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173854:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173865:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173871:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173876:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173881:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173886:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173901:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173907:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173914:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173922:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173932:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173940:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173948:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173955:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173963:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173970:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173978:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173985:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.173993:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.174001:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.174009:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.174016:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.174024:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.174031:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.174039:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.177212:0:17167:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8c30c55f1000:17167] 0 exiting: rc = 1 00000100:00100000:1.0:1788309599.177349:0:17168:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8c30c55f0400:17168] 1 exiting: rc = 0 00000100:00100000:2.0:1788309599.177459:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177467:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177474:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177480:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177488:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177495:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177503:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177511:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177518:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177525:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177532:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177540:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177547:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177553:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177558:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177563:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177581:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177588:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177596:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177603:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177610:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177616:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177622:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177629:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177635:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177642:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177648:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177655:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177666:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177678:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177685:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177690:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177871:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177883:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177892:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177901:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177908:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177914:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177923:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177932:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177940:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177948:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177957:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177965:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177974:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177981:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177988:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.177995:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.178006:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.178016:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.178025:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.178044:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.178048:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.178053:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.178058:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.178062:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.178066:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.178071:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.178076:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.178082:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.178087:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.178092:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.178096:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.178101:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309599.178621:0:17904:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8c30c7a59c00:17904] 2 exiting: rc = 0 00000100:00100000:3.0:1788309599.178628:0:17170:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8c30d631cc00:17170] 1 exiting: rc = 0 00000100:00100000:1.0:1788309599.178778:0:17169:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8c30c55f0a00:17169] 0 exiting: rc = 1 00000100:00100000:2.0:1788309599.179079:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179089:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179102:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179116:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179127:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179137:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179148:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179193:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179203:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179210:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179216:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179223:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179232:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179241:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179248:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179257:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179274:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179283:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179291:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179323:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179332:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179340:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179356:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179365:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179373:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179381:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179387:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179393:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179399:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179405:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179410:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179455:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179468:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179480:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179490:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179499:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179508:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179513:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179526:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179568:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179574:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179579:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179585:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179606:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179616:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179623:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179632:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179641:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179650:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179658:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179666:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179674:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179682:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179690:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179775:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179809:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179886:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179903:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179909:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179916:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179921:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179927:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179934:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.179947:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.192610:0:17171:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8c30d1cf2200:17171] 0 exiting: rc = 1 00000100:00100000:1.0:1788309599.192633:0:17172:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8c30d1cf3400:17172] 1 exiting: rc = 0 00000100:00100000:3.0:1788309599.192707:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192714:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192718:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192723:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192727:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192731:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192736:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192740:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192745:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192750:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192754:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192759:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192763:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192768:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192773:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192778:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192782:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192787:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192792:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192796:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192800:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192805:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192809:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192813:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192817:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192821:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192826:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192830:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192834:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192852:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192857:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192883:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192887:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192892:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192897:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192901:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192906:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192911:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192918:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192923:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192928:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192932:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192936:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192940:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192944:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192948:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192952:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192956:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192960:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192964:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192968:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192972:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192976:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192979:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192983:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192987:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192991:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192995:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.192999:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.193002:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.193007:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.193011:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.193015:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.193019:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309599.193612:0:17174:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8c30f52bcc00:17174] 1 exiting: rc = 0 00000100:00100000:2.0:1788309599.196203:0:17173:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8c30f52bd000:17173] 0 exiting: rc = 1 00000100:00100000:3.0:1788309599.196316:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196323:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196341:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196346:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196350:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196355:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196360:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196365:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196371:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196376:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196380:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196398:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196406:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196414:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196421:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196429:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196436:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196443:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196448:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196453:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196457:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196462:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196467:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196472:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196477:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196482:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196487:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196492:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196497:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196501:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196506:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196511:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196516:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196520:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196524:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196528:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196533:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196545:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196551:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196556:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196560:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196565:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196570:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196575:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196580:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196585:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196590:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196596:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196601:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196605:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196610:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196616:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196621:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196625:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196629:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196634:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196640:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196645:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196650:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196656:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196660:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196665:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196670:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.196675:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309599.197031:0:17175:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8c30f52bc400:17175] 0 exiting: rc = 1 00000100:00100000:2.0:1788309599.197118:0:17176:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8c30f52bc800:17176] 1 exiting: rc = 0 00000100:00100000:3.0:1788309599.197172:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197181:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197187:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197192:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197197:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197201:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197205:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197210:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197223:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197228:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197233:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197238:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197243:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197249:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197253:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197259:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197273:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197279:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197284:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197288:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197293:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197297:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197302:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197307:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197313:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197318:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197322:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197327:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197332:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197337:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197341:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197346:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197350:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197354:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197359:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197364:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197368:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197372:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197376:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197391:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197396:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197401:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197406:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197418:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197423:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197428:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197433:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197438:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197443:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197448:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197454:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197459:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197463:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197468:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197472:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197477:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197482:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197486:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197491:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197495:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197500:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197504:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197508:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.197514:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788309599.198116:0:17178:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8c30f52bd400:17178] 1 exiting: rc = 0 00000100:00100000:2.0:1788309599.198416:0:17177:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8c30f52bd200:17177] 0 exiting: rc = 1 00000100:00100000:2.0:1788309599.198599:0:17179:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8c30f52bdc00:17179] 2 exiting: rc = 0 00000100:00100000:3.0:1788309599.198869:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.198877:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.198882:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.198887:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.198892:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.198897:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.198902:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.198907:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.198913:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.198934:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.198940:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.198945:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.198951:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.198956:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.198973:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.198978:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.198984:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.198990:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.198995:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199000:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199006:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199012:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199018:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199024:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199029:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199034:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199039:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199045:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199049:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199055:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199060:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199066:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199072:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199094:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199101:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199107:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199112:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199117:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199123:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199129:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199135:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199141:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199147:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199152:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199158:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199163:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199170:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199176:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199181:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199195:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199200:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199207:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199213:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199218:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199223:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199230:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199236:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199242:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199247:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199253:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199258:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199273:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199280:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309599.199286:0:20939:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788309599.205020:0:20939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788309599.205033:0:20939:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788309599.205039:0:20939:0:(genops.c:885:class_export_put()) final put ffff8c30d5e80800/MDS_uuid 00000020:00000080:3.0:1788309599.205043:0:20939:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30d5e80800/MDS_uuid for MDS 00000020:01000000:3.0:1788309599.205053:0:20939:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788309599.205219:0:20939:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788309599.344211:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309600.363958:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788309600.873926:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 42218ed5-7e96-4e9d-b9da-f92649f6b56e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788309600.873936:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 42218ed5-7e96-4e9d-b9da-f92649f6b56e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788309600.873939:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788309600.873942:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788309600.873945:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c30c7d22000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788309600.873953:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 505 00000100:00080000:2.0:1788309600.873959:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788309600.873965:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c30c7d22000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:2.0:1788309600.873999:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30d3b07100 x1875178048147200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788309600.874037:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788309600.874040:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788309600.874042:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c2fc1926000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788309600.874045:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 505 00000100:00080000:2.0:1788309600.874054:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788309600.874058:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c2fc1926000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:2.0:1788309600.874070:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30d3b06300 x1875178048147456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788309600.874117:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1875178048147200:0@lo:38:kworker.0 00000400:00000100:2.0:1788309600.874159:0:3616:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875178048147200 offset 0 length 520: 4 00000100:00100000:2.0:1788309600.874183:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1875178048147456:0@lo:38:kworker.0 00000400:00000100:2.0:1788309600.874196:0:3616:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875178048147456 offset 0 length 520: 4 00000100:00100000:0.0:1788309600.874283:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875178048147328:0@lo:400:kworker.0 00000400:00000100:0.0:1788309600.874309:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875178048147328 offset 0 length 224: 4 00000100:00100000:0.0:1788309600.874325:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788309600.874336:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875178048147584:0@lo:400:kworker.0 00000400:00000100:0.0:1788309600.874353:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875178048147584 offset 0 length 224: 4 00010000:00010000:1.0:1788309601.386289:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788309602.030377:0:21139:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1788309602.041379:0:21139:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788309602.041506:0:21139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc337d800/0x98c38120c44aedfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44aee05 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309602.041521:0:21139:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc337d800/0x98c38120c44aedfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44aee05 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309602.041530:0:21139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc337d800/0x98c38120c44aedfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44aee05 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309602.041537:0:21139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff8c2fc337d800/0x98c38120c44aedfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44aee05 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309602.041560:0:21139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788309602.041566:0:21139:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788309602.041589:0:21139:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788309602.041599:0:21139:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c30d3b07100 x1875178048147200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788309620 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309602.041622:0:21139:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788309602.041628:0:21139:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788309602.041634:0:21139:0:(import.c:65:import_set_state_nolock()) ffff8c30c7d22000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788309602.041639:0:21139:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788309602.041642:0:21139:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c30d3b07100 x1875178048147200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788309620 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309602.041650:0:21139:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788309602.041653:0:21139:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00010000:00010000:2.0:1788309602.041695:0:17152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309602.041702:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c2fc337d800/0x98c38120c44aedfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44aee05 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309602.041709:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337d800 already unused, calling callback (ffffffffc1507c20) 10000000:00010000:2.0:1788309602.041713:0:17152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c2fc337d800/0x98c38120c44aedfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44aee05 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309602.041720:0:17152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c2fc337d800/0x98c38120c44aedfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x98c38120c44aee05 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309602.041727:0:17152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c2fc337d800/0x98c38120c44aedfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x98c38120c44aee05 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309602.041732:0:17152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788309602.041735:0:17152:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788309602.041737:0:17152:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788309602.041749:0:17152:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c2fc4316000 00010000:00010000:2.0:1788309602.041753:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c2fc337d800/0x98c38120c44aedfe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x98c38120c44aee05 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309602.041778:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c2fc337d800/0x98c38120c44aedfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x98c38120c44aee05 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309602.041788:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309602.041790:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309602.041791:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309602.041797:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1875178048147200:0@lo:38:kworker.0 00000100:00080000:1.0:1788309602.043096:0:21139:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788309602.043108:0:21139:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c30d3b07800 x1875178048147328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309616 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309602.043170:0:21139:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788309602.043187:0:21139:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788309602.043207:0:21139:0:(import.c:65:import_set_state_nolock()) ffff8c2fc1975000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788309602.043275:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875178048147328:0@lo:400:kworker.0 00000100:00100000:2.0:1788309602.043494:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1875178048147712:0@lo:39:umount.0 00000400:00000100:2.0:1788309602.043539:0:3616:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875178048147712 offset 0 length 224: 4 00010000:00010000:3.0:1788309602.410447:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309603.434698:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788309603.882079:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 42218ed5-7e96-4e9d-b9da-f92649f6b56e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788309603.882088:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 42218ed5-7e96-4e9d-b9da-f92649f6b56e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788309603.882092:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788309603.882095:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788309603.882193:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788309603.883413:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875178048147840:0@lo:400:kworker.0 00000400:00000100:1.0:1788309603.883472:0:3620:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875178048147840 offset 0 length 224: 4 00010000:00010000:3.0:1788309604.461439:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788309604.973173:0:19483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788309604.973181:0:19483:0:(genops.c:885:class_export_put()) final put ffff8c2fc35c8000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788309604.973482:0:18666:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788309604.973487:0:18666:0:(genops.c:885:class_export_put()) final put ffff8c31011f0000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788309604.973868:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc35c8000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788309604.973920:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c31011f0000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788309604.973949:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c30f093a000 for lustre-OST0001 00000020:00000080:0.0:1788309604.973963:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c31011f1000 for lustre-OST0000 00010000:00010000:3.0:1788309605.482199:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788309605.930215:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 42218ed5-7e96-4e9d-b9da-f92649f6b56e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788309605.930225:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 42218ed5-7e96-4e9d-b9da-f92649f6b56e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788309605.930228:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788309605.930240:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788309605.930364:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788309605.930385:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875178048147968:0@lo:400:kworker.0 00000400:00000100:0.0:1788309605.930434:0:3619:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875178048147968 offset 0 length 224: 4 00010000:00010000:1.0:1788309606.507454:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309607.530695:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309608.170926:0:3616:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788309598/real 1788309598] req@ffff8c2fc414ed80 x1875178048147072/t0(0) o250->MGC192.168.206.132@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788309608 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309608.170978:0:3616:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c2fc414ed80 x1875178048147072/t0(0) o250->MGC192.168.206.132@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788309608 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788309608.170999:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c2fc4316000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788309608.171024:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788309608.171028:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3616:1875178048147072:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:3.0:1788309608.171230:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 42218ed5-7e96-4e9d-b9da-f92649f6b56e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788309608.171236:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788309608.171238:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c2fc4316000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788309608.171244:0:37:0:(import.c:510:import_select_connection()) MGC192.168.206.132@tcp: connect to NID 0@lo last attempt 509 00000100:00080000:3.0:1788309608.171248:0:37:0:(import.c:589:import_select_connection()) MGC192.168.206.132@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788309608.171254:0:37:0:(import.c:624:import_select_connection()) MGC192.168.206.132@tcp: import ffff8c2fc4316000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:3.0:1788309608.171293:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30fbbf2d80 x1875178048148096/t0(0) o250->MGC192.168.206.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788309608.171314:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788309608.171318:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788309608.171438:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875178048148224:0@lo:400:kworker.0 00000100:00100000:2.0:1788309608.171474:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3616:1875178048148096:0@lo:250:kworker.0 00000400:00000100:0.0:1788309608.171484:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875178048148224 offset 0 length 224: 4 00000400:00000100:2.0:1788309608.171506:0:3616:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875178048148096 offset 0 length 520: 4 00010000:00010000:3.0:1788309608.556385:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309609.582956:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309610.602573:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309611.626376:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309612.266436:0:3616:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788309602/real 1788309602] req@ffff8c30fba9ea00 x1875178048147712/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788309612 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309612.266464:0:3616:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c30fba9ea00 x1875178048147712/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788309612 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788309612.266496:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c2fc1975000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788309612.266517:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1875178048147712:0@lo:39:umount.0 00000100:00080000:1.0:1788309612.266799:0:21139:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788309612.266804:0:21139:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788309612.266808:0:21139:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788309612.268019:0:21139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc337ce00/0x98c38120c44aedd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44aeddb expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309612.268034:0:21139:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc337ce00/0x98c38120c44aedd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44aeddb expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309612.268041:0:21139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc337ce00/0x98c38120c44aedd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44aeddb expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309612.268049:0:21139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff8c2fc337ce00/0x98c38120c44aedd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44aeddb expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309612.268076:0:21139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788309612.268084:0:21139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1513a00/0x98c38120c44af138 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af13f expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309612.268104:0:21139:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1513a00/0x98c38120c44af138 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af13f expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309612.268110:0:21139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1513a00/0x98c38120c44af138 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44af13f expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309612.268117:0:21139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff8c30c1513a00/0x98c38120c44af138 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44af13f expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309612.268136:0:21139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788309612.268141:0:21139:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788309612.268165:0:21139:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788309612.268169:0:21139:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788309612.268173:0:21139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788309612.268178:0:21139:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788309612.268182:0:21139:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8c3101204d28) has no exports 00000020:00080000:1.0:1788309612.268216:0:21139:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8c3101204d28) has no exports 00010000:00010000:3.0:1788309612.270264:0:17152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788309612.270277:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c2fc337ce00/0x98c38120c44aedd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44aeddb expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309612.270287:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337ce00 already unused, calling callback (ffffffffc1507c20) 10000000:00010000:3.0:1788309612.270291:0:17152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c2fc337ce00/0x98c38120c44aedd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44aeddb expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309612.270299:0:17152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c2fc337ce00/0x98c38120c44aedd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x98c38120c44aeddb expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788309612.270306:0:17152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c2fc337ce00/0x98c38120c44aedd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x98c38120c44aeddb expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309612.270311:0:17152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788309612.270340:0:17152:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788309612.270343:0:17152:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788309612.270370:0:17152:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c2fc4316000 00010000:00010000:3.0:1788309612.270374:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c2fc337ce00/0x98c38120c44aedd4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x98c38120c44aeddb expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309612.270381:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c2fc337ce00/0x98c38120c44aedd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x98c38120c44aeddb expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309612.270395:0:17152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309612.270398:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c30c1513a00/0x98c38120c44af138 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44af13f expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309612.270404:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30c1513a00 already unused, calling callback (ffffffffc1507c20) 10000000:00010000:3.0:1788309612.271291:0:17152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c30c1513a00/0x98c38120c44af138 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44af13f expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309612.271305:0:17152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c30c1513a00/0x98c38120c44af138 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x98c38120c44af13f expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788309612.271312:0:17152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c30c1513a00/0x98c38120c44af138 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x98c38120c44af13f expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309612.271317:0:17152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788309612.271319:0:17152:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788309612.271322:0:17152:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788309612.271344:0:17152:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c2fc4316000 00010000:00010000:3.0:1788309612.271348:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c30c1513a00/0x98c38120c44af138 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x98c38120c44af13f expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309612.271356:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c30c1513a00/0x98c38120c44af138 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x98c38120c44af13f expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309612.271387:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309612.271389:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309612.271391:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309612.271632:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788309612.272137:0:21139:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c2fc2241ea0 - data ffff8c2fc1d4ba20/ffff8c30c83e8800 00000020:01000000:1.0:1788309612.272263:0:21139:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c30d01c68a0 - data ffff8c30ee435af8/ffff8c30f5d75400 00100000:10000000:1.0:1788309612.291093:0:21139:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788309612.304337:0:21139:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aede9 00000020:00000080:2.0:1788309612.304351:0:21139:0:(genops.c:885:class_export_put()) final put ffff8c31011f3000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788309612.304482:0:21139:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c30f54b5800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788309612.304486:0:21139:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c30f54b5800 2 00000020:01000004:2.0:1788309612.304490:0:21139:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c30f54b5800 from lustre-OST0000 00000020:00000080:2.0:1788309612.304531:0:21139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788309612.304542:0:21139:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788309612.304546:0:21139:0:(genops.c:885:class_export_put()) final put ffff8c31011f1800/lustre-OST0000_UUID 00000020:00000080:2.0:1788309612.304550:0:21139:0:(genops.c:844:class_export_destroy()) destroying export ffff8c31011f1800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788309612.304560:0:21139:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788309612.304625:0:21139:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788309612.304630:0:21139:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788309612.304634:0:21139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788309612.304640:0:21139:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788309612.304647:0:21139:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8c2fc1a2b800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788309612.304654:0:21139:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff8c30f0d80000) has exports, disconnecting them 00000020:00080000:2.0:1788309612.304660:0:21139:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8c2fc1a2b800), last request at 1788309540 00000020:00000080:2.0:1788309612.304665:0:21139:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aee13 00000020:00080000:2.0:1788309612.304681:0:21139:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c2fc1a2b800): rc 0 00000020:00000080:2.0:1788309612.304687:0:21139:0:(genops.c:885:class_export_put()) final put ffff8c2fc1a2b800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788309612.304762:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c31011f3000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788309612.304778:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc1a2b800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788309612.308589:0:21139:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788309612.308598:0:21139:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788309612.308602:0:21139:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788309612.308608:0:21139:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788309612.308781:0:21139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788309612.308791:0:21139:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1788309612.308798:0:21139:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788309612.308806:0:21139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788309612.308810:0:21139:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788309612.308818:0:21139:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8c2fc1970000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788309612.308824:0:21139:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff8c30f0d84d28) has exports, disconnecting them 00000020:00080000:3.0:1788309612.308829:0:21139:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8c2fc1970000), last request at 1788309540 00000020:00000080:3.0:1788309612.308833:0:21139:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aee28 00000020:00080000:3.0:1788309612.308899:0:21139:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c2fc1970000): rc 0 00000020:00000080:3.0:1788309612.308905:0:21139:0:(genops.c:885:class_export_put()) final put ffff8c2fc1970000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788309612.310341:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c30c7d22000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788309612.310354:0:36:0:(genops.c:885:class_export_put()) final put ffff8c2fc1a28800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788309612.310367:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc1a28800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788309612.310374:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788309612.310456:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc1970000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788309612.367789:0:21139:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788309612.367797:0:21139:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788309612.367801:0:21139:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788309612.367808:0:21139:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788309612.367899:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c2fc1975000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788309612.368247:0:21139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788309612.368260:0:21139:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788309612.368265:0:21139:0:(genops.c:885:class_export_put()) final put ffff8c2fc1972800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788309612.368268:0:21139:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc1972800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788309612.368277:0:21139:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788309612.368345:0:21139:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c30f54b5800 1 00000020:00000080:3.0:1788309612.368351:0:21139:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aedc6 00000020:00000080:3.0:1788309612.368358:0:21139:0:(genops.c:885:class_export_put()) final put ffff8c2fc35cd000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788309612.368424:0:21139:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788309612.368429:0:21139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788309612.368434:0:21139:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788309612.368438:0:21139:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff8c30c7a199b8) has no exports 00000020:00000080:1.0:1788309612.369526:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc35cd000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788309612.424398:0:21139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788309612.424411:0:21139:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788309612.424416:0:21139:0:(genops.c:885:class_export_put()) final put ffff8c30f54b6000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788309612.424420:0:21139:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f54b6000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788309612.424433:0:21139:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788309612.424585:0:21139:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8c30f54b6800 00000020:02000400:1.0:1788309612.424967:0:21139:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788309612.650454:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309613.674029:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788309613.674034:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 42218ed5-7e96-4e9d-b9da-f92649f6b56e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788309613.674042:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 42218ed5-7e96-4e9d-b9da-f92649f6b56e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788309613.674046:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788309613.674049:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788309613.674133:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1875178048148352:0@lo:400:kworker.0 00000400:00000100:2.0:1788309613.674215:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875178048148352 offset 0 length 224: 4 00010000:00010000:2.0:1788309614.698052:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788309615.111414:0:21342:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1788309615.117991:0:21342:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788309615.118081:0:21342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91e00/0x98c38120c44aef63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44aef6a expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309615.118095:0:21342:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91e00/0x98c38120c44aef63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44aef6a expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309615.118102:0:21342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91e00/0x98c38120c44aef63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44aef6a expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309615.118110:0:21342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91e00/0x98c38120c44aef63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44aef6a expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309615.118135:0:21342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788309615.118141:0:21342:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788309615.118163:0:21342:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788309615.118174:0:21342:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c30d3b06300 x1875178048147456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788309620 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309615.118204:0:21342:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788309615.118210:0:21342:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788309615.118216:0:21342:0:(import.c:65:import_set_state_nolock()) ffff8c2fc1926000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788309615.118221:0:21342:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788309615.118239:0:21342:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c30d3b06300 x1875178048147456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788309620 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788309615.118247:0:17153:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788309615.118248:0:21342:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788309615.118255:0:21342:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00010000:00010000:0.0:1788309615.118258:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91e00/0x98c38120c44aef63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44aef6a expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309615.118268:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d3d91e00 already unused, calling callback (ffffffffc1507c20) 10000000:00010000:0.0:1788309615.118272:0:17153:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91e00/0x98c38120c44aef63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44aef6a expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309615.118281:0:17153:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91e00/0x98c38120c44aef63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x98c38120c44aef6a expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788309615.118296:0:17153:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91e00/0x98c38120c44aef63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x98c38120c44aef6a expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309615.118315:0:17153:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788309615.118318:0:17153:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788309615.118320:0:17153:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788309615.118342:0:17153:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c2fc4316000 00010000:00010000:0.0:1788309615.118347:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91e00/0x98c38120c44aef63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x98c38120c44aef6a expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309615.118358:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91e00/0x98c38120c44aef63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x98c38120c44aef6a expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309615.118370:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309615.118372:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309615.118373:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309615.118771:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1875178048147456:0@lo:38:kworker.0 00000100:00080000:3.0:1788309615.121978:0:21342:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788309615.121995:0:21342:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c30d3b04700 x1875178048147584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309616 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309615.122020:0:21342:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c2fc414dc00 x1875178048147840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309619 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309615.122037:0:21342:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c30fbbf3800 x1875178048147968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309621 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309615.122053:0:21342:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c30fbbf0700 x1875178048148224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309624 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309615.122064:0:21342:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c30fba9e300 x1875178048148352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309629 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309615.122078:0:21342:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1788309615.122083:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875178048148224:0@lo:400:kworker.0 00000100:00080000:3.0:1788309615.122084:0:21342:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788309615.122091:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875178048147840:0@lo:400:kworker.0 00000100:00080000:3.0:1788309615.122106:0:21342:0:(import.c:65:import_set_state_nolock()) ffff8c2fc1927000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788309615.122108:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875178048147584:0@lo:400:kworker.0 00000100:00100000:0.0:1788309615.122151:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875178048147968:0@lo:400:kworker.0 00000100:00100000:3.0:1788309615.122156:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1875178048148352:0@lo:400:kworker.0 00000100:00100000:2.0:1788309615.122869:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1875178048148480:0@lo:39:umount.0 00000400:00000100:2.0:1788309615.122957:0:3616:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875178048148480 offset 0 length 224: 4 00010000:00010000:3.0:1788309615.722034:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309616.746242:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309617.770105:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309618.794054:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788309618.798489:0:468:0:(pinger.c:229:ptlrpc_pinger_process_import()) 42218ed5-7e96-4e9d-b9da-f92649f6b56e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788309618.798497:0:468:0:(pinger.c:247:ptlrpc_pinger_process_import()) 42218ed5-7e96-4e9d-b9da-f92649f6b56e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788309619.818138:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309620.842502:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309621.866013:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309622.890199:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309623.337979:0:3616:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788309608/real 1788309608] req@ffff8c30fbbf2d80 x1875178048148096/t0(0) o250->MGC192.168.206.132@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788309623 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309623.338009:0:3616:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c30fbbf2d80 x1875178048148096/t0(0) o250->MGC192.168.206.132@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788309623 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788309623.338027:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c2fc4316000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788309623.338044:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788309623.338048:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3616:1875178048148096:0@lo:250:kworker.0 00000100:00080000:1.0:1788309623.338751:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 42218ed5-7e96-4e9d-b9da-f92649f6b56e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788309623.338757:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788309623.338761:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c2fc4316000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788309623.338766:0:36:0:(import.c:510:import_select_connection()) MGC192.168.206.132@tcp: connect to NID 0@lo last attempt 518 00000100:00080000:1.0:1788309623.338771:0:36:0:(import.c:589:import_select_connection()) MGC192.168.206.132@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788309623.338778:0:36:0:(import.c:624:import_select_connection()) MGC192.168.206.132@tcp: import ffff8c2fc4316000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:1.0:1788309623.338814:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30fba9d180 x1875178048148608/t0(0) o250->MGC192.168.206.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788309623.338951:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3616:1875178048148608:0@lo:250:kworker.0 00000400:00000100:3.0:1788309623.339006:0:3616:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875178048148608 offset 0 length 520: 4 00010000:00010000:0.0:1788309623.914042:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309624.944333:0:17152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309625.387111:0:3616:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788309615/real 1788309615] req@ffff8c30fbbf1180 x1875178048148480/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788309625 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309625.387151:0:3616:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c30fbbf1180 x1875178048148480/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788309625 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788309625.387193:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c2fc1927000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788309625.387270:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1875178048148480:0@lo:39:umount.0 00000100:00080000:1.0:1788309625.388380:0:21342:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788309625.388395:0:21342:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788309625.388400:0:21342:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788309625.389324:0:21342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91c00/0x98c38120c44aef39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44aef40 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309625.389338:0:21342:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91c00/0x98c38120c44aef39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44aef40 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309625.389346:0:21342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91c00/0x98c38120c44aef39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44aef40 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309625.389353:0:21342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91c00/0x98c38120c44aef39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44aef40 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309625.389382:0:21342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788309625.389389:0:21342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c83dbe00/0x98c38120c44af12a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af131 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309625.389396:0:21342:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c83dbe00/0x98c38120c44af12a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af131 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309625.389401:0:21342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c83dbe00/0x98c38120c44af12a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44af131 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309625.389407:0:21342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff8c30c83dbe00/0x98c38120c44af12a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x98c38120c44af131 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309625.389426:0:21342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788309625.389431:0:21342:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788309625.389454:0:21342:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788309625.389459:0:21342:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788309625.389470:0:21342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788309625.389476:0:21342:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788309625.389480:0:21342:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8c30edf7b370) has no exports 00010000:00010000:2.0:1788309625.389485:0:18806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788309625.389493:0:18806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91c00/0x98c38120c44aef39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44aef40 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309625.389502:0:18806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d3d91c00 already unused, calling callback (ffffffffc1507c20) 00000020:00080000:1.0:1788309625.389502:0:21342:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8c30edf7b370) has no exports 10000000:00010000:2.0:1788309625.389507:0:18806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91c00/0x98c38120c44aef39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44aef40 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309625.389518:0:18806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91c00/0x98c38120c44aef39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x98c38120c44aef40 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309625.389526:0:18806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91c00/0x98c38120c44aef39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x98c38120c44aef40 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309625.389532:0:18806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788309625.389541:0:18806:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788309625.389543:0:18806:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788309625.389558:0:18806:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c2fc4316000 00010000:00010000:2.0:1788309625.389562:0:18806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91c00/0x98c38120c44aef39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x98c38120c44aef40 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309625.389568:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91c00/0x98c38120c44aef39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x98c38120c44aef40 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309625.389583:0:18806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309625.389587:0:18806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c30c83dbe00/0x98c38120c44af12a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44af131 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309625.389592:0:18806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30c83dbe00 already unused, calling callback (ffffffffc1507c20) 10000000:00010000:2.0:1788309625.389595:0:18806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c30c83dbe00/0x98c38120c44af12a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x98c38120c44af131 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309625.389603:0:18806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c30c83dbe00/0x98c38120c44af12a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x98c38120c44af131 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309625.389610:0:18806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c30c83dbe00/0x98c38120c44af12a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x98c38120c44af131 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309625.389616:0:18806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788309625.389618:0:18806:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788309625.389619:0:18806:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788309625.389637:0:18806:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c2fc4316000 00010000:00010000:2.0:1788309625.389640:0:18806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c30c83dbe00/0x98c38120c44af12a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x98c38120c44af131 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309625.389646:0:18806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c30c83dbe00/0x98c38120c44af12a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x98c38120c44af131 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309625.389663:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309625.389664:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309625.389666:0:18806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309625.392317:0:17153:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788309625.394561:0:21342:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c2fc21b7f60 - data ffff8c2fc1c1e0d8/ffff8c2fc443ac00 00000020:01000000:1.0:1788309625.394762:0:21342:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c30d01c6d80 - data ffff8c30ee587000/ffff8c30f56c8000 00100000:10000000:1.0:1788309625.407471:0:21342:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788309625.415869:0:21342:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aef4e 00000020:00000080:2.0:1788309625.415881:0:21342:0:(genops.c:885:class_export_put()) final put ffff8c30c7fe9000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788309625.415891:0:21342:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c2fc1973000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788309625.415895:0:21342:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c2fc1973000 2 00000020:01000004:2.0:1788309625.415898:0:21342:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c2fc1973000 from lustre-OST0001 00000020:00000080:2.0:1788309625.415918:0:21342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788309625.415926:0:21342:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788309625.415928:0:21342:0:(genops.c:885:class_export_put()) final put ffff8c2fc35ac800/lustre-OST0001_UUID 00000020:00000080:2.0:1788309625.415931:0:21342:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc35ac800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788309625.415936:0:21342:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788309625.416024:0:21342:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 42218ed5-7e96-4e9d-b9da-f92649f6b56e->MGS 00010000:00010000:2.0:1788309625.416038:0:21342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0000/0x98c38120c44aec92 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x98c38120c44aec99 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309625.416050:0:21342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0000/0x98c38120c44aec92 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x98c38120c44aec99 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309625.416056:0:21342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788309625.416058:0:21342:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788309625.416061:0:21342:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788309625.416076:0:21342:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c2fc4316000 00010000:00010000:2.0:1788309625.416079:0:21342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0000/0x98c38120c44aec92 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x98c38120c44aec99 expref: -99 pid: 17895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309625.416093:0:21342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c2fc337c400/0x98c38120c44aeb81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x98c38120c44aeb88 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309625.416111:0:21342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c2fc337c400/0x98c38120c44aeb81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x98c38120c44aeb88 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309625.416116:0:21342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788309625.416118:0:21342:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788309625.416119:0:21342:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788309625.416138:0:21342:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c2fc4316000 00010000:00010000:2.0:1788309625.416141:0:21342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c2fc337c400/0x98c38120c44aeb81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x98c38120c44aeb88 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788309625.416157:0:21342:0:(import.c:65:import_set_state_nolock()) ffff8c2fc4316000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788309625.416160:0:21342:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788309625.416162:0:21342:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788309625.416164:0:21342:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788309625.416167:0:21342:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788309625.416176:0:21342:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c30fba9d180 x1875178048148608/t0(0) o250->MGC192.168.206.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788309643 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788309625.416187:0:21342:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788309625.416189:0:21342:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000020:00000080:3.0:1788309625.416555:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30c7fe9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1788309625.416588:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:42218ed5-7e96-4e9d-b9da-f92649f6b56e:3616:1875178048148608:0@lo:250:kworker.0 10000000:01000000:2.0:1788309625.416737:0:21342:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788309625.416745:0:21342:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aeb6c 00000020:00000080:2.0:1788309625.416749:0:21342:0:(genops.c:885:class_export_put()) final put ffff8c30d1891000/42218ed5-7e96-4e9d-b9da-f92649f6b56e 00000020:01000000:2.0:1788309625.416764:0:21342:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.132@tcp (flags='') 00000020:00000080:2.0:1788309625.416769:0:21342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788309625.416773:0:21342:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.132@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788309625.416776:0:21342:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8c3101264d28) has no exports 10000000:01000000:2.0:1788309625.416791:0:17161:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788309625.416868:0:21342:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.132@tcp: client import never connected 00000100:00080000:2.0:1788309625.416871:0:21342:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788309625.416873:0:21342:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788309625.416881:0:21342:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788309625.416883:0:21342:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788309625.416912:0:21342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788309625.416916:0:21342:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.132@tcp (uuid 42218ed5-7e96-4e9d-b9da-f92649f6b56e) 00000020:01000000:2.0:1788309625.416920:0:21342:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788309625.416923:0:21342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788309625.416926:0:21342:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788309625.416930:0:21342:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8c2fc1923000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788309625.416934:0:21342:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff8c30edf799b8) has exports, disconnecting them 00000020:00080000:2.0:1788309625.416937:0:21342:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8c2fc1923000), last request at 1788309554 00000020:00000080:2.0:1788309625.416940:0:21342:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aef78 00000020:00080000:2.0:1788309625.416950:0:21342:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c2fc1923000): rc 0 00000020:00000080:2.0:1788309625.416953:0:21342:0:(genops.c:885:class_export_put()) final put ffff8c2fc1923000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788309625.418089:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30d1891000/42218ed5-7e96-4e9d-b9da-f92649f6b56e for MGC192.168.206.132@tcp 00000020:00000080:3.0:1788309625.418101:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c2fc4316000 for MGC192.168.206.132@tcp 00000020:00000080:3.0:1788309625.418107:0:36:0:(genops.c:885:class_export_put()) final put ffff8c2fc4312000/42218ed5-7e96-4e9d-b9da-f92649f6b56e 00000020:00000080:3.0:1788309625.418109:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc4312000/42218ed5-7e96-4e9d-b9da-f92649f6b56e for MGC192.168.206.132@tcp 00000020:01000000:3.0:1788309625.418114:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.132@tcp (42218ed5-7e96-4e9d-b9da-f92649f6b56e) 00000020:00000080:3.0:1788309625.418393:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc1923000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788309625.418417:0:21342:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788309625.418420:0:21342:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788309625.418423:0:21342:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788309625.418428:0:21342:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788309625.418583:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c2fc1926000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788309625.419583:0:21342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788309625.419592:0:21342:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788309625.419596:0:21342:0:(genops.c:885:class_export_put()) final put ffff8c3101368000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788309625.419599:0:21342:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3101368000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788309625.419604:0:21342:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1788309625.419663:0:21342:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788309625.419667:0:21342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788309625.420180:0:21342:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788309625.420186:0:21342:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8c2fc1921800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788309625.420193:0:21342:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8c30f03e8000) has exports, disconnecting them 00000020:00080000:3.0:1788309625.420205:0:21342:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8c2fc1921800), last request at 1788309554 00000020:00000080:3.0:1788309625.420209:0:21342:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aef8d 00000020:00080000:3.0:1788309625.420643:0:21342:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c2fc1921800): rc 0 00000020:00000080:3.0:1788309625.420648:0:21342:0:(genops.c:885:class_export_put()) final put ffff8c2fc1921800/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1788309625.422383:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc1921800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1788309625.424997:0:21342:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788309625.425005:0:21342:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788309625.425009:0:21342:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788309625.425152:0:21342:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788309625.425182:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c2fc1927000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1788309625.425246:0:17152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788309625.425395:0:18806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788309625.425460:0:17153:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788309625.425610:0:17148:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8c2fc33bce00:17148] 1 exiting: rc = 0 00000100:00100000:0.0:1788309625.425667:0:17147:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8c2fc40c7e00:17147] 0 exiting: rc = 1 00000100:00100000:0.0:1788309625.425727:0:20191:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8c30f50c3200:20191] 2 exiting: rc = 0 00000100:00100000:0.0:1788309625.425793:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426053:0:17149:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8c2fc40c6400:17149] 0 exiting: rc = 1 00000100:00100000:0.0:1788309625.426121:0:17151:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8c30c3fb8400:17151] 2 exiting: rc = 0 00000100:00100000:0.0:1788309625.426346:0:20192:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8c30f50c2800:20192] 4 exiting: rc = 0 00000100:00100000:0.0:1788309625.426441:0:18317:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8c30ee1aac00:18317] 3 exiting: rc = 0 00000100:00100000:0.0:1788309625.426653:0:17150:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8c30c3fb9a00:17150] 1 exiting: rc = 0 00000100:00100000:0.0:1788309625.426706:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426714:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426720:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426730:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426736:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426742:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426747:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426752:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426781:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426791:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426796:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426803:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426809:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426829:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426835:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426864:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426870:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426875:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426880:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426884:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426889:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426894:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426899:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426905:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426911:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426916:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426921:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426926:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426931:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426936:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426941:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426945:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426951:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426956:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426960:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426965:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426970:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426975:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426980:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426985:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426991:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.426996:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.427001:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.427006:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.427012:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.427017:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.427022:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.427028:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.427042:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.427048:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.427054:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.427059:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.427065:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.427071:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.427077:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.427083:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.427090:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.427096:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.427102:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.427107:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.427112:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.427118:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.427123:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.427139:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788309625.429124:0:21342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788309625.429145:0:21342:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1788309625.429151:0:21342:0:(genops.c:885:class_export_put()) final put ffff8c2fc1925800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1788309625.429155:0:21342:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc1925800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1788309625.429161:0:21342:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1788309625.429446:0:21342:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c2fc1973000 1 00000020:00000080:0.0:1788309625.429452:0:21342:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x98c38120c44aef32 00000020:00000080:0.0:1788309625.429458:0:21342:0:(genops.c:885:class_export_put()) final put ffff8c30f58af000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788309625.429472:0:21342:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788309625.429486:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30f58af000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788309625.429500:0:21342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788309625.429506:0:21342:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788309625.429509:0:21342:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff8c2fc23b99b8) has no exports 00000020:00000080:0.0:1788309625.468958:0:21342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788309625.468970:0:21342:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788309625.468976:0:21342:0:(genops.c:885:class_export_put()) final put ffff8c2fc1975800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788309625.468980:0:21342:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc1975800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788309625.469001:0:21342:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788309625.469707:0:21342:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8c2fc1971800 00000020:01000000:0.0:1788309625.469727:0:21342:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788309625.469731:0:21342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788309625.469735:0:21342:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788309625.469739:0:21342:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8c30c7b319b8) has no exports 00000020:00000080:0.0:1788309625.469764:0:21342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788309625.469769:0:21342:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788309625.469773:0:21342:0:(genops.c:885:class_export_put()) final put ffff8c2fc35c9000/OSS_uuid 00000020:00000080:0.0:1788309625.469775:0:21342:0:(genops.c:844:class_export_destroy()) destroying export ffff8c2fc35c9000/OSS_uuid for OSS 00000020:01000000:0.0:1788309625.469780:0:21342:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788309625.469875:0:18672:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8c30edf95e00:18672] 2 exiting: rc = 0 00000100:00080000:0.0:1788309625.470940:0:17160:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788309625.472982:0:19862:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8c2fc2a5f000:19862] 3 exiting: rc = 0 00000100:00100000:0.0:1788309625.478985:0:18670:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8c30edf95400:18670] 0 exiting: rc = 1 00000100:00100000:0.0:1788309625.486992:0:18671:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8c30ee837c00:18671] 1 exiting: rc = 0 00000100:00100000:0.0:1788309625.487154:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487161:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487166:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487171:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487176:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487181:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487186:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487191:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487195:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487200:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487205:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487211:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487215:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487220:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487225:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487230:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487236:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487240:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487259:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487264:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487269:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487274:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487279:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487297:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487310:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487316:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487321:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487327:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487332:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487337:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487342:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487347:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487352:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487357:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487363:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487368:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487373:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487378:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487383:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487388:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487393:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487398:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487403:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487409:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487414:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487420:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487435:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487441:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487445:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487450:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487455:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487460:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487465:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487476:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487481:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487485:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487490:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487494:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487499:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487504:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487508:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487756:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487765:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.487771:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788309625.488926:0:20737:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8c2fc2a53200:20737] 2 exiting: rc = 0 00000100:00100000:0.0:1788309625.489002:0:18674:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8c30c6877400:18674] 1 exiting: rc = 0 00000100:00100000:0.0:1788309625.503744:0:18673:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8c30ee331a00:18673] 0 exiting: rc = 1 00000100:00100000:2.0:1788309625.503956:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.503965:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.503970:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.503975:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.503980:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.503986:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.503991:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.503996:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504002:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504006:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504073:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504083:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504088:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504093:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504097:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504102:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504107:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504112:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504117:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504122:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504157:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504163:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504169:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504174:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504179:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504183:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504189:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504194:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504199:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504204:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504209:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504214:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504219:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504224:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504229:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504234:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504238:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504243:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504248:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504253:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504258:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504262:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504267:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504272:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504278:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504283:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504795:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504802:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504807:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504811:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504816:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504820:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504973:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504981:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.504986:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.505001:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.505007:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.505068:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.505074:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.505078:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.505082:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.505087:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.505091:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.505095:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.507265:0:18676:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8c30ee23ce00:18676] 1 exiting: rc = 0 00000100:00100000:3.0:1788309625.507658:0:20305:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff8c2fc2bd8800:20305] 3 exiting: rc = 0 00000100:00100000:3.0:1788309625.510688:0:18677:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8c30d6d17400:18677] 2 exiting: rc = 0 00000100:00100000:0.0:1788309625.511173:0:18675:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8c30c6877e00:18675] 0 exiting: rc = 1 00000100:00100000:3.0:1788309625.511665:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.511673:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.511679:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.511684:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.511689:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.511694:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.511699:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.511703:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.511709:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.511713:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.511718:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.511723:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.511728:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.511734:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.511741:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.511749:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.511759:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.511765:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.511770:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.511780:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.511787:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.511793:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.511798:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.511803:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.513972:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.513990:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514008:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514082:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514091:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514096:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514102:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514107:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514113:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514118:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514123:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514137:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514143:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514148:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514153:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514158:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514164:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514169:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514174:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514179:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514184:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514189:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514195:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514200:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514222:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514229:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514234:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514239:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514245:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514250:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514256:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514262:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514276:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514489:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514498:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.514503:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.523618:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.523660:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.523666:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.523687:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.531708:0:18679:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8c30ee318c00:18679] 1 exiting: rc = 0 00000100:00100000:0.0:1788309625.557256:0:18678:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8c2fc222d600:18678] 0 exiting: rc = 1 00000100:00100000:2.0:1788309625.558624:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558633:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558638:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558643:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558649:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558654:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558659:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558664:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558668:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558673:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558678:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558693:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558702:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558706:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558711:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558715:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558720:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558725:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558730:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558783:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558789:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558793:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558798:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558802:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558807:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558811:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558978:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558983:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558988:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.558993:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559000:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559160:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559171:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559176:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559181:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559186:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559192:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559196:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559201:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559206:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559210:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559215:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559220:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559225:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559231:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559236:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559240:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559245:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559250:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559255:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559259:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559264:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559269:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559274:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559279:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559572:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559581:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559585:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559590:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559594:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559599:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559615:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559619:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.559630:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788309625.561467:0:18680:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8c30ee208800:18680] 0 exiting: rc = 1 00000100:00100000:0.0:1788309625.561628:0:18681:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8c30ee209c00:18681] 1 exiting: rc = 0 00000100:00100000:2.0:1788309625.561749:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.561757:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.561762:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.561768:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.561797:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.561805:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.561811:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.561818:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.561982:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.561989:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.561994:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562000:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562107:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562117:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562122:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562137:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562157:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562164:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562169:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562174:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562181:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562189:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562194:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562199:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562206:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562213:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562220:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562228:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562249:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562257:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562262:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562270:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562413:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562418:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562489:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562498:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562505:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562511:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562518:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562524:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562549:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562556:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562564:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562570:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562576:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562581:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562587:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562594:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562601:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562608:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562613:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562620:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562640:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562647:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562653:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562659:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562664:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562669:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562675:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562680:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562686:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562691:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562697:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788309625.562702:0:21342:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788309625.577385:0:21342:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788309643.672691:0:22107:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg632-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788309654.362047:0:22706:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788309654.362053:0:22706:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788309654.362055:0:22706:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788309654.362286:0:22706:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c30c83d6000 00000020:01000004:2.0:1788309654.362307:0:22706:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788309654.362314:0:22706:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788309654.362327:0:22706:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8c30f03eb370) 00000020:00000080:2.0:1788309654.362339:0:22706:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788309654.430354:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788309654.434677:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788309654.437087:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788309654.438443:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788309654.438748:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788309654.439325:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788309654.439641:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1788309654.440497:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788309654.441456:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788309654.442382:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788309654.442794:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1788309654.443198:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1788309654.443518:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788309654.443910:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788309654.445512:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788309654.447523:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788309654.449665:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788309654.452383:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788309654.452937:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788309654.454058:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788309654.455125:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788309654.455872:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788309654.456426:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788309654.456635:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788309654.456948:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788309654.457405:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788309654.457634:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788309654.457927:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788309654.458407:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788309654.458606:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788309654.458931:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788309654.459624:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788309654.460020:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788309654.461056:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788309654.463870:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788309654.464769:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788309654.465541:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788309654.465910:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788309654.466574:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788309654.467312:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788309654.467665:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788309654.468571:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788309654.468912:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788309654.470249:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788309654.470652:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788309654.471086:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788309654.471474:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788309654.475765:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788309654.477426:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788309654.477634:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788309654.478435:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1788309654.478629:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788309654.478959:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:3.0:1788309654.479828:0:22706:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788309654.480533:0:22706:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788309654.480541:0:22706:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788309654.480552:0:22706:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x98c38120c44af3d8 00000020:01000004:3.0:1788309654.480560:0:22706:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788309654.480564:0:22706:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788309654.480569:0:22706:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c30c83d6000 from MGS 00000020:01000004:3.0:1788309654.480572:0:22706:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788309654.480582:0:22706:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8c3101203370) 00000020:00000080:3.0:1788309654.480592:0:22706:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788309654.480647:0:22706:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c30c83d6000 from MGS, refs=2 00080000:01000000:3.0:1788309654.480663:0:22706:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788309654.480668:0:22706:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x98c38120c44af3e6 00000100:00100000:3.0:1788309654.480770:0:22706:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788309654.480917:0:22706:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788309654.480923:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788309654.482937:0:22706:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788309654.482947:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788309654.484324:0:22706:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788309654.484673:0:22706:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788309654.484743:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788309654.485737:0:22706:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788309654.485748:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788309654.486587:0:22706:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788309654.486595:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788309654.488102:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309654.488106:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309654.488108:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309654.488650:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309654.488653:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309654.488655:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309654.489573:0:22706:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788309654.493935:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788309654.501037:0:22706:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788309654.503633:0:22718:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788309654.503690:0:22706:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788309654.503731:0:22706:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788309654.504890:0:22706:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788309654.505427:0:22706:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788309654.505582:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788309654.505588:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788309654.506537:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788309654.506544:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788309654.516926:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788309654.516941:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788309654.518655:0:22706:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788309654.518676:0:22706:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.132@tcp' 00000020:01000004:1.0:1788309654.518689:0:22706:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788309654.518723:0:22706:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.132@tcp (typ=mgc) 00000020:00000080:1.0:1788309654.518735:0:22706:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.132@tcp (ffff8c2fc23bb370) 00000020:00000080:1.0:1788309654.518752:0:22706:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788309654.518950:0:22706:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c30ee304000@MGC192.168.206.132@tcp: add connection 192.168.206.132@tcp at head 00000100:00080000:0.0:1788309654.519263:0:22723:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:1.0:1788309654.519456:0:22706:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.132@tcp-0 is initialized 00000040:01000000:1.0:1788309654.519463:0:22706:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.132@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788309654.530970:0:22724:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788309654.533386:0:22706:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.132@tcp (uuid 7b0d6b2e-d97d-4371-bf12-107712db0d6d) 00000020:00000080:0.0:1788309654.533410:0:22706:0:(genops.c:1385:class_connect()) connect: client 7b0d6b2e-d97d-4371-bf12-107712db0d6d, cookie 0x98c38120c44af3f4 00000100:00080000:0.0:1788309654.533421:0:22706:0:(import.c:510:import_select_connection()) MGC192.168.206.132@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788309654.533428:0:22706:0:(import.c:624:import_select_connection()) MGC192.168.206.132@tcp: import ffff8c30ee304000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:0.0:1788309654.533457:0:22706:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c2fc414d880 x1875178048148736/t0(0) o250->MGC192.168.206.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788309654.533501:0:22706:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7b0d6b2e-d97d-4371-bf12-107712db0d6d->MGS 00000020:01000004:0.0:1788309654.533522:0:22706:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788309654.533527:0:22706:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788309654.533539:0:22706:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8c30c7a1cd28) 00000020:00000080:0.0:1788309654.533552:0:22706:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788309654.535003:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3616:1875178048148736:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788309654.535072:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309654.535166:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048148736 00000100:00100000:1.0:1788309654.535173:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048148736 00000100:00100000:1.0:1788309654.535202:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788309654.535209:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc36ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3616:x1875178048148736:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788309654.535232:0:22719:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 7b0d6b2e-d97d-4371-bf12-107712db0d6d@0@lo t0 exp 0000000000000000 cur 564 last 0 00000020:00000080:1.0:1788309654.535268:0:22719:0:(genops.c:1385:class_connect()) connect: client 7b0d6b2e-d97d-4371-bf12-107712db0d6d, cookie 0x98c38120c44af402 00000100:00080000:1.0:1788309654.535384:0:22719:0:(import.c:65:import_set_state_nolock()) ffff8c30ee301800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788309654.535432:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc36ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+5:3616:x1875178048148736:12345-0@lo:250:mount.lustre.0 Request processed in 221us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309654.535439:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788309654.535478:0:3616:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.132@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788309654.535486:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.132@tcp: connect to target with instance 0 00000100:00080000:1.0:1788309654.535492:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.132@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788309654.535496:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788309654.535499:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30ee304000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788309654.535501:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788309654.535508:0:3616:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788309654.535513:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3616:1875178048148736:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788309654.548576:0:22706:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788309654.548987:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788309654.548994:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788309654.553536:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788309654.553551:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788309654.554167:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788309654.554175:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788309654.556757:0:22706:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788309654.557321:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788309654.557328:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788309654.558008:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788309654.558015:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788309654.595548:0:22706:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788309654.595947:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788309654.595953:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788309654.597570:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788309654.597581:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788309654.598168:0:22706:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788309654.598462:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788309654.598467:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788309654.599404:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788309654.599412:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788309654.600312:0:22706:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788309654.600489:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788309654.600495:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788309654.601484:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788309654.601493:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788309654.602503:0:22706:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788309654.602654:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788309654.602659:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788309654.603475:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788309654.603482:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788309654.632035:0:22706:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788309654.632465:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788309654.632472:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788309654.636037:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788309654.636049:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788309654.637567:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788309654.637576:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788309654.638460:0:22706:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788309654.638488:0:22706:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788309654.638494:0:22706:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.132@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788309654.638588:0:22706:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.132@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788309654.638623:0:22706:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.132@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788309654.638627:0:22706:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788309654.638629:0:22706:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788309654.638630:0:22706:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788309654.638631:0:22706:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788309654.638632:0:22706:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788309654.638633:0:22706:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788309654.638634:0:22706:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788309654.638635:0:22706:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788309654.638637:0:22706:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788309654.638638:0:22706:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788309654.638640:0:22706:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788309654.638642:0:22706:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788309654.638643:0:22706:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788309654.638644:0:22706:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788309654.638645:0:22706:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788309654.638646:0:22706:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788309654.638647:0:22706:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788309654.638648:0:22706:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788309654.638653:0:22706:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788309654.638654:0:22706:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788309654.638655:0:22706:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788309654.638688:0:22706:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788309654.638711:0:22706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048148864:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788309654.638789:0:22706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309654.638832:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2a2f240 going to sleep for 11 seconds 00000100:00100000:0.0:1788309654.640829:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048148864 00000100:00100000:0.0:1788309654.640871:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048148864 00000100:00100000:0.0:1788309654.640916:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788309654.640933:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc36ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+5:22706:x1875178048148864:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788309654.640989:0:22722:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788309654.640993:0:22722:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788309654.640996:0:22722:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788309654.641761:0:22744:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788309654.642756:0:22722:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1788309654.646531:0:22745:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788309654.646538:0:22745:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788309654.646541:0:22745:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788309654.646544:0:22745:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788309654.646768:0:22745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788309654.647319:0:22722:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788309654.647329:0:22722:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788309654.650384:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc36ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+5:22706:x1875178048148864:12345-0@lo:253:mount.lustre.0 Request processed in 9446us (11588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309654.650399:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788309654.650476:0:22706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048148864:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788309654.650491:0:22706:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788309654.650495:0:22706:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788309654.650496:0:22706:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788309654.650497:0:22706:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788309654.650498:0:22706:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788309654.650499:0:22706:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788309654.650500:0:22706:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788309654.650501:0:22706:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788309654.650503:0:22706:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788309654.650505:0:22706:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788309654.650506:0:22706:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788309654.650523:0:22706:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c30c83d6000 from lustre-MDT0000 10000000:01000000:0.0:1788309654.650550:0:22706:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788309654.650553:0:22706:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788309654.650556:0:22706:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8c2fc23bb370 10000000:01000000:0.0:1788309654.650559:0:22706:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788309654.650566:0:22706:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8c2fc23bb370 from 1 10000000:01000000:0.0:1788309654.650569:0:22706:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788309654.650602:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1512200/0x98c38120c44af409 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309654.650612:0:22706:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c30c1512200/0x98c38120c44af409 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309654.650621:0:22706:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c30c1512200/0x98c38120c44af409 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309654.650639:0:22706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048148992:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788309654.650746:0:22706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309654.650813:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c35cab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788309654.651022:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048148992 00000100:00100000:1.0:1788309654.651028:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048148992 00000100:00100000:1.0:1788309654.651217:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788309654.651226:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc36ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+5:22706:x1875178048148992:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788309654.651346:0:22720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309654.651360:0:22720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c2fc35f0000/0x98c38120c44af410 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af409 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309654.651382:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c2fc35f0000/0x98c38120c44af410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af409 expref: 6 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309654.651391:0:22720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c2fc35f0000/0x98c38120c44af410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af409 expref: 6 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309654.651399:0:22720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c2fc35f0000, rc 0) 00000100:00100000:1.0:1788309654.651441:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc36ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+6:22706:x1875178048148992:12345-0@lo:101:mount.lustre.0 Request processed in 215us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309654.651456:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788309654.651526:0:22706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048148992:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788309654.651538:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c30c1512200/0x98c38120c44af409 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af410 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309654.651547:0:22706:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c30c1512200/0x98c38120c44af409 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af410 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309654.651611:0:22706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048149120:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788309654.651636:0:22706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309654.651727:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c35cab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788309654.652051:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048149120 00000100:00100000:3.0:1788309654.652057:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048149120 00000100:00100000:3.0:1788309654.652098:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788309654.652105:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f613a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+6:22706:x1875178048149120:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788309654.652179:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f613a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+6:22706:x1875178048149120:12345-0@lo:501:mount.lustre.0 Request processed in 74us (541us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788309654.652185:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788309654.652431:0:22706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048149120:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788309654.652459:0:22706:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788309654.652478:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1512200/0x98c38120c44af409 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af410 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309654.652486:0:22706:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30c1512200/0x98c38120c44af409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af410 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309654.652493:0:22706:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c30c83d6000 10000000:01000000:0.0:1788309654.652497:0:22706:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788309654.652502:0:22706:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8c30c83d6000 10000000:01000000:0.0:1788309654.652504:0:22706:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788309654.652506:0:22706:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8c30c83d6000 from 1 10000000:01000000:0.0:1788309654.652508:0:22706:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788309654.652525:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1513a00/0x98c38120c44af417 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309654.652540:0:22706:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c30c1513a00/0x98c38120c44af417 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309654.652549:0:22706:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c30c1513a00/0x98c38120c44af417 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309654.652562:0:22706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048149248:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788309654.652589:0:22706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309654.652608:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c35cab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788309654.652660:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048149248 00000100:00100000:3.0:1788309654.652666:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048149248 00000100:00100000:3.0:1788309654.652697:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788309654.652703:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f6139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+6:22706:x1875178048149248:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788309654.652711:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309654.652721:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30c83da000/0x98c38120c44af41e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af417 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309654.652743:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30c83da000/0x98c38120c44af41e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af417 expref: 7 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309654.652751:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30c83da000/0x98c38120c44af41e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af417 expref: 7 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309654.652758:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30c83da000, rc 0) 00000100:00100000:3.0:1788309654.652789:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f6139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+7:22706:x1875178048149248:12345-0@lo:101:mount.lustre.0 Request processed in 87us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309654.652795:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788309654.652996:0:22706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048149248:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788309654.653007:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c30c1513a00/0x98c38120c44af417 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af41e expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309654.653014:0:22706:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c30c1513a00/0x98c38120c44af417 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af41e expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309654.653025:0:22706:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788309654.653034:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1513a00/0x98c38120c44af417 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af41e expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309654.653039:0:22706:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30c1513a00/0x98c38120c44af417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af41e expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309654.653045:0:22706:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788309654.653048:0:22706:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788309654.653051:0:22706:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8c30c83d6000 10000000:01000000:0.0:1788309654.653053:0:22706:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788309654.653073:0:22706:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788309654.653075:0:22706:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788309654.653097:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1513400/0x98c38120c44af425 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309654.653105:0:22706:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c30c1513400/0x98c38120c44af425 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309654.653112:0:22706:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c30c1513400/0x98c38120c44af425 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309654.653123:0:22706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048149376:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788309654.653157:0:22706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309654.653174:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c35cab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788309654.653432:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048149376 00000100:00100000:3.0:1788309654.653437:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048149376 00000100:00100000:3.0:1788309654.653458:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788309654.653464:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f6139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+7:22706:x1875178048149376:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788309654.653471:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309654.653479:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30c83dae00/0x98c38120c44af42c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af425 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309654.653492:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30c83dae00/0x98c38120c44af42c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af425 expref: 8 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309654.653500:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30c83dae00/0x98c38120c44af42c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af425 expref: 8 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309654.653506:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30c83dae00, rc 0) 00000100:00100000:3.0:1788309654.653531:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f6139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+8:22706:x1875178048149376:12345-0@lo:101:mount.lustre.0 Request processed in 68us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309654.653537:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788309654.653610:0:22706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048149376:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788309654.653621:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c30c1513400/0x98c38120c44af425 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af42c expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309654.653627:0:22706:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c30c1513400/0x98c38120c44af425 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af42c expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309654.653666:0:22706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048149504:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788309654.653702:0:22706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309654.653721:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c35cab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788309654.653766:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048149504 00000100:00100000:3.0:1788309654.653770:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048149504 00000100:00100000:3.0:1788309654.653787:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788309654.653793:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f613bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+8:22706:x1875178048149504:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788309654.653935:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f613bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+9:22706:x1875178048149504:12345-0@lo:501:mount.lustre.0 Request processed in 141us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309654.653941:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788309654.654099:0:22706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048149504:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788309654.654127:0:22706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048149632:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788309654.654179:0:22706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309654.654212:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c35cab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788309654.654462:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048149632 00000100:00100000:3.0:1788309654.654466:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048149632 00000100:00100000:3.0:1788309654.654485:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788309654.654491:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f6138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+9:22706:x1875178048149632:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788309654.655858:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f6138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+9:22706:x1875178048149632:12345-0@lo:503:mount.lustre.0 Request processed in 1337us (1648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309654.655869:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788309654.656250:0:22706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048149632:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788309654.656702:0:22746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22746:1875178048149760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788309654.656751:0:22746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309654.656786:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2335d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788309654.656859:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048149760 00000100:00100000:0.0:1788309654.656865:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048149760 00000100:00100000:0.0:1788309654.656898:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788309654.656906:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f613b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+9:22746:x1875178048149760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788309654.657799:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f613b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+9:22746:x1875178048149760:12345-0@lo:502:llog_process_th.0 Request processed in 891us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309654.657808:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788309654.657989:0:22746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22746:1875178048149760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788309654.658017:0:22746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788309654.658028:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309654.658031:0:22746:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788309654.658036:0:22746:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788309654.658038:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788309654.658055:0:22746:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8c31012019b8) 00000020:00000080:3.0:1788309654.658082:0:22746:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788309654.658097:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788309654.658196:0:22746:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788309654.658208:0:22746:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x98c38120c44af43a 00000020:00000080:3.0:1788309654.658619:0:22746:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788309654.658624:0:22746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788309654.658628:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309654.658629:0:22746:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788309654.658632:0:22746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788309654.658635:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309654.658636:0:22746:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788309654.658639:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788309654.658646:0:22746:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8c3101200000) 00000020:00000080:3.0:1788309654.658657:0:22746:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788309654.658660:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788309654.658662:0:22746:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788309654.658664:0:22746:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788309654.658669:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788309654.658712:0:22746:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c30c83d6000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788309654.658724:0:22746:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8c3101204d28) 00000020:00000080:3.0:1788309654.658733:0:22746:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788309654.658781:0:22746:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788309654.658786:0:22746:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x98c38120c44af44f 00000020:00000080:3.0:1788309654.659037:0:22746:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788309654.659044:0:22746:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788309654.659049:0:22746:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x98c38120c44af456 00080000:01000000:3.0:1788309654.659054:0:22746:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788309654.659333:0:22746:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x98c38120c44af45d 00010000:00010000:2.0:1788309654.773239:0:22746:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788309654.774342:0:22746:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:2.0:1788309654.774767:0:22746:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788309654.775502:0:22746:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8c30f03e99b8) 00000020:00000080:2.0:1788309654.775519:0:22746:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788309654.775593:0:22746:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788309654.775600:0:22746:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x98c38120c44af46b 00000020:00000080:2.0:1788309654.780003:0:22746:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788309654.783413:0:22746:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x98c38120c44af472 00000020:00000080:2.0:1788309654.783706:0:22746:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788309654.783716:0:22746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788309654.783722:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309654.783729:0:22746:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788309654.783733:0:22746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788309654.783735:0:22746:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788309654.783736:0:22746:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788309654.783738:0:22746:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788309654.783739:0:22746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788309654.783741:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309654.783743:0:22746:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788309654.783745:0:22746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788309654.783749:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309654.783750:0:22746:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788309654.783754:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788309654.783788:0:22746:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788309654.783801:0:22746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788309654.783804:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309654.783805:0:22746:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788309654.783808:0:22746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788309654.783810:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309654.783811:0:22746:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788309654.783814:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788309654.783819:0:22746:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.132@tcp to nid 0x20000c0a8ce84 (192.168.206.132@tcp) 00000020:00000080:2.0:1788309654.783860:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788309654.783874:0:22746:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8c30f03ecd28) 00000020:00000080:2.0:1788309654.783887:0:22746:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788309654.783892:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788309654.783943:0:22746:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788309654.783948:0:22746:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788309654.783955:0:22746:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x98c38120c44af480 00010000:00080000:2.0:1788309654.783996:0:22746:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c2fc4270000@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.132@tcp at head 00010000:00010000:2.0:1788309654.785706:0:22746:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1788309654.789668:0:22746:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788309654.789682:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788309654.789713:0:22746:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788309654.789730:0:22746:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x98c38120c44af487 00000100:00080000:0.0:1788309654.789739:0:22746:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788309654.789744:0:22746:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c2fc4270000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:0.0:1788309654.789776:0:22746:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c2fc414f100 x1875178048149888/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788309654.789801:0:22746:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1788309654.789926:0:22746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788309654.789931:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309654.789932:0:22746:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788309654.789935:0:22746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788309654.789937:0:22746:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1788309654.789939:0:22746:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788309654.789940:0:22746:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788309654.789942:0:22746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788309654.789944:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309654.789946:0:22746:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788309654.789948:0:22746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788309654.789960:0:22746:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788309654.789964:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309654.789965:0:22746:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788309654.789969:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788309654.789983:0:22746:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.132@tcp to nid 0x20000c0a8ce84 (192.168.206.132@tcp) 00000020:01000000:0.0:1788309654.790008:0:22746:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788309654.790010:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788309654.790021:0:22746:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8c30c7a18000) 00000020:00000080:0.0:1788309654.790031:0:22746:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788309654.790035:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788309654.790097:0:22746:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788309654.790104:0:22746:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788309654.790109:0:22746:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x98c38120c44af495 00000100:00100000:1.0:1788309654.790246:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048149888:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788309654.790308:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788309654.790394:0:22746:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c31011f6800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.132@tcp at head 00010000:00010000:0.0:1788309654.790585:0:22746:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788309654.791592:0:22746:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788309654.791811:0:22746:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788309654.793871:0:22746:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788309654.794079:0:22746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00100000:3.0:1788309654.796243:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048149888 00000100:00100000:3.0:1788309654.796255:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048149888 00000100:00100000:3.0:1788309654.796287:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788309654.796295:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1875178048149888:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788309654.796313:0:22732:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:00080000:1.0:1788309654.801753:0:22746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1788309654.807086:0:22752:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788309654.807102:0:22752:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1788309654.811581:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1875178048149888:12345-0@lo:38:llog_process_th.0 Request processed in 15280us (21267us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788309654.811606:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788309654.811657:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c2fc4270000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788309654.811662:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788309654.811666:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048149888:0@lo:38:llog_process_th.0 00000020:00000080:1.0:1788309654.812702:0:22746:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788309654.812717:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788309654.812755:0:22746:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788309654.812785:0:22746:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x98c38120c44af49c 00000100:00080000:1.0:1788309654.812793:0:22746:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788309654.812798:0:22746:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c31011f6800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:1.0:1788309654.812827:0:22746:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30fba9d880 x1875178048150016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788309654.812872:0:22746:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1788309654.813338:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048150016:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788309654.813381:0:3616:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875178048150016 offset 0 length 520: 4 00000020:01000000:1.0:1788309654.813466:0:22746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788309654.813471:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309654.813473:0:22746:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788309654.813476:0:22746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788309654.813479:0:22746:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1788309654.813480:0:22746:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788309654.813482:0:22746:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788309654.813483:0:22746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788309654.813485:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309654.813487:0:22746:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788309654.813490:0:22746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788309654.813493:0:22746:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788309654.813496:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309654.813497:0:22746:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788309654.813508:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788309654.813512:0:22746:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.132@tcp to nid 0x20000c0a8ce84 (192.168.206.132@tcp) 00000020:01000000:1.0:1788309654.813533:0:22746:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788309654.813535:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788309654.813547:0:22746:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8c2fc23b8000) 00000020:00000080:1.0:1788309654.813560:0:22746:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788309654.813565:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788309654.813628:0:22746:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788309654.813634:0:22746:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788309654.813640:0:22746:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x98c38120c44af4aa 00010000:00080000:1.0:1788309654.813667:0:22746:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c30f9a1b800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.132@tcp at head 00010000:00010000:1.0:1788309654.814264:0:22746:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788309654.814335:0:22746:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788309654.814348:0:22746:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788309654.816358:0:22746:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788309654.816615:0:22746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788309654.816728:0:22746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1788309654.817746:0:22754:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788309654.817756:0:22754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788309654.818712:0:22746:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788309654.818723:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788309654.818755:0:22746:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788309654.818774:0:22746:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x98c38120c44af4b1 00000100:00080000:1.0:1788309654.818968:0:22746:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788309654.818984:0:22746:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c30f9a1b800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:1.0:1788309654.819243:0:22746:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30fba9fb80 x1875178048150144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788309654.819311:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048150144:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788309654.819365:0:3616:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875178048150144 offset 0 length 520: 4 00000100:00080000:1.0:1788309654.819420:0:22746:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788309654.819480:0:22746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788309654.819484:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309654.819486:0:22746:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788309654.819489:0:22746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788309654.819502:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309654.819503:0:22746:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788309654.819507:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788309654.819509:0:22746:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788309654.819511:0:22746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788309654.819514:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309654.819515:0:22746:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788309654.819517:0:22746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788309654.819520:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309654.819521:0:22746:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788309654.819524:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788309654.819551:0:22746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22746:1875178048150272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788309654.819599:0:22746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309654.819633:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048150272 00000100:00100000:1.0:1788309654.819639:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048150272 00000100:00100000:1.0:1788309654.819672:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788309654.819680:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f6138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+9:22746:x1875178048150272:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788309654.819790:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f6138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+9:22746:x1875178048150272:12345-0@lo:502:llog_process_th.0 Request processed in 110us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309654.819798:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788309654.819832:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c5726a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788309654.819873:0:22746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22746:1875178048150272:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788309654.819894:0:22746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788309654.819898:0:22746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309654.819900:0:22746:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788309654.819903:0:22746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788309654.820086:0:22706:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788309654.820113:0:22706:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788309654.820129:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1513400/0x98c38120c44af425 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af42c expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309654.820148:0:22706:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30c1513400/0x98c38120c44af425 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af42c expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309654.820155:0:22706:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c30c83d6000 from 1 10000000:01000000:0.0:1788309654.820159:0:22706:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788309654.820182:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af4b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309654.820190:0:22706:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af4b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309654.820206:0:22706:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af4b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309654.820219:0:22706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048150400:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788309654.820247:0:22706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309654.820266:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c42dbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788309654.820387:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048150400 00000100:00100000:2.0:1788309654.820392:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048150400 00000100:00100000:2.0:1788309654.820426:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788309654.820433:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f6139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+9:22706:x1875178048150400:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788309654.820442:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309654.820455:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30edf5bc00/0x98c38120c44af4bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af4b8 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309654.820473:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30edf5bc00/0x98c38120c44af4bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af4b8 expref: 10 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309654.820483:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30edf5bc00/0x98c38120c44af4bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af4b8 expref: 10 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309654.820491:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30edf5bc00, rc 0) 00000100:00100000:2.0:1788309654.820519:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f6139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+10:22706:x1875178048150400:12345-0@lo:101:mount.lustre.0 Request processed in 86us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309654.820525:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788309654.820587:0:22706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048150400:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788309654.820599:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af4b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af4bf expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309654.820608:0:22706:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af4b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af4bf expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309654.821457:0:22706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048150528:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788309654.821495:0:22706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309654.821528:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c42dbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788309654.821734:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048150528 00000100:00100000:1.0:1788309654.821739:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048150528 00000100:00100000:1.0:1788309654.821774:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788309654.821781:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f6139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+10:22706:x1875178048150528:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788309654.821801:0:22719:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788309654.821806:0:22719:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788309654.821898:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f6139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+10:22706:x1875178048150528:12345-0@lo:256:mount.lustre.0 Request processed in 116us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309654.821905:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788309654.822293:0:22706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048150528:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788309654.823016:0:22706:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788309654.823069:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af4b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af4bf expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309654.823081:0:22706:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af4b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af4bf expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309654.823096:0:22706:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c30c83d6000 from 1 10000000:01000000:0.0:1788309654.823099:0:22706:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788309654.823147:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1513c00/0x98c38120c44af4c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309654.823155:0:22706:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c30c1513c00/0x98c38120c44af4c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309654.823163:0:22706:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c30c1513c00/0x98c38120c44af4c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309654.823180:0:22706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048150656:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788309654.823217:0:22706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309654.823246:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c42dbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788309654.823359:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048150656 00000100:00100000:1.0:1788309654.823365:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048150656 00000100:00100000:1.0:1788309654.823404:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788309654.823412:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f6138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+10:22706:x1875178048150656:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788309654.823421:0:22720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309654.823433:0:22720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c2fc35f1200/0x98c38120c44af4cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af4c6 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309654.823453:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c2fc35f1200/0x98c38120c44af4cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af4c6 expref: 11 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309654.823462:0:22720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c2fc35f1200/0x98c38120c44af4cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af4c6 expref: 11 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309654.823471:0:22720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c2fc35f1200, rc 0) 00000100:00100000:1.0:1788309654.823501:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f6138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+11:22706:x1875178048150656:12345-0@lo:101:mount.lustre.0 Request processed in 90us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309654.823507:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788309654.823761:0:22706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048150656:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788309654.823785:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c30c1513c00/0x98c38120c44af4c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af4cd expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309654.823794:0:22706:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c30c1513c00/0x98c38120c44af4c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af4cd expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309654.823869:0:22706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048150784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788309654.823894:0:22706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309654.823916:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c42dbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788309654.824485:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048150784 00000100:00100000:3.0:1788309654.824491:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048150784 00000100:00100000:3.0:1788309654.824584:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788309654.824592:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f6138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+11:22706:x1875178048150784:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788309654.824719:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f6138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+11:22706:x1875178048150784:12345-0@lo:501:mount.lustre.0 Request processed in 128us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309654.824726:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788309654.824792:0:22706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048150784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788309654.824819:0:22706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048150912:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788309654.824898:0:22706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309654.825116:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c42dbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788309654.825367:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048150912 00000100:00100000:1.0:1788309654.825371:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048150912 00000100:00100000:1.0:1788309654.825394:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788309654.825400:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f613ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+11:22706:x1875178048150912:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788309654.825488:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f613ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+11:22706:x1875178048150912:12345-0@lo:503:mount.lustre.0 Request processed in 87us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309654.825501:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788309654.825590:0:22706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048150912:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788309654.826303:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22756:1875178048151040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788309654.826344:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309654.826375:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c42dbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788309654.826420:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048151040 00000100:00100000:1.0:1788309654.826425:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048151040 00000100:00100000:1.0:1788309654.826455:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788309654.826462:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f613b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+11:22756:x1875178048151040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788309654.826944:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f613b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+11:22756:x1875178048151040:12345-0@lo:502:llog_process_th.0 Request processed in 482us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309654.826952:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788309654.827045:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22756:1875178048151040:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788309654.827281:0:22756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788309654.827290:0:22756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309654.827292:0:22756:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788309654.827297:0:22756:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c30c83d6000 00000020:00000080:0.0:1788309654.827300:0:22756:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788309654.827306:0:22756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788309654.827309:0:22756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309654.827310:0:22756:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788309654.827313:0:22756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788309654.827315:0:22756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309654.827316:0:22756:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788309654.827319:0:22756:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c30c83d6000 00000020:00000080:0.0:1788309654.827321:0:22756:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788309654.827374:0:22756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788309654.827377:0:22756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309654.827379:0:22756:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788309654.827381:0:22756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788309654.827383:0:22756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309654.827384:0:22756:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788309654.827387:0:22756:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c30c83d6000 00000020:00000080:0.0:1788309654.827389:0:22756:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788309654.827403:0:22756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788309654.827406:0:22756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309654.827407:0:22756:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788309654.827409:0:22756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788309654.827411:0:22756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309654.827412:0:22756:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788309654.827422:0:22756:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c30c83d6000 00000020:00000080:0.0:1788309654.827424:0:22756:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788309654.827458:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22756:1875178048151168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788309654.827492:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309654.827524:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c42dbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788309654.828901:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048151168 00000100:00100000:1.0:1788309654.828910:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048151168 00000100:00100000:1.0:1788309654.828949:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788309654.828958:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f613b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+11:22756:x1875178048151168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788309654.829306:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f613b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+11:22756:x1875178048151168:12345-0@lo:502:llog_process_th.0 Request processed in 348us (1812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309654.829314:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788309654.829424:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22756:1875178048151168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788309654.829452:0:22756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788309654.829458:0:22756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309654.829460:0:22756:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788309654.829463:0:22756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788309654.829878:0:22706:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788309654.829898:0:22706:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788309654.829914:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1513c00/0x98c38120c44af4c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af4cd expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309654.829925:0:22706:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30c1513c00/0x98c38120c44af4c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af4cd expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309654.829969:0:22706:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788309654.829981:0:22706:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c30c83d6000 10000000:01000000:1.0:1788309654.829984:0:22706:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c30c83d6000 10000000:01000000:1.0:1788309654.829988:0:22706:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788309654.830000:0:22706:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c30c83d6000 from 1 10000000:01000000:1.0:1788309654.830003:0:22706:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788309654.830930:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0a00/0x98c38120c44af4d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309654.830942:0:22706:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0a00/0x98c38120c44af4d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309654.830951:0:22706:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0a00/0x98c38120c44af4d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309654.830969:0:22706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048151296:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788309654.831223:0:22706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309654.831255:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c5726240 going to sleep for 11 seconds 00000100:00100000:1.0:1788309654.831283:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048151296 00000100:00100000:1.0:1788309654.831288:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048151296 00000100:00100000:1.0:1788309654.831317:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788309654.831324:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+11:22706:x1875178048151296:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788309654.831333:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309654.831343:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c2fc35f0e00/0x98c38120c44af4db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af4d4 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309654.831360:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c2fc35f0e00/0x98c38120c44af4db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af4d4 expref: 12 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309654.831370:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c2fc35f0e00/0x98c38120c44af4db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af4d4 expref: 12 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309654.831378:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c2fc35f0e00, rc 0) 00000100:00100000:1.0:1788309654.831405:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:22706:x1875178048151296:12345-0@lo:101:mount.lustre.0 Request processed in 82us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309654.831417:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788309654.831454:0:22706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048151296:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788309654.831466:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0a00/0x98c38120c44af4d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af4db expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309654.831474:0:22706:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0a00/0x98c38120c44af4d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af4db expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309654.831517:0:22706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048151424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788309654.831537:0:22706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309654.831548:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c5726240 going to sleep for 11 seconds 00000100:00100000:1.0:1788309654.831559:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048151424 00000100:00100000:1.0:1788309654.831561:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048151424 00000100:00100000:1.0:1788309654.831577:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788309654.831582:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:22706:x1875178048151424:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788309654.831667:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:22706:x1875178048151424:12345-0@lo:501:mount.lustre.0 Request processed in 85us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309654.831674:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788309654.831699:0:22706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048151424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788309654.831721:0:22706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048151552:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788309654.831751:0:22706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309654.831761:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c5726240 going to sleep for 11 seconds 00000100:00100000:2.0:1788309654.832953:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048151552 00000100:00100000:2.0:1788309654.832961:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048151552 00000100:00100000:2.0:1788309654.833019:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788309654.833027:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:22706:x1875178048151552:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788309654.834276:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:22706:x1875178048151552:12345-0@lo:503:mount.lustre.0 Request processed in 1247us (2521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309654.834285:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788309654.834616:0:22706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048151552:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788309654.835559:0:22758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22758:1875178048151680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788309654.835618:0:22758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309654.835654:0:22758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c5726900 going to sleep for 11 seconds 00000100:00100000:2.0:1788309654.836255:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048151680 00000100:00100000:2.0:1788309654.836262:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048151680 00000100:00100000:2.0:1788309654.836304:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788309654.836313:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:22758:x1875178048151680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788309654.836418:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:22758:x1875178048151680:12345-0@lo:502:llog_process_th.0 Request processed in 105us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309654.836425:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788309654.837276:0:22758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22758:1875178048151680:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788309654.837336:0:22758:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788309654.837351:0:22758:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8c2fc23bcd28) 00000020:00000080:1.0:1788309654.837370:0:22758:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1788309654.837459:0:22758:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c30c83d6000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788309654.837463:0:22758:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c30c83d6000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788309654.837466:0:22758:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c30c83d6000 4 00010000:00080000:1.0:1788309654.837491:0:22758:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c30f58ae000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.132@tcp at head 00010000:00010000:1.0:1788309654.848386:0:22758:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1788309654.848567:0:22758:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788309654.848606:0:22758:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788309654.848619:0:22758:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x98c38120c44af4e9 00000100:00080000:1.0:1788309654.848629:0:22758:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788309654.848634:0:22758:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c30f58ae000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:1.0:1788309654.848665:0:22758:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30fba9c380 x1875178048151808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788309654.853035:0:22758:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788309654.857831:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875178048151808:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788309654.857933:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309654.858292:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048151808 00000100:00100000:3.0:1788309654.858299:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048151808 00000100:00100000:3.0:1788309654.858333:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788309654.858341:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1875178048151808:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788309654.858881:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1875178048151808:12345-0@lo:38:llog_process_th.0 Request processed in 538us (946us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788309654.858889:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788309654.861394:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788309654.861408:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30f58ae000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788309654.861414:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788309654.861419:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875178048151808:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788309654.865868:0:22758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22758:1875178048151936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788309654.865944:0:22758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309654.865992:0:22758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c5726180 going to sleep for 11 seconds 00000100:00100000:1.0:1788309654.866198:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048151936 00000100:00100000:1.0:1788309654.866205:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048151936 00000100:00100000:1.0:1788309654.866247:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788309654.866256:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:22758:x1875178048151936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788309654.866367:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:22758:x1875178048151936:12345-0@lo:502:llog_process_th.0 Request processed in 111us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309654.866381:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788309654.866427:0:22758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22758:1875178048151936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788309654.866473:0:22758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22758:1875178048152064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788309654.866505:0:22758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309654.866519:0:22758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c5726180 going to sleep for 11 seconds 00000100:00100000:1.0:1788309654.866531:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048152064 00000100:00100000:1.0:1788309654.866534:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048152064 00000100:00100000:1.0:1788309654.866555:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788309654.866561:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:22758:x1875178048152064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788309654.866621:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:22758:x1875178048152064:12345-0@lo:502:llog_process_th.0 Request processed in 60us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309654.866627:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788309654.866659:0:22758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22758:1875178048152064:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788309654.866677:0:22758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788309654.867274:0:22706:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788309654.867298:0:22706:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788309654.867318:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0a00/0x98c38120c44af4d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af4db expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309654.867329:0:22706:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0a00/0x98c38120c44af4d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af4db expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788309654.867377:0:22706:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788309654.867379:0:22706:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788309654.867381:0:22706:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788309654.867382:0:22706:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788309654.867383:0:22706:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788309654.867384:0:22706:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788309654.867386:0:22706:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788309654.867387:0:22706:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788309654.867389:0:22706:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788309654.867390:0:22706:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788309654.867394:0:22706:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788309654.867396:0:22706:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788309654.867397:0:22706:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788309654.867399:0:22706:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788309654.867404:0:22706:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788309654.867405:0:22706:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788309654.867406:0:22706:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788309654.867407:0:22706:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788309654.867408:0:22706:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788309654.867409:0:22706:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788309654.867409:0:22706:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788309654.867424:0:22706:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788309654.867435:0:22706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048152192:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788309654.867474:0:22706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309654.871409:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048152192 00000100:00100000:1.0:1788309654.871421:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048152192 00000100:00100000:1.0:1788309654.871466:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788309654.871475:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:22706:x1875178048152192:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788309654.871503:0:22722:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788309654.871516:0:22722:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788309654.873931:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc29966c0 going to sleep for 11 seconds 20000000:01000000:1.0:1788309654.874566:0:22722:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788309654.874619:0:22722:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788309654.874859:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:22706:x1875178048152192:12345-0@lo:253:mount.lustre.0 Request processed in 3364us (7362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309654.874869:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788309654.874939:0:22706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22706:1875178048152192:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788309654.874950:0:22706:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788309654.874953:0:22706:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788309654.874955:0:22706:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788309654.874956:0:22706:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788309654.874957:0:22706:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788309654.874958:0:22706:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788309654.874960:0:22706:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788309654.874961:0:22706:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788309654.874962:0:22706:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788309654.874964:0:22706:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788309654.874965:0:22706:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788309654.874990:0:22706:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788309654.880937:0:22744:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788309654.880947:0:22744:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788309654.880966:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44af4f0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309654.880992:0:22744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c30edf5bc00/0x98c38120c44af4bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af4b8 expref: 11 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309654.881001:0:22744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44af4f0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309654.881049:0:22744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c30edf5bc00/0x98c38120c44af4bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x98c38120c44af4b8 expref: 11 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309654.881071:0:22744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c30edf5bc00/0x98c38120c44af4bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x98c38120c44af4b8 expref: 11 pid: 22722 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309654.881085:0:22744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22744:1875178048152320:0@lo:104: 00000100:00100000:2.0:1788309654.881151:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309654.881196:0:22744:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2996600 going to sleep for 11 seconds 00000100:00100000:3.0:1788309654.881325:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048152320 00000100:00100000:3.0:1788309654.881332:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048152320 00000100:00100000:3.0:1788309654.881373:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788309654.881383:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d3b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+3:22744:x1875178048152320:12345-0@lo:104: 00010000:00010000:3.0:1788309654.881394:0:22710:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af4b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af4bf expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309654.881448:0:22710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788309654.881455:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d3b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+3:22744:x1875178048152320:12345-0@lo:104: Request processed in 74us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309654.881462:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788309654.881484:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309654.881490:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af4b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af4bf expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309654.881498:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30c1513600 already unused, calling callback (ffffffffc1507c20) 10000000:00010000:3.0:1788309654.881501:0:22716:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af4b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x98c38120c44af4bf expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309654.881509:0:22716:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af4b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x98c38120c44af4bf expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788309654.881515:0:22716:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af4b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x98c38120c44af4bf expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309654.881521:0:22716:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788309654.881549:0:22716:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af4b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af4bf expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309654.881555:0:22716:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788309654.881581:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af4b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af4bf expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309654.881588:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af4b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af4bf expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309654.881603:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309654.881605:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309654.881606:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309654.881639:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3619:1875178048152448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788309654.881667:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309654.881709:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048152448 00000100:00100000:3.0:1788309654.881712:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048152448 00010000:00010000:3.0:1788309654.881727:0:22712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c30edf5bc00/0x98c38120c44af4bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af4b8 expref: 12 pid: 22722 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309654.881747:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788309654.881753:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:3619:x1875178048152448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788309654.881762:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309654.881767:0:22712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c30edf5bc00/0x98c38120c44af4bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af4b8 expref: 12 pid: 22722 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309654.881890:0:22744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22744:1875178048152320:0@lo:104: 00010000:00010000:2.0:1788309654.881907:0:22744:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44af4f0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309654.882101:0:22712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c30edf5bc00/0x98c38120c44af4bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x98c38120c44af4b8 expref: 12 pid: 22722 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309654.882114:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30edf5bc00/0x98c38120c44af4bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x98c38120c44af4b8 expref: 12 pid: 22722 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309654.882125:0:22712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44af4f0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309654.882142:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44af4f0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788309654.882154:0:22712:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001208149s 00010000:00010000:3.0:1788309654.882158:0:22712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44af4f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309654.882165:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44af4f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309654.882171:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44af4f0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309654.882177:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44af4f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309654.882183:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30edf5ae00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:3.0:1788309654.882186:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44af4f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309654.882193:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44af4f0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309654.882211:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44af4f0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309654.882220:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309654.882252:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+11:3619:x1875178048152448:12345-0@lo:103:ldlm_bl.0 Request processed in 498us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309654.882259:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788309654.882295:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3619:1875178048152448:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788309654.882505:0:22744:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44af4f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309654.882513:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44af4f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309654.882519:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44af4f0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788309654.894118:0:22706:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:1.0:1788309654.894277:0:22706:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788309654.894359:0:22767:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:1.0:1788309654.894363:0:22767:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:3.0:1788309654.899613:0:22768:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788309654.899703:0:22706:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:2.0:1788309654.900126:0:22770:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8c30d3b05500 x1875178048152576/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309654.900138:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2996cc0 going to sleep for 0 seconds 00000040:01000000:1.0:1788309654.900499:0:22706:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788309654.900542:0:22706:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788309654.901050:0:22706:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788309654.901057:0:22706:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788309654.901091:0:22706:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788309654.902069:0:22706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788309654.902587:0:22706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788309654.902616:0:22706:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788309654.905414:0:22706:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1788309654.907896:0:22706:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:1.0:1788309654.914748:0:22706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:00080000:3.0:1788309654.917616:0:22768:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1788309654.921299:0:22706:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788309654.921336:0:22706:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa2ea01c7b988 00100000:10000000:2.0:1788309654.921343:0:22706:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788309654.922711:0:22706:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788309654.922727:0:22706:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.132@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788309654.922744:0:22706:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1788309654.922762:0:22706:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000040:00080000:3.0:1788309654.925686:0:22768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788309654.925745:0:22768:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000020:00000004:3.0:1788309654.932421:0:22706:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788309654.932645:0:22706:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788309655.532532:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788309655.788248:0:22724:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788309655.788255:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c30c83d6000 from 11 10000000:01000000:0.0:1788309655.788260:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788309655.788304:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af4f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309655.788315:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af4f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309655.788327:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af4f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309655.788348:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048152704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788309655.788404:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309655.788450:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c4f779c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788309655.790883:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048152704 00000100:00100000:3.0:1788309655.790895:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048152704 00000100:00100000:3.0:1788309655.791034:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788309655.791043:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+11:22724:x1875178048152704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309655.791059:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309655.791077:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30c83db800/0x98c38120c44af4fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af4f7 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309655.791101:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30c83db800/0x98c38120c44af4fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af4f7 expref: 12 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309655.791111:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30c83db800/0x98c38120c44af4fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af4f7 expref: 12 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309655.791120:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30c83db800, rc 0) 00000100:00100000:3.0:1788309655.791189:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:22724:x1875178048152704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (2784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309655.791195:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788309655.791256:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048152704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309655.791272:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af4f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af4fe expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309655.791305:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af4f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af4fe expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309655.791365:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048152832:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788309655.791399:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309655.791424:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30e1130180 going to sleep for 11 seconds 00000100:00100000:1.0:1788309655.791526:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048152832 00000100:00100000:1.0:1788309655.791531:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048152832 00000100:00100000:1.0:1788309655.791560:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788309655.791566:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:22724:x1875178048152832:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788309655.791578:0:22720:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788309655.791591:0:22720:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788309655.791594:0:22720:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1788309655.791663:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:22724:x1875178048152832:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 97us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309655.791670:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788309655.791738:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048152832:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788309655.791774:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788309655.791781:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af4f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af4fe expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309655.791789:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af4f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af4fe expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309655.915603:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2996cc0 going to sleep for 0 seconds 00000040:00080000:2.0:1788309655.923502:0:22764:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788309655.923511:0:22764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788309655.928421:0:22764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788309655.928434:0:22764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788309656.554939:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788309656.942815:0:22764:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788309656.942823:0:22764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788309656.942979:0:22764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:2.0:1788309656.943018:0:22764:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788309656.943147:0:22764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:0.0:1788309656.944646:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2996cc0 going to sleep for 0 seconds 00010000:00010000:0.0:1788309657.580768:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309657.962122:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2996cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1788309658.606723:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788309658.662780:0:23012:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg632-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788309658.986023:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2996cc0 going to sleep for 0 seconds 00000020:00000004:1.0:1788309659.536212:0:23064:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788309659.536429:0:23064:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788309659.627208:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309660.010059:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2996cc0 going to sleep for 0 seconds 00000100:00080000:3.0:1788309660.269299:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788309660.269305:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788309660.269310:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c2fc4270000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788309660.269317:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 564 00000100:00080000:3.0:1788309660.269322:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788309660.269328:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c2fc4270000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:3.0:1788309660.269365:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30fbbf2300 x1875178048153088/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788309660.269382:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:3.0:1788309660.269386:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788309660.269391:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788309660.269393:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788309660.269396:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788309660.269399:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:2.0:1788309660.269403:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3619:1875178048152960:0@lo:400:kworker.0 00000100:00080000:3.0:1788309660.269404:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788309660.269408:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c30f58ae000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788309660.269415:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c30f58ae000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:3.0:1788309660.269428:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30fbbf3480 x1875178048153216/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788309660.269455:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048153088:0@lo:38:kworker.0 00000100:00100000:2.0:1788309660.269497:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309660.269527:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309660.269554:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875178048153216:0@lo:38:kworker.0 00000100:00100000:3.0:1788309660.269581:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309660.269683:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048152960 00000100:00100000:1.0:1788309660.269690:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048152960 00000100:00100000:1.0:1788309660.269733:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788309660.269743:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:3619:x1875178048152960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309660.269788:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048153088 00000100:00100000:0.0:1788309660.269793:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048153088 00000100:00100000:1.0:1788309660.269811:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:3619:x1875178048152960:12345-0@lo:400:kworker.0 Request processed in 68us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309660.269818:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788309660.269822:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788309660.269859:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1875178048153088:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788309660.269875:0:22733:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788309660.269888:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3619:1875178048152960:0@lo:400:kworker.0 00000100:00100000:0.0:1788309660.269928:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1875178048153088:12345-0@lo:38:kworker.0 Request processed in 101us (400us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788309660.269936:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788309660.269940:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c2fc4270000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788309660.269956:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788309660.269959:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048153088:0@lo:38:kworker.0 00000100:00100000:2.0:1788309660.270034:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048153216 00000100:00100000:2.0:1788309660.270038:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048153216 00000100:00100000:2.0:1788309660.270069:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788309660.270074:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1875178048153216:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788309660.270100:0:22729:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 570 last 0 00000020:00000080:2.0:1788309660.270142:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x98c38120c44af505 00000004:00100000:2.0:1788309660.270155:0:22729:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788309660.270281:0:22729:0:(import.c:65:import_set_state_nolock()) ffff8c3101bc1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788309660.270330:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875178048153216:12345-0@lo:38:kworker.0 Request processed in 254us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309660.270336:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788309660.270735:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c30fbbf3480 x1875178048153216/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788309670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788309660.270749:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788309660.270757:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788309660.270762:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788309660.270765:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30f58ae000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788309660.270770:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875178048153216:0@lo:38:kworker.0 00000020:00000004:0.0:1788309660.426058:0:23114:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788309660.426263:0:23114:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788309660.651066:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309661.034502:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2996cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1788309661.674903:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309662.059333:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2996cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1788309662.701557:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309663.082941:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2996cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1788309663.723264:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309664.105961:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2996cc0 going to sleep for 0 seconds 00000100:00100000:0.0:1788309664.362036:0:3616:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788309654/real 1788309654] req@ffff8c30fba9fb80 x1875178048150144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788309664 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309664.362065:0:3616:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c30fba9fb80 x1875178048150144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788309664 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309664.362074:0:3616:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788309654/real 1788309654] req@ffff8c30fba9d880 x1875178048150016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788309664 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309664.362085:0:3616:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c30fba9d880 x1875178048150016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788309664 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788309664.362117:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30f9a1b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788309664.362143:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788309664.362148:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048150144:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788309664.362154:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c31011f6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788309664.362160:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788309664.362162:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048150016:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788309664.362288:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788309664.362299:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788309664.362302:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c2fc4270000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788309664.362307:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 570 00000100:00080000:1.0:1788309664.362312:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788309664.362319:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c2fc4270000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:1.0:1788309664.362340:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30fba9d880 x1875178048153472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788309664.362354:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788309664.362357:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788309664.362359:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c31011f6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788309664.362372:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 564 00000100:00080000:1.0:1788309664.362374:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788309664.362377:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c31011f6800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:1.0:1788309664.362388:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30fba9fb80 x1875178048153600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788309664.362397:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788309664.362400:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788309664.362401:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c30f9a1b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788309664.362404:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 564 00000100:00080000:1.0:1788309664.362407:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788309664.362409:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c30f9a1b800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:1.0:1788309664.362418:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30fba9c380 x1875178048153728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788309664.362539:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875178048153856:0@lo:400:kworker.0 00000100:00100000:2.0:1788309664.362594:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309664.362651:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788309664.362659:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3618:1875178048153344:0@lo:400:kworker.0 00000100:00100000:1.0:1788309664.362757:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048153856 00000100:00100000:1.0:1788309664.362764:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048153856 00000100:00100000:1.0:1788309664.362833:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788309664.362887:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d3b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875178048153856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309664.364634:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048153472:0@lo:38:kworker.0 00000100:00100000:1.0:1788309664.365634:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d3b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875178048153856:12345-0@lo:400:kworker.0 Request processed in 2745us (3037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309664.365646:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788309664.368082:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788309664.368158:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c30fba9e680 x1875178048153856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309664.368174:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875178048153856:0@lo:400:kworker.0 00000100:00100000:3.0:1788309664.368204:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048153344 00000100:00100000:3.0:1788309664.368210:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048153344 00000100:00100000:3.0:1788309664.368255:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788309664.368264:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:3618:x1875178048153344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309664.368328:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:3618:x1875178048153344:12345-0@lo:400:kworker.0 Request processed in 65us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309664.368335:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788309664.368342:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3618:1875178048153344:0@lo:400:kworker.0 00000100:00100000:0.0:1788309664.369094:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309664.369132:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048153600:0@lo:8:kworker.0 00000100:00100000:1.0:1788309664.369149:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048153472 00000100:00100000:1.0:1788309664.369156:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048153472 00000400:00000100:0.0:1788309664.369164:0:3616:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875178048153600 offset 0 length 520: 4 00000100:00100000:0.0:1788309664.369190:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048153728:0@lo:8:kworker.0 00000100:00100000:1.0:1788309664.369198:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788309664.369205:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1875178048153472:12345-0@lo:38:kworker.0 00000400:00000100:0.0:1788309664.369213:0:3616:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875178048153728 offset 0 length 520: 4 00010000:00020000:1.0:1788309664.369222:0:22733:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788309664.369276:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1875178048153472:12345-0@lo:38:kworker.0 Request processed in 70us (184us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788309664.369283:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788309664.376522:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c2fc4270000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788309664.376533:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788309664.376538:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048153472:0@lo:38:kworker.0 00010000:00010000:2.0:1788309664.748376:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309665.130649:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2996cc0 going to sleep for 0 seconds 00010000:00010000:0.0:1788309665.773341:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309666.156435:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2996cc0 going to sleep for 0 seconds 00000040:00080000:3.0:1788309666.156994:0:22764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1788309666.575312:0:23459:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788309666.575316:0:23459:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788309666.575317:0:23459:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788309666.575479:0:23459:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c2fc33d3000 00000020:01000004:0.0:1788309666.575495:0:23459:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788309666.575506:0:23459:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788309666.575519:0:23459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8c30c7a199b8) 00000020:00000080:0.0:1788309666.575545:0:23459:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788309666.648050:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788309666.648396:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788309666.650543:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788309666.651081:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788309666.651333:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788309666.651630:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788309666.652374:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788309666.652783:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788309666.653190:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788309666.653385:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788309666.653710:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788309666.654218:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788309666.654392:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788309666.654642:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788309666.655060:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788309666.655362:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788309666.655658:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788309666.656091:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788309666.656301:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788309666.656538:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788309666.658250:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788309666.658714:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788309666.658944:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788309666.659232:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788309666.659804:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788309666.660600:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788309666.661046:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788309666.661437:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788309666.661616:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788309666.661934:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788309666.662159:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788309666.662478:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788309666.662824:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788309666.663182:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788309666.665997:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788309666.666429:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788309666.666611:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788309666.667088:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788309666.667819:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788309666.668347:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788309666.669105:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788309666.669347:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788309666.669973:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788309666.670234:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788309666.671006:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788309666.671754:0:23459:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:2.0:1788309666.673154:0:23459:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788309666.673379:0:23459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788309666.673391:0:23459:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788309666.673416:0:23459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x98c38120c44af513 00000020:01000004:2.0:1788309666.673423:0:23459:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788309666.673441:0:23459:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.132@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788309666.673444:0:23459:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788309666.673449:0:23459:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788309666.673474:0:23459:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788309666.673478:0:23459:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.132@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788309666.678659:0:23459:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.132@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788309666.678753:0:23459:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.132@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1788309666.678757:0:23459:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788309666.678759:0:23459:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788309666.678760:0:23459:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788309666.678761:0:23459:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788309666.678762:0:23459:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788309666.678764:0:23459:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788309666.678765:0:23459:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788309666.678767:0:23459:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788309666.678768:0:23459:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788309666.678771:0:23459:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1788309666.678773:0:23459:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788309666.678774:0:23459:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788309666.678775:0:23459:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788309666.678776:0:23459:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788309666.678777:0:23459:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788309666.678778:0:23459:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788309666.678779:0:23459:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788309666.678781:0:23459:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788309666.678781:0:23459:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788309666.678806:0:23459:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788309666.678970:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048153984:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788309666.679036:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309666.679140:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c7c53780 going to sleep for 11 seconds 00000100:00100000:3.0:1788309666.679259:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048153984 00000100:00100000:3.0:1788309666.679266:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048153984 00000100:00100000:3.0:1788309666.679346:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788309666.679355:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:23459:x1875178048153984:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788309666.679383:0:22722:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788309666.679385:0:22722:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1788309666.679391:0:22722:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788309666.679871:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:23459:x1875178048153984:12345-0@lo:253:mount.lustre.0 Request processed in 484us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309666.679881:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788309666.679974:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048153984:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788309666.679985:0:23459:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788309666.679987:0:23459:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788309666.679997:0:23459:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788309666.679998:0:23459:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788309666.679999:0:23459:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788309666.680001:0:23459:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788309666.680002:0:23459:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788309666.680003:0:23459:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788309666.680005:0:23459:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788309666.680006:0:23459:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788309666.680022:0:23459:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c2fc33d3000 from lustre-MDT0001 10000000:01000000:2.0:1788309666.680048:0:23459:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788309666.680051:0:23459:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788309666.680057:0:23459:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c2fc23bb370 local copy 00010000:00010000:2.0:1788309666.680076:0:23459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1512200/0x98c38120c44af409 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af410 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309666.680158:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048154112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788309666.680188:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309666.681207:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30e1130e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788309666.681347:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048154112 00000100:00100000:0.0:1788309666.681365:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048154112 00000100:00100000:0.0:1788309666.681488:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788309666.681507:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:23459:x1875178048154112:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788309666.681655:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:23459:x1875178048154112:12345-0@lo:501:mount.lustre.0 Request processed in 158us (1465us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788309666.681672:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788309666.682615:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048154112:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788309666.682636:0:23459:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788309666.682778:0:23459:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788309666.682787:0:23459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1512200/0x98c38120c44af409 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af410 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.682798:0:23459:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30c1512200/0x98c38120c44af409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af410 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309666.682950:0:23459:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c2fc33d3000 10000000:01000000:2.0:1788309666.682957:0:23459:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788309666.682963:0:23459:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8c2fc23bb370 10000000:01000000:2.0:1788309666.682966:0:23459:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788309666.682982:0:23459:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8c2fc23bb370 from 1 10000000:01000000:2.0:1788309666.682985:0:23459:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788309666.683015:0:23459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30edf5aa00/0x98c38120c44af51a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.683023:0:23459:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c30edf5aa00/0x98c38120c44af51a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.683032:0:23459:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c30edf5aa00/0x98c38120c44af51a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309666.683048:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048154240:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788309666.683153:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309666.683224:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30e1130e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788309666.683321:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048154240 00000100:00100000:3.0:1788309666.683327:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048154240 00000100:00100000:1.0:1788309666.683394:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788309666.683412:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+12:23459:x1875178048154240:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788309666.683423:0:22720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309666.683435:0:22720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c2fc35f1000/0x98c38120c44af521 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af51a expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.683455:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c2fc35f1000/0x98c38120c44af521 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af51a expref: 13 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.683464:0:22720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c2fc35f1000/0x98c38120c44af521 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af51a expref: 13 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.683473:0:22720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c2fc35f1000, rc 0) 00000100:00100000:1.0:1788309666.683553:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+13:23459:x1875178048154240:12345-0@lo:101:mount.lustre.0 Request processed in 151us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309666.683567:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788309666.683639:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048154240:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788309666.683651:0:23459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c30edf5aa00/0x98c38120c44af51a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af521 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.683659:0:23459:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c30edf5aa00/0x98c38120c44af51a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af521 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309666.683685:0:23459:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788309666.683698:0:23459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30edf5aa00/0x98c38120c44af51a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af521 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.683704:0:23459:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30edf5aa00/0x98c38120c44af51a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af521 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309666.683711:0:23459:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8c2fc33d3000 10000000:01000000:2.0:1788309666.683720:0:23459:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788309666.683723:0:23459:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8c2fc33d3000 from 1 10000000:01000000:2.0:1788309666.683725:0:23459:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788309666.683740:0:23459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30edf5a000/0x98c38120c44af528 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.683747:0:23459:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c30edf5a000/0x98c38120c44af528 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.683754:0:23459:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c30edf5a000/0x98c38120c44af528 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309666.683765:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048154368:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788309666.683789:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309666.684568:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30e1130e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788309666.684746:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048154368 00000100:00100000:0.0:1788309666.684752:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048154368 00000100:00100000:0.0:1788309666.684792:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788309666.684799:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+13:23459:x1875178048154368:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788309666.684809:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309666.684822:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30c1513e00/0x98c38120c44af52f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af528 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309666.688079:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30c1513e00/0x98c38120c44af52f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af528 expref: 14 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309666.688092:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30c1513e00/0x98c38120c44af52f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af528 expref: 14 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309666.688101:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30c1513e00, rc 0) 00000100:00100000:0.0:1788309666.688186:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+14:23459:x1875178048154368:12345-0@lo:101:mount.lustre.0 Request processed in 3385us (4394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309666.688193:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788309666.688281:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048154368:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788309666.688299:0:23459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c30edf5a000/0x98c38120c44af528 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af52f expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.688308:0:23459:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c30edf5a000/0x98c38120c44af528 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af52f expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309666.688325:0:23459:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788309666.688344:0:23459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30edf5a000/0x98c38120c44af528 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af52f expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.688352:0:23459:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30edf5a000/0x98c38120c44af528 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af52f expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309666.688359:0:23459:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788309666.688375:0:23459:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788309666.688380:0:23459:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8c2fc33d3000 10000000:01000000:2.0:1788309666.688382:0:23459:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788309666.688387:0:23459:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788309666.688389:0:23459:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788309666.688478:0:23459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30edf5a200/0x98c38120c44af536 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.688486:0:23459:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c30edf5a200/0x98c38120c44af536 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.688494:0:23459:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c30edf5a200/0x98c38120c44af536 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309666.688511:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048154496:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788309666.688542:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309666.688729:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30e1130e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788309666.688796:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048154496 00000100:00100000:1.0:1788309666.688801:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048154496 00000100:00100000:1.0:1788309666.689007:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788309666.689018:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+14:23459:x1875178048154496:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788309666.689028:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309666.689040:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c2fc35f0400/0x98c38120c44af53d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af536 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.689054:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c2fc35f0400/0x98c38120c44af53d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af536 expref: 15 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.689062:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c2fc35f0400/0x98c38120c44af53d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af536 expref: 15 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.689132:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c2fc35f0400, rc 0) 00000100:00100000:1.0:1788309666.689174:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+15:23459:x1875178048154496:12345-0@lo:101:mount.lustre.0 Request processed in 158us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309666.689179:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788309666.689235:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048154496:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788309666.689246:0:23459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c30edf5a200/0x98c38120c44af536 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af53d expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.689253:0:23459:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c30edf5a200/0x98c38120c44af536 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af53d expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788309666.690865:0:23459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1788309666.692506:0:23459:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788309666.698747:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788309666.698802:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1788309666.698816:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1788309666.699207:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1788309666.699235:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1788309666.699257:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1788309666.699273:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1788309666.699288:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1788309666.699301:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1788309666.699313:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1788309666.699326:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1788309666.699340:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1788309666.699353:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1788309666.699367:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1788309666.699381:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1788309666.699393:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1788309666.699477:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1788309666.699494:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1788309666.699508:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1788309666.699521:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1788309666.699535:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1788309666.699550:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1788309666.699564:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1788309666.699645:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1788309666.699727:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1788309666.699745:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1788309666.699759:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1788309666.699770:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1788309666.699783:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1788309666.699795:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1788309666.699807:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1788309666.699820:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1788309666.699973:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1788309666.699990:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1788309666.700005:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1788309666.700019:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1788309666.700032:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1788309666.700058:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1788309666.701035:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1788309666.701059:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1788309666.701120:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1788309666.701134:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1788309666.701144:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1788309666.701155:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1788309666.701178:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1788309666.701183:0:23459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1788309666.701280:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048154624:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788309666.701334:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309666.701430:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30e1130a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788309666.701518:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048154624 00000100:00100000:1.0:1788309666.701525:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048154624 00000100:00100000:1.0:1788309666.701770:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788309666.701780:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+15:23459:x1875178048154624:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788309666.701995:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+15:23459:x1875178048154624:12345-0@lo:501:mount.lustre.0 Request processed in 216us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309666.702003:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788309666.702090:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048154624:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788309666.702116:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048154752:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788309666.702153:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309666.702505:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30e1130a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788309666.702556:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048154752 00000100:00100000:0.0:1788309666.702560:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048154752 00000100:00100000:0.0:1788309666.702596:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788309666.702604:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+15:23459:x1875178048154752:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788309666.703888:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+15:23459:x1875178048154752:12345-0@lo:503:mount.lustre.0 Request processed in 1281us (1730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309666.703897:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788309666.704081:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048154752:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788309666.704475:0:23459:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788309666.704543:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048154880:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788309666.704598:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309666.704633:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30e1130e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788309666.705028:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048154880 00000100:00100000:1.0:1788309666.705042:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048154880 00000100:00100000:1.0:1788309666.705087:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788309666.705095:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+15:23459:x1875178048154880:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788309666.706097:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+15:23459:x1875178048154880:12345-0@lo:502:mount.lustre.0 Request processed in 1000us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309666.706107:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788309666.706195:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048154880:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788309666.706380:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788309666.706422:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1788309666.706437:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1788309666.706450:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1788309666.706464:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1788309666.706490:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1788309666.706505:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1788309666.706519:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1788309666.706533:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1788309666.706545:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1788309666.706556:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1788309666.706569:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1788309666.706591:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1788309666.706607:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1788309666.706630:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1788309666.706646:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1788309666.706659:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1788309666.706997:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1788309666.707012:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1788309666.707025:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:2.0:1788309666.707039:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1788309666.707052:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1788309666.707064:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1788309666.707076:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1788309666.707091:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1788309666.707105:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1788309666.707118:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1788309666.707130:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1788309666.707144:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1788309666.707158:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1788309666.707171:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1788309666.707185:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1788309666.707198:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1788309666.707211:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1788309666.707223:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1788309666.707235:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1788309666.707248:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1788309666.707260:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1788309666.707285:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1788309666.707297:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1788309666.707309:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1788309666.707320:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1788309666.707332:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1788309666.707344:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1788309666.707380:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048155008:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788309666.707542:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309666.707642:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30e1130e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788309666.708128:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048155008 00000100:00100000:3.0:1788309666.708136:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048155008 00000100:00100000:0.0:1788309666.708979:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788309666.708993:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+15:23459:x1875178048155008:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788309666.709358:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+15:23459:x1875178048155008:12345-0@lo:502:mount.lustre.0 Request processed in 368us (1815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309666.709376:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788309666.709955:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048155008:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788309666.710025:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1788309666.710037:0:23459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1788309666.711028:0:23463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788309666.711038:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309666.711040:0:23463:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788309666.711044:0:23463:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788309666.711047:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788309666.711060:0:23463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8c30f03e8000) 00000020:00000080:2.0:1788309666.711089:0:23463:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1788309666.711096:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788309666.711161:0:23463:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788309666.711167:0:23463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x98c38120c44af54b 00000020:00000080:2.0:1788309666.712036:0:23463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788309666.712042:0:23463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788309666.712046:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309666.712048:0:23463:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788309666.712051:0:23463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788309666.712054:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309666.712055:0:23463:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788309666.712059:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788309666.712129:0:23463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8c3101264d28) 00000020:00000080:2.0:1788309666.712151:0:23463:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1788309666.712156:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788309666.712158:0:23463:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788309666.712161:0:23463:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788309666.712167:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788309666.712218:0:23463:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c2fc33d3000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788309666.712230:0:23463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8c3101263370) 00000020:00000080:2.0:1788309666.712241:0:23463:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1788309666.712292:0:23463:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788309666.712302:0:23463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x98c38120c44af560 00000020:00000080:2.0:1788309666.713231:0:23463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788309666.713241:0:23463:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788309666.713248:0:23463:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x98c38120c44af567 00080000:01000000:2.0:1788309666.713256:0:23463:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788309666.713259:0:23463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x98c38120c44af56e 00010000:00010000:2.0:1788309666.794343:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309666.799381:0:23463:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1788309666.800216:0:23463:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:0.0:1788309666.800468:0:23463:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788309666.802042:0:23463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1788309666.802053:0:23463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788309666.802059:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309666.802061:0:23463:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1788309666.802065:0:23463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788309666.802134:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309666.802136:0:23463:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1788309666.802139:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788309666.802144:0:23463:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.132@tcp to nid 0x20000c0a8ce84 (192.168.206.132@tcp) 00000020:00000080:0.0:1788309666.802168:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788309666.802180:0:23463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8c30c7a1b370) 00000020:00000080:0.0:1788309666.802197:0:23463:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1788309666.802201:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788309666.802270:0:23463:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1788309666.802276:0:23463:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788309666.802282:0:23463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x98c38120c44af57c 00010000:00080000:0.0:1788309666.802318:0:23463:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c30f5f86000@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.132@tcp at head 00010000:00010000:0.0:1788309666.805786:0:23463:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1788309666.807656:0:23463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788309666.807669:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788309666.807708:0:23463:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788309666.807729:0:23463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x98c38120c44af583 00000100:00080000:1.0:1788309666.807739:0:23463:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788309666.807744:0:23463:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c30f5f86000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:1.0:1788309666.807778:0:23463:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30fba9f800 x1875178048155136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788309666.808344:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048155136:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788309666.808445:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309666.808534:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048155136 00000100:00100000:3.0:1788309666.808541:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048155136 00000100:00100000:3.0:1788309666.808578:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788309666.808585:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1875178048155136:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788309666.808608:0:22733:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:3.0:1788309666.808648:0:22733:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x98c38120c44af58a 00000100:00080000:1.0:1788309666.808747:0:23463:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788309666.808773:0:468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788309666.808778:0:468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788309666.808780:0:468:0:(import.c:65:import_set_state_nolock()) ffff8c2fc4270000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788309666.808785:0:468:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 574 00000100:00080000:1.0:1788309666.808789:0:468:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788309666.808793:0:468:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c2fc4270000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:1.0:1788309666.808812:0:468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30fba9ca80 x1875178048155264/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00100000:3.0:1788309666.809401:0:22733:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788309666.809409:0:22733:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1788309666.810189:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048155264:0@lo:38:kworker.0 00000100:00100000:0.0:1788309666.810237:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309666.811792:0:22732:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788309666.811804:0:22732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00080000:1.0:1788309666.812208:0:468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788309666.812213:0:468:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788309666.812216:0:468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788309666.812225:0:468:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788309666.812344:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788309666.812358:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875178048155392:0@lo:400:kworker.0 00000100:00100000:1.0:1788309666.812415:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309666.812451:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048155392 00000100:00100000:1.0:1788309666.812458:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048155392 00000100:00100000:1.0:1788309666.812502:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788309666.812511:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875178048155392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309666.812572:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875178048155392:12345-0@lo:400:kworker.0 Request processed in 61us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309666.812579:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788309666.812631:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c30fba9d500 x1875178048155392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309666.812645:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875178048155392:0@lo:400:kworker.0 00000020:01000000:1.0:1788309666.812725:0:23463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788309666.812731:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309666.812733:0:23463:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788309666.812736:0:23463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788309666.812739:0:23463:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788309666.812740:0:23463:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788309666.812742:0:23463:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788309666.812743:0:23463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788309666.812746:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309666.812747:0:23463:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788309666.812750:0:23463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788309666.812754:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309666.812756:0:23463:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788309666.812759:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788309666.812802:0:23463:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788309666.812854:0:23463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788309666.812858:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309666.812860:0:23463:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788309666.812863:0:23463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788309666.812865:0:23463:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1788309666.812866:0:23463:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788309666.812867:0:23463:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788309666.812869:0:23463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788309666.812871:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309666.812873:0:23463:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788309666.812875:0:23463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788309666.812878:0:23463:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788309666.812881:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309666.812882:0:23463:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788309666.812885:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788309666.812889:0:23463:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.132@tcp to nid 0x20000c0a8ce84 (192.168.206.132@tcp) 00000020:01000000:1.0:1788309666.812916:0:23463:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788309666.812919:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788309666.812934:0:23463:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8c2fc23b99b8) 00000020:00000080:1.0:1788309666.812950:0:23463:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788309666.812954:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788309666.813008:0:23463:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788309666.813014:0:23463:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788309666.813020:0:23463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x98c38120c44af598 00010000:00080000:1.0:1788309666.813046:0:23463:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c2fc35ca800@lustre-OST0000-osc-MDT0001: add connection 192.168.206.132@tcp at head 00000100:00100000:3.0:1788309666.813417:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048155264 00000100:00100000:3.0:1788309666.813428:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048155264 00000100:00100000:3.0:1788309666.813507:0:23468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788309666.813514:0:23468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3616:x1875178048155264:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788309666.813570:0:23468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3616:x1875178048155264:12345-0@lo:38:kworker.0 Request processed in 56us (3331us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788309666.813576:0:23468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788309666.813602:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788309666.813609:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c2fc4270000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00010000:00010000:1.0:1788309666.814029:0:23463:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:3.0:1788309666.814151:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788309666.814156:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048155264:0@lo:38:kworker.0 00000040:01000000:1.0:1788309666.815894:0:23463:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788309666.816219:0:23463:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788309666.818482:0:23463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788309666.818766:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1788309666.818999:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788309666.819506:0:23469:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788309666.819511:0:23469:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788309666.820552:0:23463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788309666.820563:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788309666.820601:0:23463:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788309666.820632:0:23463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x98c38120c44af59f 00000100:00080000:2.0:1788309666.820642:0:23463:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788309666.820647:0:23463:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8c2fc35ca800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:2.0:1788309666.820793:0:23463:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30d3b05180 x1875178048155520/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788309666.820895:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048155520:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788309666.820959:0:3616:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875178048155520 offset 0 length 520: 4 00000100:00080000:2.0:1788309666.821203:0:23463:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788309666.821397:0:22733:0:(import.c:65:import_set_state_nolock()) ffff8c2fc35cb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788309666.821465:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3616:x1875178048155136:12345-0@lo:38:llog_process_th.0 Request processed in 12878us (13018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309666.821484:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788309666.821555:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788309666.821564:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788309666.821569:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788309666.821574:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788309666.821576:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30f5f86000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788309666.821588:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048155136:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788309666.821679:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048155648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788309666.821712:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788309666.822318:0:23463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788309666.822324:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309666.822332:0:23463:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788309666.822336:0:23463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788309666.822339:0:23463:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788309666.822340:0:23463:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788309666.822342:0:23463:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788309666.822344:0:23463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788309666.822346:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309666.822348:0:23463:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788309666.822350:0:23463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788309666.822354:0:23463:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788309666.822357:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309666.822359:0:23463:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788309666.822361:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788309666.822366:0:23463:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.132@tcp to nid 0x20000c0a8ce84 (192.168.206.132@tcp) 00000020:01000000:2.0:1788309666.822387:0:23463:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788309666.822389:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788309666.822402:0:23463:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8c3101260000) 00000020:00000080:2.0:1788309666.822419:0:23463:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788309666.822423:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788309666.822499:0:23463:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788309666.822506:0:23463:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788309666.822512:0:23463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x98c38120c44af5ad 00010000:00080000:2.0:1788309666.822539:0:23463:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c30c7fef800@lustre-OST0001-osc-MDT0001: add connection 192.168.206.132@tcp at head 00010000:00010000:2.0:1788309666.823041:0:23463:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788309666.823178:0:23463:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788309666.823191:0:23463:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1788309666.824165:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048155648 00000100:00100000:0.0:1788309666.824174:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048155648 00000100:00100000:0.0:1788309666.824239:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788309666.824249:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3620:x1875178048155648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788309666.824280:0:22732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000040:00080000:2.0:1788309666.825339:0:23463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788309666.825546:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1788309666.825685:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:3.0:1788309666.826119:0:23471:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788309666.826123:0:23471:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788309666.826797:0:23463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788309666.826807:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788309666.826879:0:23463:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788309666.826899:0:23463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x98c38120c44af5b4 00000100:00080000:2.0:1788309666.826922:0:23463:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788309666.826927:0:23463:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8c30c7fef800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:2.0:1788309666.826958:0:23463:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30d3b07480 x1875178048155776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788309666.826978:0:23463:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788309666.827024:0:23463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788309666.827029:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309666.827030:0:23463:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788309666.827035:0:23463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788309666.827039:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309666.827040:0:23463:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788309666.827043:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788309666.827045:0:23463:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788309666.827047:0:23463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788309666.827049:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309666.827050:0:23463:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788309666.827053:0:23463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788309666.827055:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309666.827057:0:23463:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788309666.827060:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788309666.827090:0:23463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788309666.827093:0:23463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788309666.827094:0:23463:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788309666.827097:0:23463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:2.0:1788309666.827145:0:23459:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788309666.827171:0:23459:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788309666.827184:0:23459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30edf5a200/0x98c38120c44af536 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af53d expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.827194:0:23459:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30edf5a200/0x98c38120c44af536 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af53d expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309666.827210:0:23459:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c2fc33d3000 from 1 10000000:01000000:2.0:1788309666.827213:0:23459:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788309666.827235:0:23459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b800/0x98c38120c44af5bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.827242:0:23459:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b800/0x98c38120c44af5bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.827251:0:23459:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b800/0x98c38120c44af5bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309666.827269:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048155904:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788309666.827326:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309666.827364:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f997d780 going to sleep for 11 seconds 00000100:00100000:3.0:1788309666.827594:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048155776:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788309666.827623:0:3616:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875178048155776 offset 0 length 520: 4 00000100:00100000:0.0:1788309666.827999:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3620:x1875178048155648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3750us (6284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309666.828008:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788309666.828033:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048155904 00000100:00100000:0.0:1788309666.828039:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048155904 00000100:00100000:0.0:1788309666.828127:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788309666.828137:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+15:23459:x1875178048155904:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788309666.828147:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309666.828159:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30c1513800/0x98c38120c44af5c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af5bb expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309666.828181:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30c1513800/0x98c38120c44af5c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af5bb expref: 16 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309666.828191:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30c1513800/0x98c38120c44af5c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af5bb expref: 16 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309666.828200:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30c1513800, rc 0) 00000100:00100000:0.0:1788309666.828237:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+16:23459:x1875178048155904:12345-0@lo:101:mount.lustre.0 Request processed in 101us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309666.828243:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788309666.828315:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048155904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788309666.828328:0:23459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b800/0x98c38120c44af5bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af5c2 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.828338:0:23459:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b800/0x98c38120c44af5bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af5c2 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309666.829189:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048156032:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788309666.829235:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788309666.829329:0:468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788309666.829333:0:468:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788309666.829336:0:468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788309666.829345:0:468:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788309666.829408:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f997d780 going to sleep for 11 seconds 00000100:00100000:1.0:1788309666.829483:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048155648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788309666.829538:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048156032 00000100:00100000:3.0:1788309666.829544:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048156032 00000100:00100000:3.0:1788309666.829584:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788309666.829594:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+16:23459:x1875178048156032:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788309666.829625:0:22722:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788309666.829640:0:22722:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788309666.829642:0:22722:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788309666.829735:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+16:23459:x1875178048156032:12345-0@lo:256:mount.lustre.0 Request processed in 142us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309666.829742:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788309666.829880:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048156032:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788309666.830495:0:23459:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788309666.830517:0:23459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b800/0x98c38120c44af5bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af5c2 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.830527:0:23459:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b800/0x98c38120c44af5bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af5c2 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309666.830535:0:23459:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c2fc33d3000 from 1 10000000:01000000:2.0:1788309666.830537:0:23459:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788309666.830560:0:23459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b600/0x98c38120c44af5c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.830567:0:23459:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b600/0x98c38120c44af5c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.830576:0:23459:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b600/0x98c38120c44af5c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309666.830591:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048156160:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788309666.830622:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309666.830650:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f997d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788309666.830790:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048156160 00000100:00100000:2.0:1788309666.830796:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048156160 00000100:00100000:2.0:1788309666.830822:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788309666.830828:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+16:23459:x1875178048156160:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788309666.830861:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309666.830874:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30edf5ac00/0x98c38120c44af5d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af5c9 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.830892:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30edf5ac00/0x98c38120c44af5d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af5c9 expref: 17 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.830922:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30edf5ac00/0x98c38120c44af5d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af5c9 expref: 17 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.830931:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30edf5ac00, rc 0) 00000100:00100000:2.0:1788309666.830962:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+17:23459:x1875178048156160:12345-0@lo:101:mount.lustre.0 Request processed in 134us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309666.830969:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788309666.831004:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048156160:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788309666.831015:0:23459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b600/0x98c38120c44af5c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af5d0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.831023:0:23459:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b600/0x98c38120c44af5c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af5d0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788309666.832294:0:23459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1788309666.832531:0:23459:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788309666.833178:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788309666.833207:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1788309666.833224:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1788309666.833239:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1788309666.833269:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1788309666.833286:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1788309666.833300:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1788309666.833314:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1788309666.833329:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788309666.833342:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1788309666.833356:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1788309666.833373:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1788309666.833385:0:23459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1788309666.833459:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048156288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788309666.833519:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309666.833593:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f997d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309666.833765:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048156288 00000100:00100000:1.0:1788309666.833772:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048156288 00000100:00100000:1.0:1788309666.833815:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788309666.833824:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+17:23459:x1875178048156288:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788309666.834198:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+17:23459:x1875178048156288:12345-0@lo:501:mount.lustre.0 Request processed in 374us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309666.834206:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788309666.834273:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048156288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788309666.834301:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048156416:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788309666.834336:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309666.834360:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f997d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309666.834405:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048156416 00000100:00100000:0.0:1788309666.834410:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048156416 00000100:00100000:0.0:1788309666.834441:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788309666.834448:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+17:23459:x1875178048156416:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788309666.834526:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+17:23459:x1875178048156416:12345-0@lo:503:mount.lustre.0 Request processed in 79us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309666.834533:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788309666.834603:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048156416:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788309666.835030:0:23459:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788309666.835096:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048156544:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788309666.835131:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309666.835150:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f997d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788309666.835606:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048156544 00000100:00100000:0.0:1788309666.835612:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048156544 00000100:00100000:0.0:1788309666.835635:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788309666.835642:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+17:23459:x1875178048156544:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788309666.835742:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+17:23459:x1875178048156544:12345-0@lo:502:mount.lustre.0 Request processed in 99us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309666.835749:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788309666.835978:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048156544:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788309666.836250:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788309666.836274:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1788309666.836286:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1788309666.836297:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1788309666.836308:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1788309666.836319:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1788309666.836341:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1788309666.836356:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1788309666.836368:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788309666.836380:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1788309666.836393:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1788309666.836418:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048156672:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788309666.836456:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309666.836534:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f997d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788309666.836724:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048156672 00000100:00100000:0.0:1788309666.836730:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048156672 00000100:00100000:0.0:1788309666.836765:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788309666.836772:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+17:23459:x1875178048156672:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788309666.837052:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+17:23459:x1875178048156672:12345-0@lo:502:mount.lustre.0 Request processed in 280us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309666.837059:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788309666.837236:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048156672:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788309666.837289:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:0.0:1788309666.837297:0:23459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788309666.838536:0:23473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788309666.838546:0:23473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309666.838549:0:23473:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788309666.838557:0:23473:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c2fc33d3000 00000020:00000080:1.0:1788309666.838560:0:23473:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788309666.838568:0:23473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788309666.838570:0:23473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309666.838572:0:23473:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788309666.838574:0:23473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788309666.838576:0:23473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309666.838578:0:23473:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788309666.838581:0:23473:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c2fc33d3000 00000020:00000080:1.0:1788309666.838583:0:23473:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788309666.838645:0:23473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788309666.838649:0:23473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309666.838650:0:23473:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788309666.838653:0:23473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788309666.842762:0:23473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309666.842770:0:23473:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788309666.842784:0:23473:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c2fc33d3000 00000020:00000080:1.0:1788309666.842787:0:23473:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788309666.842874:0:23473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788309666.842878:0:23473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309666.842880:0:23473:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788309666.842883:0:23473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788309666.842887:0:23473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309666.842888:0:23473:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788309666.842892:0:23473:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c2fc33d3000 00000020:00000080:1.0:1788309666.842894:0:23473:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788309666.842942:0:23473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788309666.842945:0:23473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309666.842947:0:23473:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788309666.842950:0:23473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:1.0:1788309666.843025:0:23459:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788309666.843056:0:23459:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788309666.843203:0:23459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b600/0x98c38120c44af5c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af5d0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.843216:0:23459:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b600/0x98c38120c44af5c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af5d0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309666.843269:0:23459:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788309666.843272:0:23459:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c2fc33d3000 10000000:01000000:1.0:1788309666.843275:0:23459:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c2fc33d3000 10000000:01000000:1.0:1788309666.843279:0:23459:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788309666.843285:0:23459:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c2fc33d3000 from 1 10000000:01000000:1.0:1788309666.843288:0:23459:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788309666.843322:0:23459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1400/0x98c38120c44af5d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.843343:0:23459:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1400/0x98c38120c44af5d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.843355:0:23459:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1400/0x98c38120c44af5d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309666.843379:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048156800:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788309666.843441:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309666.843482:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30d85e5900 going to sleep for 11 seconds 00000100:00100000:2.0:1788309666.847972:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048156800 00000100:00100000:2.0:1788309666.847987:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048156800 00000100:00100000:2.0:1788309666.848041:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788309666.848052:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+17:23459:x1875178048156800:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788309666.848076:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309666.848093:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30edf5b000/0x98c38120c44af5de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af5d7 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.848118:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30edf5b000/0x98c38120c44af5de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af5d7 expref: 18 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.848128:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30edf5b000/0x98c38120c44af5de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af5d7 expref: 18 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309666.848138:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30edf5b000, rc 0) 00000100:00100000:2.0:1788309666.854007:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:23459:x1875178048156800:12345-0@lo:101:mount.lustre.0 Request processed in 5949us (10558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309666.854019:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788309666.854201:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048156800:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788309666.854224:0:23459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1400/0x98c38120c44af5d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af5de expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.854236:0:23459:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1400/0x98c38120c44af5d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af5de expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788309666.861792:0:23459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:1.0:1788309666.866980:0:23459:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788309666.867326:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:1.0:1788309666.867352:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:1.0:1788309666.867369:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:1.0:1788309666.867381:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:1.0:1788309666.867393:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:1.0:1788309666.867407:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:1.0:1788309666.867439:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:1.0:1788309666.867455:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:1.0:1788309666.867470:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:1.0:1788309666.867482:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:1.0:1788309666.867509:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:1.0:1788309666.867522:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:1.0:1788309666.867536:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:1.0:1788309666.867547:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:1.0:1788309666.867559:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:1.0:1788309666.867572:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:1.0:1788309666.867586:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:1.0:1788309666.867598:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:1.0:1788309666.867609:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:1.0:1788309666.867632:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:1.0:1788309666.867648:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:1.0:1788309666.869778:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:1.0:1788309666.869939:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:1.0:1788309666.869960:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:1.0:1788309666.869974:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:1.0:1788309666.869989:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:1.0:1788309666.870002:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:1.0:1788309666.870016:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:1.0:1788309666.870028:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:1.0:1788309666.870040:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:1.0:1788309666.870051:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:1.0:1788309666.870062:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:1.0:1788309666.870822:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:1.0:1788309666.870979:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:1.0:1788309666.870995:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:1.0:1788309666.871008:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:1.0:1788309666.871022:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:1.0:1788309666.871036:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:1.0:1788309666.871066:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:1.0:1788309666.871270:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:1.0:1788309666.871283:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:1.0:1788309666.871295:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:1.0:1788309666.871310:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:1.0:1788309666.871333:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:1.0:1788309666.871346:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:1.0:1788309666.871359:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:1.0:1788309666.871370:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:1.0:1788309666.871383:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:1.0:1788309666.871539:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:1.0:1788309666.871559:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:1.0:1788309666.871577:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:1.0:1788309666.871583:0:23459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:1.0:1788309666.873048:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048156928:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788309666.873496:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309666.873534:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30d85e5780 going to sleep for 11 seconds 00000100:00100000:1.0:1788309666.873567:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048156928 00000100:00100000:1.0:1788309666.873579:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048156928 00000100:00100000:1.0:1788309666.873633:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788309666.873642:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:23459:x1875178048156928:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788309666.873765:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:23459:x1875178048156928:12345-0@lo:501:mount.lustre.0 Request processed in 123us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309666.873772:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788309666.873816:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048156928:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788309666.873888:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048157056:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788309666.873938:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309666.873956:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30d85e5780 going to sleep for 11 seconds 00000100:00100000:2.0:1788309666.874040:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048157056 00000100:00100000:2.0:1788309666.874044:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048157056 00000100:00100000:2.0:1788309666.874083:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788309666.874091:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:23459:x1875178048157056:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788309666.874175:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:23459:x1875178048157056:12345-0@lo:503:mount.lustre.0 Request processed in 85us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309666.874182:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788309666.875404:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048157056:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788309666.877059:0:23459:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788309666.877163:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048157184:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788309666.877230:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309666.877270:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30d85e5900 going to sleep for 11 seconds 00000100:00100000:1.0:1788309666.877290:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048157184 00000100:00100000:1.0:1788309666.877297:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048157184 00000100:00100000:1.0:1788309666.877335:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788309666.877345:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:23459:x1875178048157184:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788309666.877442:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:23459:x1875178048157184:12345-0@lo:502:mount.lustre.0 Request processed in 97us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309666.877449:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788309666.877512:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048157184:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788309666.877989:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:1.0:1788309666.878015:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:1.0:1788309666.878028:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:1.0:1788309666.878040:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:1.0:1788309666.878052:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:1.0:1788309666.878064:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:1.0:1788309666.878091:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:1.0:1788309666.878106:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:1.0:1788309666.878120:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:1.0:1788309666.878133:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:1.0:1788309666.878148:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:1.0:1788309666.878161:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:1.0:1788309666.878172:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:1.0:1788309666.878182:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:1.0:1788309666.878194:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:1.0:1788309666.878206:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:1.0:1788309666.878230:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:1.0:1788309666.878243:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:1.0:1788309666.878254:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:1.0:1788309666.878265:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:1.0:1788309666.878278:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:1.0:1788309666.878299:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:1.0:1788309666.878311:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:1.0:1788309666.878323:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:1.0:1788309666.878333:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:1.0:1788309666.878344:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:1.0:1788309666.878356:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:1.0:1788309666.878368:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:1.0:1788309666.878380:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:1.0:1788309666.878392:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:1.0:1788309666.878405:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:1.0:1788309666.878418:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:1.0:1788309666.878443:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:1.0:1788309666.878457:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:1.0:1788309666.878470:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:1.0:1788309666.878484:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:1.0:1788309666.878497:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:1.0:1788309666.878507:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:1.0:1788309666.878519:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:1.0:1788309666.878532:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:1.0:1788309666.878545:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:1.0:1788309666.878559:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:1.0:1788309666.878571:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:1.0:1788309666.878582:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:1.0:1788309666.878595:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:1.0:1788309666.878606:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:1.0:1788309666.878617:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:1.0:1788309666.879797:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:1.0:1788309666.880205:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048157312:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788309666.880274:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309666.880307:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30d85e5900 going to sleep for 11 seconds 00000100:00100000:1.0:1788309666.880328:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048157312 00000100:00100000:1.0:1788309666.880335:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048157312 00000100:00100000:1.0:1788309666.880382:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788309666.880391:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:23459:x1875178048157312:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788309666.880489:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:23459:x1875178048157312:12345-0@lo:502:mount.lustre.0 Request processed in 98us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309666.880496:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788309666.880558:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048157312:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788309666.882373:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:1.0:1788309666.882412:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:1.0:1788309666.882449:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048157440:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788309666.882512:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309666.882549:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30d85e5900 going to sleep for 11 seconds 00000100:00100000:1.0:1788309666.882576:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048157440 00000100:00100000:1.0:1788309666.882582:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048157440 00000100:00100000:1.0:1788309666.882619:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788309666.882627:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:23459:x1875178048157440:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788309666.882966:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:23459:x1875178048157440:12345-0@lo:502:mount.lustre.0 Request processed in 339us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309666.882975:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788309666.883032:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048157440:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788309666.883137:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:1.0:1788309666.884035:0:23459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788309666.886966:0:23478:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788309666.886983:0:23478:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8c30edf799b8) 00000020:00000080:1.0:1788309666.887006:0:23478:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788309666.887110:0:23478:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c2fc33d3000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788309666.887114:0:23478:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c2fc33d3000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788309666.887121:0:23478:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c2fc33d3000 3 00010000:00080000:1.0:1788309666.887154:0:23478:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c30f525b800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.132@tcp at head 00010000:00010000:0.0:1788309666.896523:0:23478:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1788309666.896807:0:23478:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1788309666.896874:0:23478:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788309666.896887:0:23478:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x98c38120c44af5ec 00000100:00080000:0.0:1788309666.896905:0:23478:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788309666.896920:0:23478:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c30f525b800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:0.0:1788309666.896952:0:23478:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c2fc414ea00 x1875178048157568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788309666.896971:0:23478:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788309666.896994:0:468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788309666.896999:0:468:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788309666.897001:0:468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788309666.897004:0:468:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788309666.897531:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875178048157568:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788309666.897597:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788309666.898420:0:23478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000100:00100000:0.0:1788309666.898880:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048157568 00000100:00100000:0.0:1788309666.898889:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048157568 00000100:00100000:0.0:1788309666.898935:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788309666.898943:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1875178048157568:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788309666.898969:0:22729:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:0.0:1788309666.898998:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x98c38120c44af5f3 00000004:00100000:0.0:1788309666.899013:0:22729:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788309666.899038:0:22729:0:(import.c:65:import_set_state_nolock()) ffff8c2fc35cc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788309666.899109:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875178048157568:12345-0@lo:38:llog_process_th.0 Request processed in 165us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309666.899116:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788309666.899784:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c2fc414ea00 x1875178048157568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788309676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309666.899796:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788309666.899803:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788309666.899811:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788309666.899815:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788309666.899817:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30f525b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788309666.899834:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875178048157568:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1788309666.902704:0:23459:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788309666.902747:0:23459:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788309666.902770:0:23459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1400/0x98c38120c44af5d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af5de expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.902782:0:23459:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1400/0x98c38120c44af5d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af5de expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788309666.902936:0:23459:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788309666.902938:0:23459:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788309666.902940:0:23459:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788309666.902941:0:23459:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788309666.902942:0:23459:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788309666.902943:0:23459:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788309666.902945:0:23459:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788309666.902946:0:23459:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788309666.902948:0:23459:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788309666.902951:0:23459:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788309666.902954:0:23459:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788309666.902955:0:23459:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788309666.902956:0:23459:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788309666.902957:0:23459:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788309666.902958:0:23459:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788309666.902959:0:23459:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788309666.902960:0:23459:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788309666.902962:0:23459:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788309666.902963:0:23459:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788309666.902987:0:23459:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788309666.903004:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048157696:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788309666.903063:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309666.903103:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30d85e5780 going to sleep for 11 seconds 00000100:00100000:1.0:1788309666.903128:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048157696 00000100:00100000:1.0:1788309666.903134:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048157696 00000100:00100000:1.0:1788309666.903178:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788309666.903187:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:23459:x1875178048157696:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788309666.903214:0:22720:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788309666.903228:0:22720:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788309666.906878:0:22707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1788309666.907190:0:22720:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788309666.907206:0:22720:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1788309666.907364:0:22744:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788309666.907369:0:22744:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788309666.907390:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c30c83da600/0x98c38120c44af5fa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309666.907409:0:22744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c30c83db800/0x98c38120c44af4fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af4f7 expref: 18 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309666.907417:0:22744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c30c1513800/0x98c38120c44af5c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af5bb expref: 18 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309666.907437:0:22744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c30c83da600/0x98c38120c44af5fa lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309666.907474:0:22744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c30c1513800/0x98c38120c44af5c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x98c38120c44af5bb expref: 18 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309666.907488:0:22744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c30c1513800/0x98c38120c44af5c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x98c38120c44af5bb expref: 18 pid: 22719 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309666.907501:0:22744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22744:1875178048157824:0@lo:104: 00000100:00100000:3.0:1788309666.907562:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788309666.907606:0:22744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c30c83db800/0x98c38120c44af4fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x98c38120c44af4f7 expref: 18 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309666.907614:0:22744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c30c83db800/0x98c38120c44af4fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x98c38120c44af4f7 expref: 18 pid: 22719 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309666.907623:0:22744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22744:1875178048157952:0@lo:104: 00000100:00100000:3.0:1788309666.907644:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309666.907661:0:22744:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c5367840 going to sleep for 11 seconds 00000100:00100000:1.0:1788309666.907737:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048157824 00000100:00100000:1.0:1788309666.907744:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048157824 00000100:00100000:1.0:1788309666.907774:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048157952 00000100:00100000:1.0:1788309666.907777:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048157952 00000100:00100000:1.0:1788309666.907791:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788309666.907799:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+4:22744:x1875178048157824:12345-0@lo:104: 00010000:00010000:1.0:1788309666.907811:0:22710:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b800/0x98c38120c44af5bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af5c2 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.907888:0:22710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788309666.907894:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+4:22744:x1875178048157824:12345-0@lo:104: Request processed in 96us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309666.907901:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788309666.907926:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788309666.907932:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+3:22744:x1875178048157952:12345-0@lo:104: 00010000:00010000:1.0:1788309666.907940:0:22710:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af4f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af4fe expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.907971:0:22710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788309666.907976:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+3:22744:x1875178048157952:12345-0@lo:104: Request processed in 45us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309666.907981:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788309666.907997:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788309666.908009:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b800/0x98c38120c44af5bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af5c2 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.908015:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30edf5b800 already unused, calling callback (ffffffffc1507c20) 10000000:00010000:1.0:1788309666.908018:0:22715:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b800/0x98c38120c44af5bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x98c38120c44af5c2 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.908026:0:22715:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b800/0x98c38120c44af5bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x98c38120c44af5c2 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788309666.908032:0:22715:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b800/0x98c38120c44af5bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x98c38120c44af5c2 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309666.908038:0:22715:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788309666.908065:0:22715:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b800/0x98c38120c44af5bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af5c2 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.908084:0:22715:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788309666.908102:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b800/0x98c38120c44af5bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af5c2 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.908108:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b800/0x98c38120c44af5bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af5c2 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.908119:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788309666.908122:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af4f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af4fe expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.908128:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30c1512600 already unused, calling callback (ffffffffc1507c20) 10000000:00010000:1.0:1788309666.908130:0:22715:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af4f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x98c38120c44af4fe expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.908146:0:22715:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af4f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x98c38120c44af4fe expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788309666.908152:0:22715:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af4f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x98c38120c44af4fe expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309666.908156:0:22715:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788309666.908169:0:22715:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af4f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af4fe expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.908174:0:22715:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788309666.908181:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af4f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af4fe expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.908187:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af4f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af4fe expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.908199:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309666.908200:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309666.908202:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309666.908220:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3617:1875178048158080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309666.908248:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309666.908266:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788309666.908271:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3617:1875178048158208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309666.908289:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309666.908316:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048158080 00000100:00100000:1.0:1788309666.908320:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048158080 00010000:00010000:1.0:1788309666.908336:0:22712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c30c1513800/0x98c38120c44af5c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af5bb expref: 19 pid: 22719 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309666.908364:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048158208 00000100:00100000:1.0:1788309666.908367:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048158208 00010000:00010000:1.0:1788309666.908377:0:22712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c30c83db800/0x98c38120c44af4fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af4f7 expref: 20 pid: 22719 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309666.908388:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788309666.908393:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+20:3617:x1875178048158080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788309666.908401:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309666.908405:0:22712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c30c1513800/0x98c38120c44af5c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af5bb expref: 20 pid: 22719 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.908414:0:22712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c30c1513800/0x98c38120c44af5c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x98c38120c44af5bb expref: 20 pid: 22719 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.908427:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309666.908450:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+20:3617:x1875178048158080:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309666.908456:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788309666.908465:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788309666.908470:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+19:3617:x1875178048158208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788309666.908477:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309666.908480:0:22712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c30c83db800/0x98c38120c44af4fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af4f7 expref: 19 pid: 22719 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.908488:0:22712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c30c83db800/0x98c38120c44af4fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x98c38120c44af4f7 expref: 19 pid: 22719 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.908499:0:22712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c30c83da600/0x98c38120c44af5fa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.908511:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30c83da600/0x98c38120c44af5fa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788309666.908523:0:22712:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001208149s 00010000:00010000:1.0:1788309666.908528:0:22712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c30c83da600/0x98c38120c44af5fa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.908534:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c30c83da600/0x98c38120c44af5fa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.908540:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c30c83da600/0x98c38120c44af5fa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.908546:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c30c83da600/0x98c38120c44af5fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.908550:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30c83da600 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:1.0:1788309666.908554:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c30c83da600/0x98c38120c44af5fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.908561:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c30c83da600/0x98c38120c44af5fa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.908568:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c30c83da600/0x98c38120c44af5fa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.908577:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309666.908600:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+19:3617:x1875178048158208:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309666.908606:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788309666.908648:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3617:1875178048158208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309666.908656:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3617:1875178048158080:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788309666.908682:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30c1513800/0x98c38120c44af5c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x98c38120c44af5bb expref: 18 pid: 22719 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309666.908691:0:22744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22744:1875178048157824:0@lo:104: 00010000:00010000:1.0:1788309666.908699:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30c83db800/0x98c38120c44af4fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x98c38120c44af4f7 expref: 17 pid: 22719 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309666.908706:0:22744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22744:1875178048157952:0@lo:104: 00010000:00010000:1.0:1788309666.908719:0:22744:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c30c83da600/0x98c38120c44af5fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.908726:0:22744:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c30c83da600/0x98c38120c44af5fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.908732:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c30c83da600/0x98c38120c44af5fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309666.908737:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30c83da600/0x98c38120c44af5fa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309666.909062:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+16:23459:x1875178048157696:12345-0@lo:253:mount.lustre.0 Request processed in 5875us (5998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309666.909080:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788309666.909195:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:23459:1875178048157696:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788309666.909205:0:23459:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788309666.909208:0:23459:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788309666.909209:0:23459:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788309666.909210:0:23459:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788309666.909212:0:23459:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788309666.909213:0:23459:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788309666.909220:0:23459:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788309666.909221:0:23459:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788309666.909223:0:23459:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788309666.909224:0:23459:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788309666.909235:0:23459:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788309666.910015:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788309666.916857:0:23459:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1788309666.917082:0:23484:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788309666.917087:0:23484:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788309666.917240:0:23485:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788309666.917508:0:23459:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:01000000:1.0:1788309666.917713:0:23459:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788309666.917747:0:23459:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788309666.918316:0:23459:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788309666.918324:0:23459:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788309666.918362:0:23459:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788309666.918998:0:23485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788309666.920479:0:23459:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788309666.921021:0:23459:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788309666.921050:0:23459:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:3.0:1788309666.921211:0:23486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23486:1875178048158336:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788309666.921273:0:23486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309666.921299:0:23486:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c42dbf00 going to sleep for 11 seconds 00000040:00080000:1.0:1788309666.922462:0:23459:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788309666.923020:0:23459:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000040:00080000:0.0:1788309666.924161:0:23485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788309666.924220:0:23485:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000001:00000004:1.0:1788309666.924490:0:23459:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:2.0:1788309666.924527:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048158336 00000100:00100000:2.0:1788309666.924535:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048158336 00000100:00100000:2.0:1788309666.924587:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788309666.924597:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23486:x1875178048158336:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788309666.925031:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23486:x1875178048158336:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 434us (3755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309666.925040:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788309666.925113:0:23486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23486:1875178048158336:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788309666.925156:0:23486:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788309666.925195:0:23486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23486:1875178048158464:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788309666.925237:0:23486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309666.925268:0:23486:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c42dbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788309666.925601:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048158464 00000100:00100000:0.0:1788309666.925607:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048158464 00000100:00100000:0.0:1788309666.925654:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788309666.925662:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23486:x1875178048158464:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788309666.926225:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23486:x1875178048158464:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 562us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309666.926232:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788309666.926280:0:23486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23486:1875178048158464:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788309666.926349:0:23486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23486:1875178048158592:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788309666.926374:0:23486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309666.926419:0:23486:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30edf11f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788309666.926570:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048158592 00000100:00100000:0.0:1788309666.926574:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048158592 00000100:00100000:0.0:1788309666.926644:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788309666.926652:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23486:x1875178048158592:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788309666.926696:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23486:x1875178048158592:12345-0@lo:900:lod0001_rec0000.0 Request processed in 45us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309666.926702:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788309666.926749:0:23486:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c30fba9df80 x1875178048158592/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788309682 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309666.926761:0:23486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23486:1875178048158592:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788309666.926797:0:23486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23486:1875178048158720:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788309666.926816:0:23486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309666.926834:0:23486:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30edf11480 going to sleep for 11 seconds 00000100:00100000:2.0:1788309666.926876:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048158720 00000100:00100000:2.0:1788309666.926882:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048158720 00000100:00100000:3.0:1788309666.927018:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788309666.927026:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23486:x1875178048158720:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788309666.927087:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23486:x1875178048158720:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 62us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309666.927093:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788309666.927142:0:23486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23486:1875178048158720:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1788309666.927182:0:23486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788309666.930456:0:23486:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788309666.930536:0:23486:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788309666.930541:0:23486:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:1.0:1788309666.932547:0:23459:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788309666.932590:0:23459:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa2ea00d53988 00100000:10000000:1.0:1788309666.932599:0:23459:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788309666.933243:0:23459:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788309666.933270:0:23459:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.132@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788309666.933288:0:23459:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788309666.933311:0:23459:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788309666.937370:0:23459:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788309666.938249:0:23459:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788309667.178979:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2996cc0 going to sleep for 0 seconds 00010000:00010000:1.0:1788309667.819635:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788309667.948971:0:23480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1788309668.009952:0:22724:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788309668.009964:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c2fc33d3000 from 12 10000000:01000000:1.0:1788309668.009972:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788309668.010032:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44af601 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309668.010045:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44af601 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309668.010125:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44af601 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309668.010160:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048158848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788309668.010245:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309668.010350:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048158848 00000100:00100000:2.0:1788309668.010365:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048158848 00000100:00100000:1.0:1788309668.010375:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30edf11240 going to sleep for 11 seconds 00000100:00100000:2.0:1788309668.010443:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788309668.010456:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+16:22724:x1875178048158848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788309668.010471:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309668.010491:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30edf5be00/0x98c38120c44af608 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af601 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309668.010519:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30edf5be00/0x98c38120c44af608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af601 expref: 17 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309668.010551:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30edf5be00/0x98c38120c44af608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af601 expref: 17 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309668.010561:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30edf5be00, rc 0) 00000100:00100000:2.0:1788309668.010651:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+17:22724:x1875178048158848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309668.010657:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788309668.010770:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048158848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788309668.010789:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44af601 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af608 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309668.010798:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44af601 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af608 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309668.011183:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048158976:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788309668.011225:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309668.011262:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30edf11240 going to sleep for 11 seconds 00000100:00100000:3.0:1788309668.011364:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048158976 00000100:00100000:3.0:1788309668.011372:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048158976 00000100:00100000:3.0:1788309668.012047:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788309668.012059:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+17:22724:x1875178048158976:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788309668.012097:0:22720:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788309668.012116:0:22720:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788309668.012119:0:22720:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1788309668.012262:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+17:22724:x1875178048158976:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 205us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309668.012271:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788309668.012307:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048158976:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788309668.012373:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788309668.012382:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44af601 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af608 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309668.012390:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44af601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af608 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309668.012399:0:22724:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788309668.012402:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c30c83d6000 from 12 10000000:01000000:1.0:1788309668.012404:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788309668.012428:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1600/0x98c38120c44af60f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309668.012436:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1600/0x98c38120c44af60f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309668.012444:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1600/0x98c38120c44af60f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309668.012460:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048159104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788309668.012501:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309668.012539:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30edf11240 going to sleep for 11 seconds 00000100:00100000:0.0:1788309668.012631:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048159104 00000100:00100000:0.0:1788309668.012643:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048159104 00000100:00100000:0.0:1788309668.012685:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788309668.012694:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+17:22724:x1875178048159104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788309668.012705:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309668.012723:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30c1512a00/0x98c38120c44af616 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af60f expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309668.012766:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30c1512a00/0x98c38120c44af616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af60f expref: 18 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309668.012778:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30c1512a00/0x98c38120c44af616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af60f expref: 18 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309668.012874:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30c1512a00, rc 0) 00000100:00100000:0.0:1788309668.013058:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:22724:x1875178048159104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 365us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309668.013065:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788309668.013460:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048159104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788309668.013480:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1600/0x98c38120c44af60f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af616 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309668.013490:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1600/0x98c38120c44af60f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af616 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309668.013556:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048159232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788309668.013599:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309668.013631:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30edf11240 going to sleep for 11 seconds 00000100:00100000:3.0:1788309668.013650:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048159232 00000100:00100000:3.0:1788309668.013659:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048159232 00000100:00100000:3.0:1788309668.013749:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788309668.013759:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:22724:x1875178048159232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788309668.013776:0:22720:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788309668.013800:0:22720:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788309668.013803:0:22720:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1788309668.013956:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:22724:x1875178048159232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 199us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309668.013964:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788309668.014017:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048159232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788309668.014077:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788309668.014084:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1600/0x98c38120c44af60f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af616 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309668.014099:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1600/0x98c38120c44af60f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af616 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309668.202116:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2996cc0 going to sleep for 0 seconds 00010000:00010000:0.0:1788309668.842072:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788309668.972740:0:23480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788309669.226154:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2996cc0 going to sleep for 0 seconds 00010000:00010000:1.0:1788309669.879657:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309670.249997:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2996cc0 going to sleep for 0 seconds 00000001:02000400:2.0:1788309670.436563:0:23729:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg632-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788309670.892651:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788309671.272465:0:23781:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788309671.272711:0:23781:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788309671.275563:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2996cc0 going to sleep for 0 seconds 00010000:00010000:1.0:1788309671.914032:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788309672.001773:0:23831:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788309672.002393:0:23831:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788309672.042536:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3619:1875178048159360:0@lo:400:kworker.0 00000100:00100000:0.0:1788309672.042615:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309672.042680:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048159360 00000100:00100000:0.0:1788309672.042687:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048159360 00000100:00100000:0.0:1788309672.042726:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788309672.042733:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:3619:x1875178048159360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309672.042774:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:3619:x1875178048159360:12345-0@lo:400:kworker.0 Request processed in 42us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309672.042780:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788309672.042819:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3619:1875178048159360:0@lo:400:kworker.0 00000100:00080000:3.0:1788309672.043311:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788309672.043316:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788309672.043319:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c2fc4270000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788309672.043326:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c2fc4270000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:3.0:1788309672.043350:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30fbbf1500 x1875178048159488/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788309672.043365:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788309672.043368:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788309672.043370:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788309672.043373:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788309672.043418:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788309672.043420:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788309672.043423:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788309672.043425:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788309672.043869:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875178048159616:0@lo:400:kworker.0 00000100:00100000:1.0:1788309672.043922:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309672.043959:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048159744:0@lo:400:kworker.0 00000100:00100000:1.0:1788309672.043982:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309672.043997:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788309672.044002:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875178048159872:0@lo:400:kworker.0 00000100:00100000:1.0:1788309672.044018:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309672.044057:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048159616 00000100:00100000:1.0:1788309672.044062:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048159616 00000100:00100000:1.0:1788309672.044093:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048159872 00000100:00100000:1.0:1788309672.044103:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048159872 00000100:00100000:1.0:1788309672.044120:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788309672.044128:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875178048159616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309672.044173:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875178048159616:12345-0@lo:400:kworker.0 Request processed in 46us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309672.044179:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788309672.044193:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788309672.044198:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875178048159872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309672.045183:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048159488:0@lo:38:kworker.0 00000100:00100000:0.0:1788309672.045241:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309672.045285:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048159744 00000100:00100000:0.0:1788309672.045298:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048159744 00000100:00100000:0.0:1788309672.045335:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048159488 00000100:00100000:0.0:1788309672.045338:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048159488 00000100:00100000:0.0:1788309672.045351:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788309672.045357:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048159744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309672.045416:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048159744:12345-0@lo:400:kworker.0 Request processed in 59us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309672.045423:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788309672.045437:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788309672.045441:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1875178048159488:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788309672.045572:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875178048159872:12345-0@lo:400:kworker.0 Request processed in 1373us (1551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309672.045580:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788309672.045636:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c30fbbf0e00 x1875178048159616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309672.045649:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875178048159616:0@lo:400:kworker.0 00000100:00100000:1.0:1788309672.045663:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788309672.045669:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048160000:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788309672.045691:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309672.045714:0:23468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048160000 00000100:00100000:1.0:1788309672.045718:0:23468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048160000 00000100:00100000:1.0:1788309672.045735:0:23468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788309672.045741:0:23468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048160000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788309672.045764:0:23468:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788309672.045857:0:23468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048160000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309672.045863:0:23468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788309672.045912:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048160000:0@lo:41:osp-pre-0-1.0 00010000:00080000:0.0:1788309672.047277:0:22732:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 582 last 0 00000020:00000080:0.0:1788309672.047309:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x98c38120c44af61d 00000004:00100000:0.0:1788309672.047324:0:22732:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788309672.047330:0:22732:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:0.0:1788309672.047438:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c30fbbf3800 x1875178048159872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309672.047452:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875178048159872:0@lo:400:kworker.0 00000100:00100000:0.0:1788309672.047540:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048159744:0@lo:400:kworker.0 00000100:00080000:2.0:1788309672.059334:0:22732:0:(import.c:65:import_set_state_nolock()) ffff8c30c7fee000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788309672.060812:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788309672.060824:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788309672.060830:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788309672.060833:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c2fc4270000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788309672.060863:0:3616:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000ded88f8d): req@ffff8c30d3b05500 x1875178048152576/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309672.060890:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048159488:0@lo:38:kworker.0 00000100:00100000:0.0:1788309672.060982:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309672.061146:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875178048160128:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788309672.061159:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2996cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309672.061174:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309672.061176:0:23468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048152576 00000100:00100000:0.0:1788309672.061181:0:23468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048152576 00000100:00100000:0.0:1788309672.061210:0:23468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048160128 00000100:00100000:0.0:1788309672.061213:0:23468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048160128 00000100:00100000:0.0:1788309672.061228:0:23468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788309672.061235:0:23468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:22770:x1875178048152576:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788309672.061263:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:3616:x1875178048159488:12345-0@lo:38:kworker.0 Request processed in 15000us (15201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309672.061270:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788309672.061288:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788309672.061296:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3620:x1875178048160128:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788309672.061311:0:23468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22770:x1875178048152576:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 77us (330us total) trans 0 rc 0/0 00000004:00000024:2.0:1788309672.061317:0:22732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788309672.061317:0:23468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788309672.061404:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3620:x1875178048160128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309672.061411:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788309672.062625:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22770:1875178048152576:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788309672.062663:0:22770:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788309672.062699:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9d880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22770:1875178048160256:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788309672.062743:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309672.062774:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30edf11c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788309672.062789:0:23468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048160256 00000100:00100000:1.0:1788309672.062793:0:23468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048160256 00000100:00100000:1.0:1788309672.062825:0:23468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788309672.062832:0:23468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22770:x1875178048160256:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788309672.062977:0:23468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22770:x1875178048160256:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 145us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309672.062985:0:23468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788309672.063014:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9d880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22770:1875178048160256:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788309672.063073:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9d880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22770:1875178048160384:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788309672.063096:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309672.063112:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30edf11c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788309672.064030:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875178048160128:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788309672.064199:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048160384 00000100:00100000:2.0:1788309672.064263:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048160384 00000100:00100000:2.0:1788309672.064337:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788309672.064347:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22770:x1875178048160384:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788309672.064441:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22770:x1875178048160384:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 96us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309672.064458:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788309672.064520:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9d880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22770:1875178048160384:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788309672.064562:0:22770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788309672.066695:0:22770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788309672.066757:0:22770:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:3.0:1788309672.066762:0:22770:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000080:3.0:1788309672.822934:0:23879:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdcb28cbe0 20000000:00000080:3.0:1788309672.822950:0:23879:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c30f52bbc00 uarg=0000000000000000 20000000:01000000:3.0:1788309672.822986:0:23879:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788309672.822993:0:23879:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788309672.822998:0:23879:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788309672.824429:0:23880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1788309672.825196:0:23879:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788309672.830799:0:23879:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788309672.830907:0:23879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c30c1513800/0x98c38120c44af624 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309672.830928:0:23879:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c2fc35f1200/0x98c38120c44af4cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af4c6 expref: 17 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309672.830937:0:23879:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c30edf5ac00/0x98c38120c44af5d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af5c9 expref: 17 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309672.830944:0:23879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c30c1513800/0x98c38120c44af624 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309672.830985:0:23879:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c30edf5ac00/0x98c38120c44af5d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x98c38120c44af5c9 expref: 17 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309672.831000:0:23879:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c30edf5ac00/0x98c38120c44af5d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x98c38120c44af5c9 expref: 17 pid: 22722 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309672.831015:0:23879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23879:1875178048160512:0@lo:104: 00000100:00100000:0.0:1788309672.831090:0:23879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788309672.831144:0:23879:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c2fc35f1200/0x98c38120c44af4cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x98c38120c44af4c6 expref: 17 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309672.831152:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048160512 00010000:00010000:0.0:1788309672.831154:0:23879:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c2fc35f1200/0x98c38120c44af4cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x98c38120c44af4c6 expref: 17 pid: 22720 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309672.831166:0:23879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23879:1875178048160640:0@lo:104: 00000100:00100000:1.0:1788309672.831170:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048160512 00000100:00100000:0.0:1788309672.831192:0:23879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309672.831218:0:23879:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c60de900 going to sleep for 11 seconds 00000100:00100000:3.0:1788309672.831265:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048160640 00000100:00100000:3.0:1788309672.831270:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048160640 00000100:00100000:3.0:1788309672.831292:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788309672.831300:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+4:23879:x1875178048160512:12345-0@lo:104: 00010000:00010000:3.0:1788309672.831312:0:22711:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b600/0x98c38120c44af5c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af5d0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309672.831377:0:22711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788309672.831382:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+4:23879:x1875178048160512:12345-0@lo:104: Request processed in 84us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309672.831390:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788309672.831407:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788309672.831414:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+3:23879:x1875178048160640:12345-0@lo:104: 00010000:00010000:3.0:1788309672.831422:0:22711:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff8c30c1513c00/0x98c38120c44af4c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af4cd expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309672.831430:0:23879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23879:1875178048160512:0@lo:104: 00000100:00100000:1.0:1788309672.831488:0:23879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23879:1875178048160640:0@lo:104: 00010000:00010000:3.0:1788309672.831490:0:22711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788309672.831498:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+3:23879:x1875178048160640:12345-0@lo:104: Request processed in 85us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309672.831506:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788309672.831514:0:23879:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c30c1513800/0x98c38120c44af624 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309672.831564:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788309672.831571:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b600/0x98c38120c44af5c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af5d0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309672.831575:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309672.831584:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30edf5b600 already unused, calling callback (ffffffffc1507c20) 10000000:00010000:2.0:1788309672.831589:0:22716:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b600/0x98c38120c44af5c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x98c38120c44af5d0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309672.831597:0:22716:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b600/0x98c38120c44af5c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x98c38120c44af5d0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309672.831604:0:22716:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b600/0x98c38120c44af5c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x98c38120c44af5d0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309672.831609:0:22716:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788309672.831685:0:22716:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b600/0x98c38120c44af5c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af5d0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309672.831693:0:22716:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788309672.831717:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b600/0x98c38120c44af5c9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af5d0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309672.831724:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3617:1875178048160768:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788309672.831727:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b600/0x98c38120c44af5c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af5d0 expref: -99 pid: 23459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309672.831744:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309672.831746:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309672.831748:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309672.831763:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309672.832805:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048160768 00000100:00100000:2.0:1788309672.832813:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048160768 00010000:00010000:2.0:1788309672.832870:0:22712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c30edf5ac00/0x98c38120c44af5d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af5c9 expref: 18 pid: 22722 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309672.832927:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788309672.833233:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:3617:x1875178048160768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788309672.833248:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309672.833255:0:22712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c30edf5ac00/0x98c38120c44af5d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af5c9 expref: 18 pid: 22722 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309672.833266:0:22712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c30edf5ac00/0x98c38120c44af5d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x98c38120c44af5c9 expref: 18 pid: 22722 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309672.833287:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30edf5ac00/0x98c38120c44af5d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x98c38120c44af5c9 expref: 18 pid: 22722 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309672.833298:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309672.833361:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+17:3617:x1875178048160768:12345-0@lo:103:ldlm_bl.0 Request processed in 426us (1597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309672.833367:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788309672.833505:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3617:1875178048160768:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788309672.834313:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309672.834316:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309672.834318:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309672.834464:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c30c1513c00/0x98c38120c44af4c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af4cd expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309672.834476:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30c1513c00 already unused, calling callback (ffffffffc1507c20) 10000000:00010000:1.0:1788309672.834480:0:22715:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c30c1513c00/0x98c38120c44af4c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x98c38120c44af4cd expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309672.834489:0:22715:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c30c1513c00/0x98c38120c44af4c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x98c38120c44af4cd expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788309672.834495:0:22715:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c30c1513c00/0x98c38120c44af4c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x98c38120c44af4cd expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309672.834501:0:22715:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788309672.834546:0:22715:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff8c30c1513c00/0x98c38120c44af4c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af4cd expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309672.834552:0:22715:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788309672.834579:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c30c1513c00/0x98c38120c44af4c6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af4cd expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309672.834586:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c30c1513c00/0x98c38120c44af4c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af4cd expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309672.834600:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309672.834602:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309672.834604:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309672.834671:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3618:1875178048160896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788309672.834721:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309672.834900:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048160896 00000100:00100000:1.0:1788309672.834907:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048160896 00010000:00010000:1.0:1788309672.834932:0:22714:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c2fc35f1200/0x98c38120c44af4cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af4c6 expref: 17 pid: 22720 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309672.834964:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788309672.834973:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d3b04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+17:3618:x1875178048160896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788309672.834985:0:22714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309672.834991:0:22714:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c2fc35f1200/0x98c38120c44af4cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af4c6 expref: 17 pid: 22720 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309672.835076:0:22714:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c2fc35f1200/0x98c38120c44af4cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x98c38120c44af4c6 expref: 17 pid: 22720 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309672.835090:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c2fc35f1200/0x98c38120c44af4cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x98c38120c44af4c6 expref: 17 pid: 22720 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309672.835102:0:22714:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c30c1513800/0x98c38120c44af624 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309672.835110:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30c1513800/0x98c38120c44af624 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309672.835125:0:22714:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c30c1513800/0x98c38120c44af624 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309672.835132:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c30c1513800/0x98c38120c44af624 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309672.835139:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c30c1513800/0x98c38120c44af624 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309672.835155:0:22714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c30c1513800/0x98c38120c44af624 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309672.835161:0:22714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30c1513800 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:1.0:1788309672.835165:0:22714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c30c1513800/0x98c38120c44af624 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309672.835173:0:22714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c30c1513800/0x98c38120c44af624 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309672.835190:0:22714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c30c1513800/0x98c38120c44af624 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309672.835200:0:22714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309672.835248:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d3b04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+16:3618:x1875178048160896:12345-0@lo:103:ldlm_bl.0 Request processed in 276us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309672.835256:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788309672.835381:0:23879:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c30c1513800/0x98c38120c44af624 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309672.835390:0:23879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c30c1513800/0x98c38120c44af624 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309672.835397:0:23879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30c1513800/0x98c38120c44af624 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309672.835802:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3618:1875178048160896:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788309672.938348:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309673.966178:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788309674.668979:0:22724:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788309674.668986:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c2fc33d3000 from 13 10000000:01000000:0.0:1788309674.668991:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788309674.669034:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1513200/0x98c38120c44af62b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309674.669046:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c30c1513200/0x98c38120c44af62b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309674.669057:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c30c1513200/0x98c38120c44af62b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309674.669091:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048161024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788309674.669154:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309674.669198:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c60de240 going to sleep for 11 seconds 00000100:00100000:3.0:1788309674.669274:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048161024 00000100:00100000:3.0:1788309674.669281:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048161024 00000100:00100000:3.0:1788309674.669333:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788309674.669342:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+16:22724:x1875178048161024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309674.669354:0:22720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309674.669366:0:22720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30c83daa00/0x98c38120c44af632 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af62b expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309674.669386:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30c83daa00/0x98c38120c44af632 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af62b expref: 17 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309674.669396:0:22720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30c83daa00/0x98c38120c44af632 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af62b expref: 17 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309674.669404:0:22720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30c83daa00, rc 0) 00000100:00100000:3.0:1788309674.669443:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+17:22724:x1875178048161024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309674.669449:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788309674.670045:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048161024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788309674.670060:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c30c1513200/0x98c38120c44af62b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af632 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309674.670070:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c30c1513200/0x98c38120c44af62b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af632 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309674.670130:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048161152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788309674.670162:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309674.670194:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c60de240 going to sleep for 11 seconds 00000100:00100000:2.0:1788309674.670245:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048161152 00000100:00100000:2.0:1788309674.670250:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048161152 00000100:00100000:2.0:1788309674.670284:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788309674.670292:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+17:22724:x1875178048161152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788309674.670407:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+17:22724:x1875178048161152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309674.670414:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788309674.670513:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048161152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788309674.670551:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048161280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788309674.670589:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309674.670652:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c60de240 going to sleep for 11 seconds 00000100:00100000:3.0:1788309674.683402:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048161280 00000100:00100000:3.0:1788309674.683417:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048161280 00000100:00100000:3.0:1788309674.683480:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788309674.683490:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+17:22724:x1875178048161280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788309674.683654:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+17:22724:x1875178048161280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (13062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309674.683662:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788309674.683727:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048161280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788309674.684392:0:23955:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788309674.684452:0:22724:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788309674.684470:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788309674.684478:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1513200/0x98c38120c44af62b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af632 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309674.684489:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30c1513200/0x98c38120c44af62b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af632 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309674.684500:0:22724:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788309674.684503:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c30c83d6000 from 13 10000000:01000000:3.0:1788309674.684506:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788309674.684536:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c83da200/0x98c38120c44af639 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309674.684544:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c30c83da200/0x98c38120c44af639 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309674.684552:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c30c83da200/0x98c38120c44af639 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309674.684571:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048161408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788309674.684619:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309674.684650:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c690f300 going to sleep for 11 seconds 00000100:00100000:3.0:1788309674.684665:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048161408 00000100:00100000:3.0:1788309674.684669:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048161408 00000100:00100000:3.0:1788309674.684697:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788309674.684704:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+17:22724:x1875178048161408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309674.684714:0:22720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309674.684724:0:22720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30c83da600/0x98c38120c44af640 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af639 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309674.684744:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30c83da600/0x98c38120c44af640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af639 expref: 18 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309674.684753:0:22720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30c83da600/0x98c38120c44af640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af639 expref: 18 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309674.684761:0:22720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30c83da600, rc 0) 00000100:00100000:3.0:1788309674.684792:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:22724:x1875178048161408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309674.684798:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788309674.684835:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048161408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309674.684881:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c30c83da200/0x98c38120c44af639 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af640 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309674.684891:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c30c83da200/0x98c38120c44af639 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af640 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309674.684938:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048161536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309674.684972:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309674.684984:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c690f300 going to sleep for 11 seconds 00000100:00100000:3.0:1788309674.684996:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048161536 00000100:00100000:3.0:1788309674.684999:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048161536 00000100:00100000:3.0:1788309674.685019:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788309674.685025:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:22724:x1875178048161536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309674.685112:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:22724:x1875178048161536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 87us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309674.685119:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788309674.685147:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048161536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309674.685169:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048161664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788309674.685204:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309674.685216:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c690f300 going to sleep for 11 seconds 00000100:00100000:3.0:1788309674.685227:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048161664 00000100:00100000:3.0:1788309674.685230:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048161664 00000100:00100000:3.0:1788309674.685250:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788309674.685255:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:22724:x1875178048161664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788309674.685322:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:22724:x1875178048161664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309674.685328:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788309674.685366:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048161664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788309674.691199:0:23956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788309674.691560:0:22724:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788309674.691593:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788309674.691604:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c83da200/0x98c38120c44af639 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af640 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309674.691633:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30c83da200/0x98c38120c44af639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af640 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309674.986075:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309676.018580:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309676.142927:0:3616:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788309666/real 1788309666] req@ffff8c30d3b07480 x1875178048155776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788309676 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309676.142959:0:3616:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c30d3b07480 x1875178048155776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788309676 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309676.143403:0:3616:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788309666/real 1788309666] req@ffff8c30d3b05180 x1875178048155520/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788309676 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309676.143419:0:3616:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c30d3b05180 x1875178048155520/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788309676 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788309676.143439:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30c7fef800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788309676.143560:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788309676.143566:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048155776:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788309676.143572:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c2fc35ca800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788309676.143653:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788309676.143657:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788309676.143660:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788309676.143662:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788309676.143693:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788309676.143696:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788309676.143699:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c2fc35ca800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788309676.143704:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 576 00000100:00080000:3.0:1788309676.143708:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788309676.143714:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8c2fc35ca800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:3.0:1788309676.143732:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30fbbf0e00 x1875178048162304/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788309676.143741:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788309676.143744:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788309676.143746:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c30c7fef800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788309676.143749:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 576 00000100:00080000:3.0:1788309676.143751:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788309676.143754:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8c30c7fef800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:3.0:1788309676.143764:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30fbbf3100 x1875178048162432/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788309676.143813:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875178048161920:0@lo:400:kworker.0 00000100:00100000:3.0:1788309676.143906:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309676.143950:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788309676.143957:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3620:1875178048161792:0@lo:400:kworker.0 00000100:00100000:3.0:1788309676.144006:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309676.144038:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875178048162560:0@lo:400:kworker.0 00000100:00100000:3.0:1788309676.144065:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309676.144092:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875178048162048:0@lo:400:kworker.0 00000100:00100000:3.0:1788309676.144115:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309676.144133:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788309676.144139:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048162176:0@lo:400:kworker.0 00000100:00100000:3.0:1788309676.144158:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309676.144188:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048161920 00000100:00100000:3.0:1788309676.144195:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048161920 00000100:00100000:3.0:1788309676.144229:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048162176 00000100:00100000:3.0:1788309676.144233:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048162176 00000100:00100000:3.0:1788309676.144254:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788309676.144262:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3620:x1875178048161920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309676.144313:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3620:x1875178048161920:12345-0@lo:400:kworker.0 Request processed in 51us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309676.144319:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788309676.144334:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788309676.144340:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c30c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048162176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309676.144370:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c30c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048162176:12345-0@lo:400:kworker.0 Request processed in 30us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309676.144386:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788309676.144404:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048161792 00000100:00100000:3.0:1788309676.144407:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048161792 00000100:00100000:3.0:1788309676.144432:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788309676.144438:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:3620:x1875178048161792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309676.144762:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:3620:x1875178048161792:12345-0@lo:400:kworker.0 Request processed in 323us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309676.144770:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788309676.144798:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048162560 00000100:00100000:3.0:1788309676.144802:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048162560 00000100:00100000:3.0:1788309676.144901:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048162048 00000100:00100000:3.0:1788309676.144906:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048162048 00000100:00080000:2.0:1788309676.145225:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788309676.145232:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048155520:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788309676.145262:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048162304:0@lo:8:kworker.0 00000400:00000100:2.0:1788309676.145294:0:3616:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875178048162304 offset 0 length 520: 4 00000100:00100000:2.0:1788309676.145318:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048162432:0@lo:8:kworker.0 00000400:00000100:2.0:1788309676.145351:0:3616:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875178048162432 offset 0 length 520: 4 00000100:00100000:0.0:1788309676.145417:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788309676.145428:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875178048162560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309676.145554:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875178048162560:12345-0@lo:400:kworker.0 Request processed in 128us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309676.145561:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788309676.145576:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788309676.145583:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c30c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875178048162048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309676.145624:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c30c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875178048162048:12345-0@lo:400:kworker.0 Request processed in 41us (1507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309676.145631:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788309676.145781:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048162176:0@lo:400:kworker.0 00010000:00080000:3.0:1788309676.145796:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c30fbbf3800 x1875178048162048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309676.145807:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875178048162048:0@lo:400:kworker.0 00000100:00100000:3.0:1788309676.145834:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3620:1875178048161792:0@lo:400:kworker.0 00000100:00080000:2.0:1788309676.145907:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788309676.145911:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788309676.145914:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788309676.145925:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:3.0:1788309676.146263:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c30fbbf2a00 x1875178048162560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309676.146272:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875178048162560:0@lo:400:kworker.0 00000100:00100000:3.0:1788309676.146282:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875178048161920:0@lo:400:kworker.0 00000040:00080000:2.0:1788309676.395090:0:22764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788309677.034189:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309677.162660:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788309677.162662:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788309677.162681:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875178048162816:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788309677.162693:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048162688:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788309677.163271:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309677.163301:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048162688 00000100:00100000:3.0:1788309677.163310:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048162688 00000100:00100000:2.0:1788309677.163322:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309677.163354:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048162816 00000100:00100000:1.0:1788309677.163359:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048162816 00000100:00100000:3.0:1788309677.163361:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788309677.163373:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1875178048162688:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788309677.163388:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788309677.163394:0:23468:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 3 min 2 max 116 00000100:00100000:1.0:1788309677.163397:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d3b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875178048162816:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788309677.163402:0:23468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_003' 00000004:00000024:3.0:1788309677.163405:0:22733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000004:00000024:1.0:1788309677.163417:0:22732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788309677.163464:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1875178048162688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309677.163471:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788309677.163511:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048162688:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788309677.163546:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d3b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875178048162816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309677.163554:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788309677.163588:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875178048162816:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1788309677.677743:0:23460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788309678.058985:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788309678.186485:0:23480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:3.0:1788309678.769961:0:24229:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788309678.769966:0:24229:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788309678.769967:0:24229:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788309678.770153:0:24229:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c30f9a31000 00000020:01000004:3.0:1788309678.770169:0:24229:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788309678.770183:0:24229:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788309678.770198:0:24229:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8c30c7b319b8) 00000020:00000080:3.0:1788309678.770215:0:24229:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788309678.809112:0:24229:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788309678.812115:0:24229:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788309678.812348:0:24229:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788309678.812531:0:24229:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788309678.813592:0:24229:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788309678.813956:0:24229:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788309678.814386:0:24229:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:0.0:1788309678.816172:0:24229:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788309678.816382:0:24229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788309678.816395:0:24229:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788309678.816406:0:24229:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x98c38120c44af64e 00000020:01000004:0.0:1788309678.816412:0:24229:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788309678.816434:0:24229:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.132@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788309678.816437:0:24229:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788309678.816443:0:24229:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788309678.816448:0:24229:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788309678.816473:0:24229:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8c30ed8ccd28) 00000020:00000080:0.0:1788309678.816485:0:24229:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1788309678.817584:0:24229:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788309678.817740:0:24229:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788309678.817747:0:24229:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788309678.824952:0:24229:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788309678.824966:0:24229:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788309678.825800:0:24229:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788309678.825807:0:24229:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788309678.827475:0:24229:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788309678.827664:0:24229:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788309678.827671:0:24229:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788309678.828686:0:24229:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788309678.828695:0:24229:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788309678.850228:0:24229:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788309678.850645:0:24229:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788309678.850653:0:24229:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788309678.851969:0:24229:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788309678.851981:0:24229:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788309678.853757:0:24229:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788309678.853770:0:24229:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788309678.865699:0:24229:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788309678.866511:0:24229:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788309678.866520:0:24229:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788309678.868657:0:24229:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788309678.868668:0:24229:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788309678.908827:0:24229:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788309678.909150:0:24229:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788309678.909157:0:24229:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788309678.911026:0:24229:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788309678.911038:0:24229:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788309678.915575:0:24229:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788309678.915617:0:24229:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788309678.915623:0:24229:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.132@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788309678.947577:0:24229:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.132@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788309678.947622:0:24229:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.132@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788309678.947627:0:24229:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788309678.947629:0:24229:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788309678.947630:0:24229:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788309678.947631:0:24229:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788309678.947633:0:24229:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788309678.947634:0:24229:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788309678.947639:0:24229:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788309678.947641:0:24229:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788309678.947642:0:24229:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788309678.947645:0:24229:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788309678.947647:0:24229:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788309678.947649:0:24229:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788309678.947650:0:24229:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788309678.947651:0:24229:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788309678.947652:0:24229:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788309678.947652:0:24229:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788309678.947653:0:24229:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788309678.947654:0:24229:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788309678.947655:0:24229:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788309678.947680:0:24229:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788309678.947699:0:24229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048162944:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788309678.947767:0:24229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309678.947949:0:24229:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc342c240 going to sleep for 11 seconds 00000100:00100000:3.0:1788309678.949151:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048162944 00000100:00100000:3.0:1788309678.949162:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048162944 00000100:00100000:3.0:1788309678.949251:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788309678.949263:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:24229:x1875178048162944:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788309678.949305:0:22719:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788309678.949308:0:22719:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788309678.949323:0:22719:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788309678.949946:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:24229:x1875178048162944:12345-0@lo:253:mount.lustre.0 Request processed in 684us (2177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309678.949955:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788309678.950070:0:24229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048162944:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788309678.950083:0:24229:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788309678.950086:0:24229:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788309678.950087:0:24229:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788309678.950089:0:24229:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788309678.950090:0:24229:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788309678.950091:0:24229:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788309678.950092:0:24229:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788309678.950094:0:24229:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788309678.950096:0:24229:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788309678.950097:0:24229:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788309678.950118:0:24229:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c30f9a31000 from lustre-OST0000 10000000:01000000:2.0:1788309678.950143:0:24229:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788309678.950146:0:24229:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788309678.950154:0:24229:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c2fc23bb370 local copy 00010000:00010000:2.0:1788309678.950164:0:24229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1512200/0x98c38120c44af409 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af410 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309678.950275:0:24229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048163072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788309678.950337:0:24229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309678.950887:0:24229:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc342c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309678.951110:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048163072 00000100:00100000:0.0:1788309678.951117:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048163072 00000100:00100000:0.0:1788309678.951151:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788309678.951160:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc36ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:24229:x1875178048163072:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788309678.951250:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc36ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:24229:x1875178048163072:12345-0@lo:501:mount.lustre.0 Request processed in 91us (913us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788309678.951257:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788309678.951404:0:24229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048163072:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788309678.951420:0:24229:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788309678.951441:0:24229:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788309678.951448:0:24229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1512200/0x98c38120c44af409 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af410 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309678.951457:0:24229:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30c1512200/0x98c38120c44af409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af410 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309678.951483:0:24229:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c30f9a31000 10000000:01000000:2.0:1788309678.951487:0:24229:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788309678.951492:0:24229:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788309678.951494:0:24229:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788309678.951498:0:24229:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788309678.951501:0:24229:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788309678.951524:0:24229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30edf5ba00/0x98c38120c44af65c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309678.951531:0:24229:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c30edf5ba00/0x98c38120c44af65c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309678.951539:0:24229:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c30edf5ba00/0x98c38120c44af65c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309678.951554:0:24229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048163200:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788309678.951585:0:24229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309678.951625:0:24229:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc342c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309678.952150:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048163200 00000100:00100000:0.0:1788309678.952163:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048163200 00000100:00100000:0.0:1788309678.952190:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788309678.952197:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc36ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+18:24229:x1875178048163200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788309678.952207:0:22720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309678.952219:0:22720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30c1513c00/0x98c38120c44af663 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af65c expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309678.952240:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30c1513c00/0x98c38120c44af663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af65c expref: 19 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309678.952250:0:22720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30c1513c00/0x98c38120c44af663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af65c expref: 19 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309678.952259:0:22720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30c1513c00, rc 0) 00000100:00100000:0.0:1788309678.952316:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc36ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+19:24229:x1875178048163200:12345-0@lo:101:mount.lustre.0 Request processed in 118us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309678.952322:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788309678.952612:0:24229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048163200:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788309678.952627:0:24229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c30edf5ba00/0x98c38120c44af65c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af663 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309678.952636:0:24229:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c30edf5ba00/0x98c38120c44af65c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af663 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788309678.953969:0:24229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1788309678.954790:0:24229:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788309678.961205:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788309678.961262:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788309678.961278:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788309678.961541:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788309678.961557:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788309678.961570:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788309678.961584:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788309678.961594:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788309678.961606:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1788309678.961620:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1788309678.961634:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1788309678.961647:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1788309678.961675:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1788309678.961681:0:24229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1788309678.961782:0:24229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048163328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788309678.961890:0:24229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309678.961938:0:24229:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc342c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788309678.962036:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048163328 00000100:00100000:3.0:1788309678.962043:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048163328 00000100:00100000:3.0:1788309678.962086:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788309678.962095:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc36ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+19:24229:x1875178048163328:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788309678.962236:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc36ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+19:24229:x1875178048163328:12345-0@lo:501:mount.lustre.0 Request processed in 141us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309678.962244:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788309678.962623:0:24229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048163328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788309678.962656:0:24229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048163456:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788309678.962707:0:24229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309678.962734:0:24229:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc342c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788309678.962809:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048163456 00000100:00100000:0.0:1788309678.962825:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048163456 00000100:00100000:0.0:1788309678.962891:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788309678.962899:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f613a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+19:24229:x1875178048163456:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788309678.963732:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f613a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+19:24229:x1875178048163456:12345-0@lo:503:mount.lustre.0 Request processed in 831us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309678.963740:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788309678.963815:0:24229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048163456:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788309678.964199:0:24229:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788309678.964270:0:24229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048163584:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788309678.964479:0:24229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309678.964515:0:24229:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc342c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788309678.964675:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048163584 00000100:00100000:3.0:1788309678.964681:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048163584 00000100:00100000:3.0:1788309678.964718:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788309678.964726:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f6139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+19:24229:x1875178048163584:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788309678.965184:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f6139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+19:24229:x1875178048163584:12345-0@lo:502:mount.lustre.0 Request processed in 457us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309678.965192:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788309678.965280:0:24229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048163584:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788309678.965559:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788309678.965583:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788309678.965594:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788309678.965605:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788309678.965616:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788309678.965627:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788309678.965638:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788309678.965648:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788309678.965658:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1788309678.965669:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1788309678.965680:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1788309678.965691:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1788309678.965715:0:24229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048163712:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788309678.965751:0:24229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309678.965784:0:24229:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc342c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309678.965879:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048163712 00000100:00100000:0.0:1788309678.965885:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048163712 00000100:00100000:0.0:1788309678.965916:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788309678.965923:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f6139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+19:24229:x1875178048163712:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788309678.966142:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f6139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+19:24229:x1875178048163712:12345-0@lo:502:mount.lustre.0 Request processed in 219us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309678.966149:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788309678.966279:0:24229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048163712:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788309678.966472:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1788309678.966482:0:24229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1788309678.967456:0:24246:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788309678.967465:0:24246:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788309678.967472:0:24246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309678.967474:0:24246:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788309678.967479:0:24246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788309678.967494:0:24246:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8c30ed8c99b8) 00000020:00000080:0.0:1788309678.967516:0:24246:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788309678.967520:0:24246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788309678.967581:0:24246:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c30f9a31000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788309678.967588:0:24246:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788309678.967594:0:24246:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x98c38120c44af671 00010000:00010000:0.0:1788309678.972687:0:24246:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1788309678.973445:0:24246:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:0.0:1788309678.975079:0:24246:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788309678.980483:0:24246:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788309678.980495:0:24246:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788309678.980502:0:24246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309678.980504:0:24246:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788309678.980513:0:24246:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788309678.980515:0:24246:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1788309678.980517:0:24246:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788309678.980518:0:24246:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788309678.980520:0:24246:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788309678.980523:0:24246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309678.980524:0:24246:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788309678.980526:0:24246:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788309678.980543:0:24246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309678.980544:0:24246:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788309678.980549:0:24246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788309678.980551:0:24246:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788309678.980553:0:24246:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788309678.980555:0:24246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309678.980557:0:24246:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788309678.980559:0:24246:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788309678.980562:0:24246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309678.980563:0:24246:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788309678.980566:0:24246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788309678.980602:0:24246:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788309678.980606:0:24246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309678.980607:0:24246:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788309678.980611:0:24246:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1788309678.980903:0:24229:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788309678.980929:0:24229:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788309678.980946:0:24229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30edf5ba00/0x98c38120c44af65c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af663 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309678.980957:0:24229:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30edf5ba00/0x98c38120c44af65c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af663 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309678.980964:0:24229:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c30f9a31000 from 1 10000000:01000000:0.0:1788309678.980976:0:24229:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788309678.981017:0:24229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af678 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309678.981036:0:24229:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af678 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309678.981049:0:24229:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af678 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309678.981073:0:24229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048163840:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788309678.981138:0:24229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309678.981174:0:24229:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f526db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788309678.985160:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048163840 00000100:00100000:3.0:1788309678.985171:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048163840 00000100:00100000:3.0:1788309678.985222:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788309678.985231:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f613bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+19:24229:x1875178048163840:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788309678.985246:0:22720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309678.985262:0:22720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30c83dbe00/0x98c38120c44af67f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af678 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309678.985287:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30c83dbe00/0x98c38120c44af67f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af678 expref: 20 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309678.985297:0:22720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30c83dbe00/0x98c38120c44af67f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af678 expref: 20 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309678.985307:0:22720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30c83dbe00, rc 0) 00000100:00100000:3.0:1788309678.985370:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f613bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+20:24229:x1875178048163840:12345-0@lo:101:mount.lustre.0 Request processed in 141us (4232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309678.985387:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788309678.986133:0:24229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048163840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788309678.986160:0:24229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af678 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af67f expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309678.986171:0:24229:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af678 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af67f expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788309678.988605:0:24229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1788309678.989099:0:24229:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788309678.992603:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788309678.992654:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788309678.992671:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788309678.992684:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788309678.992698:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788309678.992712:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788309678.992726:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788309678.992739:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788309678.992753:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788309678.992766:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1788309678.992779:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1788309678.992801:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1788309678.992806:0:24229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1788309678.993977:0:24229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048163968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788309678.994045:0:24229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309678.994083:0:24229:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc342c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788309678.994467:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048163968 00000100:00100000:3.0:1788309678.994474:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048163968 00000100:00100000:3.0:1788309678.994521:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788309678.994529:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f6138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+20:24229:x1875178048163968:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788309678.994655:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f6138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+20:24229:x1875178048163968:12345-0@lo:501:mount.lustre.0 Request processed in 127us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309678.994663:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788309678.996363:0:24229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048163968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788309678.996424:0:24229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048164096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788309678.996485:0:24229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309678.996528:0:24229:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc342c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309678.997135:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048164096 00000100:00100000:1.0:1788309678.997142:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048164096 00000100:00100000:1.0:1788309678.997193:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788309678.997203:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f613b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+20:24229:x1875178048164096:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788309678.997329:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f613b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+20:24229:x1875178048164096:12345-0@lo:503:mount.lustre.0 Request processed in 127us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309678.997337:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788309678.999177:0:24229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048164096:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788309679.001300:0:24229:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788309679.001999:0:24229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048164224:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788309679.002356:0:24229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309679.003250:0:24229:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc342c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788309679.004600:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048164224 00000100:00100000:1.0:1788309679.004610:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048164224 00000100:00100000:2.0:1788309679.004763:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788309679.004774:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f6138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+20:24229:x1875178048164224:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788309679.004984:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f6138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+20:24229:x1875178048164224:12345-0@lo:502:mount.lustre.0 Request processed in 212us (2627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309679.004992:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788309679.005100:0:24229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048164224:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788309679.005357:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788309679.005620:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788309679.005638:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788309679.005650:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788309679.005662:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788309679.005675:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788309679.005689:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788309679.005702:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1788309679.005728:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788309679.005745:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1788309679.005759:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1788309679.005795:0:24229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048164352:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788309679.005886:0:24229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309679.007478:0:24229:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc23e53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309679.008000:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048164352 00000100:00100000:0.0:1788309679.008017:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048164352 00000100:00100000:0.0:1788309679.008062:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788309679.008070:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f6139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+20:24229:x1875178048164352:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788309679.008207:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f6139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+20:24229:x1875178048164352:12345-0@lo:502:mount.lustre.0 Request processed in 137us (2320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309679.008214:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788309679.008294:0:24229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048164352:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788309679.008359:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1788309679.008381:0:24229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788309679.009137:0:24250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788309679.009159:0:24250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309679.009161:0:24250:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788309679.009167:0:24250:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c30f9a31000 00000020:00000080:3.0:1788309679.009169:0:24250:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788309679.009176:0:24250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788309679.009178:0:24250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309679.009179:0:24250:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788309679.009181:0:24250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788309679.009184:0:24250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309679.009185:0:24250:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788309679.009188:0:24250:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c30f9a31000 00000020:00000080:3.0:1788309679.009190:0:24250:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788309679.009241:0:24250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788309679.009244:0:24250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309679.009245:0:24250:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788309679.009247:0:24250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788309679.009250:0:24250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309679.009251:0:24250:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788309679.009254:0:24250:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c30f9a31000 00000020:00000080:3.0:1788309679.009256:0:24250:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788309679.009270:0:24250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788309679.009272:0:24250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309679.009273:0:24250:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788309679.009275:0:24250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788309679.009277:0:24250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309679.009278:0:24250:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788309679.009282:0:24250:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c30f9a31000 00000020:00000080:3.0:1788309679.009283:0:24250:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788309679.009301:0:24250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788309679.009303:0:24250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788309679.009304:0:24250:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788309679.009307:0:24250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1788309679.011953:0:24229:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788309679.011995:0:24229:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788309679.012025:0:24229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af678 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af67f expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309679.012039:0:24229:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af678 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af67f expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309679.012104:0:24229:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788309679.012108:0:24229:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c30f9a31000 10000000:01000000:2.0:1788309679.012111:0:24229:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c30f9a31000 10000000:01000000:2.0:1788309679.012114:0:24229:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788309679.012120:0:24229:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c30f9a31000 from 1 10000000:01000000:2.0:1788309679.012122:0:24229:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788309679.012158:0:24229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b800/0x98c38120c44af686 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309679.012166:0:24229:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b800/0x98c38120c44af686 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309679.012190:0:24229:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b800/0x98c38120c44af686 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309679.012212:0:24229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048164480:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788309679.012277:0:24229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309679.012314:0:24229:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc342cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788309679.017960:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048164480 00000100:00100000:1.0:1788309679.017975:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048164480 00000100:00100000:1.0:1788309679.018051:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788309679.018062:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f6139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+20:24229:x1875178048164480:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788309679.018078:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309679.018101:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c2fc35f1200/0x98c38120c44af68d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af686 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.018128:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c2fc35f1200/0x98c38120c44af68d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af686 expref: 21 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.018138:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c2fc35f1200/0x98c38120c44af68d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af686 expref: 21 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.018147:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c2fc35f1200, rc 0) 00000100:00100000:1.0:1788309679.031082:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f6139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:24229:x1875178048164480:12345-0@lo:101:mount.lustre.0 Request processed in 13013us (18796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309679.031096:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788309679.031361:0:24229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048164480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788309679.031391:0:24229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b800/0x98c38120c44af686 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af68d expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309679.031404:0:24229:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b800/0x98c38120c44af686 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af68d expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788309679.033658:0:24229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1788309679.033968:0:24229:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788309679.034316:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788309679.034341:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788309679.034355:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788309679.034366:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788309679.034379:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788309679.034391:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788309679.034403:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788309679.034415:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788309679.034426:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788309679.034437:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788309679.034448:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788309679.034459:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788309679.034472:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788309679.034485:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788309679.035170:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788309679.035193:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788309679.035208:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788309679.035221:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788309679.035236:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788309679.035249:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788309679.035260:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788309679.035273:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788309679.035289:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788309679.035303:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788309679.035317:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1788309679.035331:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1788309679.035345:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1788309679.035359:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1788309679.035373:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1788309679.035387:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1788309679.035417:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1788309679.035434:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1788309679.035448:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1788309679.035462:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1788309679.035476:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1788309679.035490:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1788309679.036279:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1788309679.036320:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1788309679.036334:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1788309679.036345:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1788309679.036356:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1788309679.036368:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1788309679.036379:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1788309679.036391:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1788309679.036403:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1788309679.036415:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1788309679.036441:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1788309679.036463:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1788309679.036623:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1788309679.036644:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1788309679.036662:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1788309679.036667:0:24229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1788309679.036763:0:24229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048164608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788309679.036831:0:24229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309679.036909:0:24229:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2335180 going to sleep for 11 seconds 00000100:00100000:3.0:1788309679.039066:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048164608 00000100:00100000:3.0:1788309679.039079:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048164608 00000100:00100000:3.0:1788309679.039161:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788309679.039170:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f6138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:24229:x1875178048164608:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788309679.039353:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f6138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:24229:x1875178048164608:12345-0@lo:501:mount.lustre.0 Request processed in 183us (2521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309679.039363:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788309679.041700:0:24229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048164608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788309679.041759:0:24229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048164736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788309679.041821:0:24229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309679.041882:0:24229:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2335180 going to sleep for 11 seconds 00000100:00100000:1.0:1788309679.042071:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048164736 00000100:00100000:1.0:1788309679.042078:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048164736 00000100:00100000:1.0:1788309679.042136:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788309679.042146:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f6138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:24229:x1875178048164736:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788309679.042261:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f6138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:24229:x1875178048164736:12345-0@lo:503:mount.lustre.0 Request processed in 116us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309679.042269:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788309679.042618:0:24229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048164736:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788309679.043075:0:24229:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788309679.043144:0:24229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048164864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788309679.043192:0:24229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309679.043218:0:24229:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2335f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788309679.043355:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048164864 00000100:00100000:1.0:1788309679.043361:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048164864 00000100:00100000:1.0:1788309679.043404:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788309679.043411:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f613ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:24229:x1875178048164864:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788309679.043496:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f613ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:24229:x1875178048164864:12345-0@lo:502:mount.lustre.0 Request processed in 84us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309679.043503:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788309679.043948:0:24229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048164864:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788309679.044216:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788309679.044247:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1788309679.044264:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1788309679.044282:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1788309679.044299:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1788309679.044315:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1788309679.044332:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1788309679.044348:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1788309679.044379:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788309679.044405:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1788309679.044421:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1788309679.044438:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1788309679.044454:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1788309679.044470:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1788309679.044487:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1788309679.045203:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1788309679.045287:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1788309679.045308:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1788309679.045326:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1788309679.045344:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1788309679.045362:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1788309679.045380:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1788309679.045396:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1788309679.045410:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1788309679.045440:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1788309679.045456:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1788309679.045467:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1788309679.045478:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1788309679.045491:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1788309679.046183:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1788309679.046216:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1788309679.046230:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1788309679.046246:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1788309679.046263:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1788309679.046280:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1788309679.046294:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1788309679.046305:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1788309679.046317:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1788309679.046328:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1788309679.046343:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1788309679.046369:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1788309679.046383:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1788309679.046403:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1788309679.046415:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1788309679.046427:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1788309679.046439:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1788309679.046451:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1788309679.046464:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1788309679.047105:0:24229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048164992:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788309679.047186:0:24229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309679.047227:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048164992 00000100:00100000:2.0:1788309679.047234:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048164992 00000100:00100000:2.0:1788309679.047282:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788309679.047291:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f613b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:24229:x1875178048164992:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788309679.047402:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f613b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:24229:x1875178048164992:12345-0@lo:502:mount.lustre.0 Request processed in 111us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309679.047409:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788309679.047459:0:24229:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2335f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788309679.047480:0:24229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048164992:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788309679.048786:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1788309679.048819:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1788309679.049117:0:24229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048165120:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788309679.049184:0:24229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309679.049213:0:24229:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2335f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788309679.049429:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048165120 00000100:00100000:1.0:1788309679.049443:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048165120 00000100:00100000:1.0:1788309679.049488:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788309679.049497:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f613b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:24229:x1875178048165120:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788309679.049603:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f613b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:24229:x1875178048165120:12345-0@lo:502:mount.lustre.0 Request processed in 107us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309679.049610:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788309679.049619:0:24229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048165120:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788309679.049661:0:24229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1788309679.049670:0:24229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788309679.053132:0:24255:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788309679.053151:0:24255:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8c31012619b8) 00000020:00000080:2.0:1788309679.053185:0:24255:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1788309679.053280:0:24255:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c30f9a31000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788309679.053284:0:24255:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c30f9a31000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788309679.053287:0:24255:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c30f9a31000 3 00010000:00080000:2.0:1788309679.053314:0:24255:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c2fc4304000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.132@tcp at head 00010000:00010000:2.0:1788309679.059100:0:24255:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1788309679.059287:0:24255:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788309679.059328:0:24255:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788309679.059341:0:24255:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x98c38120c44af69b 00000100:00080000:2.0:1788309679.059351:0:24255:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788309679.059357:0:24255:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c2fc4304000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:2.0:1788309679.059389:0:24255:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30d3b05500 x1875178048165248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788309679.059428:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1875178048165248:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788309679.059496:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788309679.061124:0:24255:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788309679.061201:0:468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788309679.061206:0:468:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788309679.061208:0:468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788309679.061211:0:468:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788309679.061225:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875178048165376:0@lo:400:kworker.0 00000100:00080000:0.0:1788309679.061235:0:468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788309679.061238:0:468:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788309679.061240:0:468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788309679.061243:0:468:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788309679.061273:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309679.061296:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788309679.061302:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875178048165760:0@lo:400:kworker.0 00000100:00100000:2.0:1788309679.061338:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309679.062563:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048165376 00000100:00100000:3.0:1788309679.062574:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048165376 00000100:00100000:3.0:1788309679.062619:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788309679.062628:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d3b06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875178048165376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309679.062696:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d3b06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875178048165376:12345-0@lo:400:kworker.0 Request processed in 69us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309679.062703:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788309679.063779:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048165632:0@lo:400:kworker.0 00000100:00100000:3.0:1788309679.065277:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309679.065333:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788309679.065343:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875178048165504:0@lo:400:kworker.0 00000100:00100000:3.0:1788309679.065407:0:23468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048165632 00000100:00100000:3.0:1788309679.065417:0:23468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048165632 00000100:00100000:3.0:1788309679.065458:0:23468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788309679.065466:0:23468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c30cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048165632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309679.065613:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875178048165376:0@lo:400:kworker.0 00000100:00100000:1.0:1788309679.065727:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048165248 00000100:00100000:1.0:1788309679.065732:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048165248 00000100:00100000:1.0:1788309679.065766:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048165760 00000100:00100000:1.0:1788309679.065769:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048165760 00000100:00100000:1.0:1788309679.065788:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788309679.065795:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d3b06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875178048165760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309679.065876:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d3b06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875178048165760:12345-0@lo:400:kworker.0 Request processed in 80us (4536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309679.065883:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788309679.065901:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788309679.065904:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d3b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1875178048165248:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788309679.065926:0:22729:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 589 last 0 00000020:00000080:1.0:1788309679.065954:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x98c38120c44af6a2 00000004:00100000:1.0:1788309679.065967:0:22729:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788309679.065994:0:22729:0:(import.c:65:import_set_state_nolock()) ffff8c30fc527800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788309679.066035:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d3b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875178048165248:12345-0@lo:38:llog_process_th.0 Request processed in 128us (6538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309679.066042:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788309679.066077:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c30d3b05500 x1875178048165248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788309689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309679.066087:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788309679.066107:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788309679.066115:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788309679.066120:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788309679.066123:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c2fc4304000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788309679.066129:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1875178048165248:0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788309679.066158:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c2fc414c380 x1875178048165760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309679.066166:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875178048165760:0@lo:400:kworker.0 00000100:00100000:3.0:1788309679.066965:0:23468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c30cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048165632:12345-0@lo:400:kworker.0 Request processed in 1497us (1690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309679.066974:0:23468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788309679.067009:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309679.067041:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048165632:0@lo:400:kworker.0 00000100:00100000:1.0:1788309679.068623:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048165504 00000100:00100000:1.0:1788309679.068636:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048165504 00000100:00100000:1.0:1788309679.068690:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788309679.068698:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c30ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875178048165504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309679.068771:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c30ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875178048165504:12345-0@lo:400:kworker.0 Request processed in 74us (1761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309679.068777:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788309679.068816:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c2fc414c000 x1875178048165504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309679.068830:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875178048165504:0@lo:400:kworker.0 00000020:01000004:2.0:1788309679.069292:0:24255:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788309679.069310:0:24255:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8c30f0d84d28) 00000020:00000080:2.0:1788309679.069333:0:24255:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788309679.069405:0:24255:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c30f9a31000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788309679.069409:0:24255:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c30f9a31000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788309679.069421:0:24255:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c30f9a31000 3 00010000:00080000:2.0:1788309679.069447:0:24255:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c2fc4300000@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.132@tcp at head 00010000:00010000:2.0:1788309679.074996:0:24255:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1788309679.075190:0:24255:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788309679.075234:0:24255:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788309679.075246:0:24255:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x98c38120c44af6b0 00000100:00080000:2.0:1788309679.075255:0:24255:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788309679.075260:0:24255:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8c2fc4300000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:2.0:1788309679.075293:0:24255:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30d3b04700 x1875178048165888/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788309679.075313:0:24255:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788309679.077217:0:468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788309679.077225:0:468:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788309679.077228:0:468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788309679.077231:0:468:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788309679.077235:0:468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788309679.077237:0:468:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788309679.077240:0:468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788309679.077243:0:468:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788309679.078288:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1875178048165888:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788309679.078363:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309679.078678:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048165888 00000100:00100000:0.0:1788309679.078686:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048165888 00000100:00100000:0.0:1788309679.078725:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788309679.078734:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1875178048165888:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788309679.078761:0:22728:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 589 last 0 00000020:00000080:0.0:1788309679.078792:0:22728:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x98c38120c44af6b7 00000004:00100000:0.0:1788309679.078806:0:22728:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788309679.078874:0:22728:0:(import.c:65:import_set_state_nolock()) ffff8c2fc35aa800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788309679.078929:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875178048165888:12345-0@lo:38:llog_process_th.0 Request processed in 194us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309679.078936:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788309679.078975:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c30d3b04700 x1875178048165888/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788309689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309679.078986:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788309679.078994:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1788309679.079012:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788309679.079016:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788309679.079019:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c2fc4300000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788309679.079025:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1875178048165888:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788309679.085315:0:24255:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1788309679.085389:0:24229:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788309679.085416:0:24229:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788309679.085429:0:24229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b800/0x98c38120c44af686 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af68d expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309679.085439:0:24229:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b800/0x98c38120c44af686 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af68d expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788309679.085478:0:24229:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788309679.085480:0:24229:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788309679.085482:0:24229:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788309679.085483:0:24229:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788309679.085484:0:24229:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788309679.085485:0:24229:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788309679.085487:0:24229:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788309679.085489:0:24229:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788309679.085490:0:24229:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788309679.085494:0:24229:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788309679.085497:0:24229:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788309679.085498:0:24229:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788309679.085499:0:24229:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788309679.085500:0:24229:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788309679.085500:0:24229:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788309679.085501:0:24229:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788309679.085502:0:24229:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788309679.085503:0:24229:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788309679.085504:0:24229:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788309679.085542:0:24229:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788309679.085561:0:24229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048166016:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788309679.085625:0:24229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309679.085660:0:24229:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc23e56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788309679.085682:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048166016 00000100:00100000:3.0:1788309679.085688:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048166016 00000100:00100000:3.0:1788309679.085730:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788309679.085738:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:24229:x1875178048166016:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788309679.085769:0:22720:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788309679.085779:0:22720:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:2.0:1788309679.091667:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1788309679.106939:0:22720:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788309679.106964:0:22720:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788309679.107403:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:24229:x1875178048166016:12345-0@lo:253:mount.lustre.0 Request processed in 21660us (21772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309679.107415:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 20000000:01000000:1.0:1788309679.107439:0:22744:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788309679.107444:0:22744:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788309679.107462:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c2fc35f1a00/0x98c38120c44af6be lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.107494:0:22744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c30edf5be00/0x98c38120c44af608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af601 expref: 20 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.107502:0:22744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c30c1512a00/0x98c38120c44af616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af60f expref: 20 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.107509:0:22744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c2fc35f1a00/0x98c38120c44af6be lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.107545:0:22744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c30c1512a00/0x98c38120c44af616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x98c38120c44af60f expref: 20 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.107560:0:22744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c30c1512a00/0x98c38120c44af616 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x98c38120c44af60f expref: 20 pid: 22719 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309679.107573:0:22744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22744:1875178048166144:0@lo:104: 00000100:00100000:1.0:1788309679.107608:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788309679.107659:0:22744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c30edf5be00/0x98c38120c44af608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x98c38120c44af601 expref: 20 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309679.107662:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048166144 00010000:00010000:1.0:1788309679.107667:0:22744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c30edf5be00/0x98c38120c44af608 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x98c38120c44af601 expref: 20 pid: 22722 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309679.107669:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048166144 00000100:00100000:1.0:1788309679.107675:0:22744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22744:1875178048166272:0@lo:104: 00000100:00100000:1.0:1788309679.107697:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309679.107707:0:22710:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788309679.107707:0:22744:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30edf11c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788309679.107715:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048166272 00000100:00100000:2.0:1788309679.107718:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048166272 00000100:00100000:2.0:1788309679.107732:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788309679.107739:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+4:22744:x1875178048166144:12345-0@lo:104: 00010000:00010000:2.0:1788309679.107751:0:22710:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1600/0x98c38120c44af60f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af616 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309679.107803:0:22710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788309679.107808:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+4:22744:x1875178048166144:12345-0@lo:104: Request processed in 70us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309679.107821:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788309679.107834:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788309679.107875:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d8197c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+3:22744:x1875178048166272:12345-0@lo:104: 00010000:00010000:2.0:1788309679.107884:0:22710:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44af601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af608 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309679.107917:0:22710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788309679.107917:0:22744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22744:1875178048166144:0@lo:104: 00000100:00100000:2.0:1788309679.107922:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d8197c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+3:22744:x1875178048166272:12345-0@lo:104: Request processed in 50us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309679.107926:0:22744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22744:1875178048166272:0@lo:104: 00000100:00100000:2.0:1788309679.107928:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788309679.107947:0:22744:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c2fc35f1a00/0x98c38120c44af6be lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.107961:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788309679.107966:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1600/0x98c38120c44af60f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af616 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.107974:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc35f1600 already unused, calling callback (ffffffffc1507c20) 10000000:00010000:1.0:1788309679.107977:0:22715:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1600/0x98c38120c44af60f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x98c38120c44af616 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.107986:0:22715:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1600/0x98c38120c44af60f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x98c38120c44af616 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788309679.107993:0:22715:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1600/0x98c38120c44af60f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x98c38120c44af616 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309679.107999:0:22715:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788309679.108031:0:22715:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1600/0x98c38120c44af60f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af616 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.108038:0:22715:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788309679.108056:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1600/0x98c38120c44af60f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af616 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.108063:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1600/0x98c38120c44af60f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af616 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.108075:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788309679.108078:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44af601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af608 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.108094:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc35f0c00 already unused, calling callback (ffffffffc1507c20) 10000000:00010000:1.0:1788309679.108097:0:22715:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44af601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x98c38120c44af608 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.108103:0:22715:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44af601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x98c38120c44af608 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788309679.108110:0:22715:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44af601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x98c38120c44af608 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309679.108115:0:22715:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788309679.108140:0:22715:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44af601 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af608 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.108146:0:22715:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788309679.108161:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44af601 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af608 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.108167:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44af601 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af608 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.108181:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309679.108182:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309679.108184:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309679.108194:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3618:1875178048166400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309679.108221:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309679.108264:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3619:1875178048166528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309679.108288:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309679.108291:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048166400 00000100:00100000:2.0:1788309679.108295:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048166400 00010000:00010000:2.0:1788309679.108310:0:22712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c30c1512a00/0x98c38120c44af616 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af60f expref: 21 pid: 22719 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309679.108325:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048166528 00000100:00100000:1.0:1788309679.108328:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048166528 00000100:00100000:2.0:1788309679.108329:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788309679.108334:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+22:3618:x1875178048166400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788309679.108339:0:22713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c30edf5be00/0x98c38120c44af608 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af601 expref: 22 pid: 22722 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309679.108343:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309679.108347:0:22712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c30c1512a00/0x98c38120c44af616 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af60f expref: 22 pid: 22719 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309679.108350:0:22713:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1788309679.108357:0:22712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c30c1512a00/0x98c38120c44af616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x98c38120c44af60f expref: 22 pid: 22719 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309679.108365:0:22713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1788309679.108368:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30c1512a00/0x98c38120c44af616 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x98c38120c44af60f expref: 22 pid: 22719 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309679.108378:0:22714:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1788309679.108379:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309679.108387:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788309679.108394:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8197850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:3619:x1875178048166528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788309679.108401:0:22714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309679.108406:0:22714:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c30edf5be00/0x98c38120c44af608 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af601 expref: 21 pid: 22722 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309679.108409:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:3618:x1875178048166400:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309679.108416:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788309679.108416:0:22714:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c30edf5be00/0x98c38120c44af608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x98c38120c44af601 expref: 21 pid: 22722 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.108426:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30edf5be00/0x98c38120c44af608 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x98c38120c44af601 expref: 20 pid: 22722 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.108435:0:22714:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c2fc35f1a00/0x98c38120c44af6be lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.108442:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c2fc35f1a00/0x98c38120c44af6be lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788309679.108454:0:22714:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001208149s 00010000:00010000:1.0:1788309679.108458:0:22714:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c2fc35f1a00/0x98c38120c44af6be lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.108464:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c2fc35f1a00/0x98c38120c44af6be lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.108480:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c2fc35f1a00/0x98c38120c44af6be lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.108486:0:22714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c2fc35f1a00/0x98c38120c44af6be lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.108492:0:22714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc35f1a00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:1.0:1788309679.108495:0:22714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c2fc35f1a00/0x98c38120c44af6be lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.108502:0:22714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c2fc35f1a00/0x98c38120c44af6be lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.108523:0:22714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c2fc35f1a00/0x98c38120c44af6be lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309679.108532:0:22714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309679.108560:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8197850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+19:3619:x1875178048166528:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309679.108566:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788309679.108580:0:22744:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c2fc35f1a00/0x98c38120c44af6be lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309679.108587:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c2fc35f1a00/0x98c38120c44af6be lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309679.108594:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c2fc35f1a00/0x98c38120c44af6be lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309679.108705:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3619:1875178048166528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309679.108722:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3618:1875178048166400:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788309679.109960:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309679.109995:0:24229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:24229:1875178048166016:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788309679.110011:0:24229:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788309679.110015:0:24229:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788309679.110016:0:24229:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788309679.110017:0:24229:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788309679.110019:0:24229:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788309679.110020:0:24229:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788309679.110021:0:24229:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788309679.110023:0:24229:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788309679.110025:0:24229:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788309679.110026:0:24229:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788309679.110039:0:24229:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1788309679.115101:0:24229:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1788309679.120318:0:24229:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788309679.120327:0:24229:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788309679.120365:0:24229:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788309679.120412:0:24229:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.132@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788309679.120431:0:24229:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788309679.120461:0:24229:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788309679.121113:0:24229:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788309679.121301:0:24229:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1788309679.928890:0:24309:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788309679.929092:0:24309:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788309680.106041:0:3616:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788309664/real 1788309664] req@ffff8c30fba9fb80 x1875178048153600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788309679 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309680.106075:0:3616:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c30fba9fb80 x1875178048153600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788309679 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309680.106085:0:3616:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788309664/real 1788309664] req@ffff8c30fba9c380 x1875178048153728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788309679 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309680.106096:0:3616:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c30fba9c380 x1875178048153728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788309679 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788309680.106114:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c31011f6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788309680.106135:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788309680.106139:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048153600:0@lo:8:kworker.0 00000100:00080000:2.0:1788309680.106144:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30f9a1b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788309680.106149:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788309680.106170:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048153728:0@lo:8:kworker.0 00000100:00080000:0.0:1788309680.106660:0:468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788309680.106665:0:468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788309680.106668:0:468:0:(import.c:65:import_set_state_nolock()) ffff8c31011f6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788309680.106674:0:468:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 574 00000100:00080000:0.0:1788309680.106679:0:468:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788309680.106684:0:468:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c31011f6800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:0.0:1788309680.106703:0:468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c2fc414df80 x1875178048166912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788309680.106725:0:468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788309680.106728:0:468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788309680.106729:0:468:0:(import.c:65:import_set_state_nolock()) ffff8c30f9a1b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788309680.106732:0:468:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 574 00000100:00080000:0.0:1788309680.106735:0:468:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788309680.106738:0:468:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c30f9a1b800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:0.0:1788309680.106751:0:468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c2fc414d180 x1875178048167040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788309680.106769:0:468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788309680.106772:0:468:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788309680.106774:0:468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788309680.106777:0:468:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788309680.106807:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048166912:0@lo:8:kworker.0 00000100:00100000:0.0:1788309680.106901:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309680.106942:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048167040:0@lo:8:kworker.0 00000100:00100000:0.0:1788309680.106964:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309680.107109:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875178048167296:0@lo:400:kworker.0 00000100:00100000:3.0:1788309680.107140:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309680.107170:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788309680.107175:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3619:1875178048166656:0@lo:400:kworker.0 00000100:00100000:3.0:1788309680.107201:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309680.107215:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875178048167424:0@lo:400:kworker.0 00000100:00100000:3.0:1788309680.107236:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309680.107299:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048167424 00000100:00100000:3.0:1788309680.107306:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048167424 00000100:00100000:3.0:1788309680.107345:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788309680.107354:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c30c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875178048167424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309680.107401:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c30c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875178048167424:12345-0@lo:400:kworker.0 Request processed in 47us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309680.107408:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788309680.107429:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1788309680.107455:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c2fc414ce00 x1875178048167424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309680.107468:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875178048167424:0@lo:400:kworker.0 00000100:00100000:0.0:1788309680.107526:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048167296 00000100:00100000:0.0:1788309680.107530:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048167296 00000100:00100000:0.0:1788309680.107568:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788309680.107575:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c30caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875178048167296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309680.107612:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c30caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875178048167296:12345-0@lo:400:kworker.0 Request processed in 38us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309680.107618:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788309680.107734:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875178048167296:0@lo:400:kworker.0 00000100:00100000:1.0:1788309680.108597:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875178048166784:0@lo:400:kworker.0 00000100:00100000:1.0:1788309680.108760:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309680.109059:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048166912 00000100:00100000:0.0:1788309680.109065:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048166912 00000100:00100000:0.0:1788309680.109096:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048167040 00000100:00100000:0.0:1788309680.109099:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048167040 00000100:00100000:0.0:1788309680.109111:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788309680.109117:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1875178048166912:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788309680.109144:0:24234:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 590 last 0 00000020:00000080:0.0:1788309680.109169:0:24234:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x98c38120c44af6c5 00002000:00100000:0.0:1788309680.109182:0:24234:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8c2fc35a9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788309680.109185:0:24234:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788309680.109188:0:24234:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788309680.109374:0:24234:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788309680.109401:0:24234:0:(import.c:65:import_set_state_nolock()) ffff8c2fc35ac000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788309680.109459:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3616:x1875178048166912:12345-0@lo:8:kworker.0 Request processed in 341us (2557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309680.109466:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788309680.109480:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788309680.109484:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1875178048167040:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788309680.109494:0:24234:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788309680.109521:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1875178048167040:12345-0@lo:8:kworker.0 Request processed in 35us (2555us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788309680.109527:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788309680.109547:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875178048167168:0@lo:400:kworker.0 00000100:00100000:0.0:1788309680.109575:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309680.109599:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1875178048167680:0@lo:400:kworker.0 00000100:00100000:0.0:1788309680.109619:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309680.110071:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048167168 00000100:00100000:2.0:1788309680.110077:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048167168 00000100:00100000:2.0:1788309680.110110:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048167680 00000100:00100000:2.0:1788309680.110113:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048167680 00000100:00100000:2.0:1788309680.110137:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788309680.110144:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875178048167168:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788309680.110222:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788309680.110253:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c2fc414df80 x1875178048166912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788309700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309680.110263:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788309680.110272:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788309680.110279:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788309680.110285:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788309680.110287:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c31011f6800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788309680.110300:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788309680.110305:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048166912:0@lo:8:kworker.0 00000100:00080000:0.0:1788309680.110318:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30f9a1b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788309680.110322:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788309680.110326:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048167040:0@lo:8:kworker.0 00000100:00100000:3.0:1788309680.111474:0:23468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048166784 00000100:00100000:3.0:1788309680.111484:0:23468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048166784 00000100:00100000:3.0:1788309680.111530:0:23468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788309680.111551:0:23468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875178048166784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309680.113393:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875178048167552:0@lo:400:kworker.0 00000100:00100000:1.0:1788309680.113441:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309680.113505:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048166656 00000100:00100000:1.0:1788309680.113512:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048166656 00000100:00100000:1.0:1788309680.113557:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788309680.113565:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+19:3619:x1875178048166656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309680.113611:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+19:3619:x1875178048166656:12345-0@lo:400:kworker.0 Request processed in 47us (6409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309680.113617:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788309680.113635:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875178048167168:12345-0@lo:400:kworker.0 Request processed in 2801us (3369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309680.113647:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788309680.113651:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048167552 00000100:00100000:1.0:1788309680.113655:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048167552 00000100:00100000:2.0:1788309680.113687:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788309680.113697:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875178048167680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309680.113700:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788309680.113714:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875178048167552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309680.113749:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875178048167680:12345-0@lo:400:kworker.0 Request processed in 54us (4128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309680.113757:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788309680.113765:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875178048167552:12345-0@lo:400:kworker.0 Request processed in 53us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309680.113772:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788309680.113792:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1788309680.113817:0:22753:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00010000:00080000:1.0:1788309680.113832:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c2fc414c380 x1875178048167552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309680.113873:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875178048167552:0@lo:400:kworker.0 00000100:00100000:2.0:1788309680.113890:0:22753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b07800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22753:1875178048167936:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788309680.113926:0:22753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309680.113954:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2996780 going to sleep for 11 seconds 00000004:00080000:2.0:1788309680.113970:0:22752:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788309680.114068:0:22752:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 590183228011ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788309680.114075:0:22752:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788309680.114096:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788309680.114106:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875178048167808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788309680.114135:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309680.114197:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048167936 00000100:00100000:1.0:1788309680.114202:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048167936 00000100:00100000:1.0:1788309680.114240:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788309680.114247:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d3b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22753:x1875178048167936:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788309680.114767:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048167808 00000100:00100000:2.0:1788309680.114772:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048167808 00000100:00100000:2.0:1788309680.114810:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788309680.114816:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d3b04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1875178048167808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788309680.114832:0:24237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788309680.114911:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d3b04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1875178048167808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309680.114918:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788309680.114960:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c30d3b05f80 x1875178048167808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309696 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309680.114977:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875178048167808:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788309680.115138:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c2fc414d880 x1875178048167168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309680.115148:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875178048167168:0@lo:400:kworker.0 00010000:00080000:2.0:1788309680.115165:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c2fc414d500 x1875178048167680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309680.115174:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1875178048167680:0@lo:400:kworker.0 00000004:00080000:2.0:1788309680.116882:0:22707:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00080000:0.0:1788309680.117896:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788309680.118764:0:23468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875178048166784:12345-0@lo:400:kworker.0 Request processed in 7209us (9999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309680.118778:0:23468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788309680.118887:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3619:1875178048166656:0@lo:400:kworker.0 00000100:00100000:1.0:1788309680.119197:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875178048166784:0@lo:400:kworker.0 00002000:00080000:3.0:1788309680.119259:0:24234:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788309680.119267:0:24234:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:3.0:1788309680.119273:0:24234:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:65) 00002000:00010000:3.0:1788309680.130437:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788309680.130450:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6d3c1e6/0x98c38120c44af6cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.130469:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=590s v=(0 0) 00010000:00010000:3.0:1788309680.130473:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309680.130480:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6d3c1e6/0x98c38120c44af6cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.130499:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6d3c1e6/0x98c38120c44af6cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.130510:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6d3c1e6/0x98c38120c44af6cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.130517:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6d3c1e6/0x98c38120c44af6cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.130553:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788309680.130760:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309680.130768:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6d3c1e6/0x98c38120c44af6cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.130776:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30c83db000 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309680.130781:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6d3c1e6/0x98c38120c44af6cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.130790:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6d3c1e6/0x98c38120c44af6cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.130808:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6d3c1e6/0x98c38120c44af6cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.130826:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6d3c1e6/0x98c38120c44af6cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.130879:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.130881:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.130883:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309680.131007:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788309680.131013:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039bec57f/0x98c38120c44af6d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.131022:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=590s v=(0 0) 00010000:00010000:3.0:1788309680.131025:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309680.131030:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039bec57f/0x98c38120c44af6d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.131040:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039bec57f/0x98c38120c44af6d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.131049:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039bec57f/0x98c38120c44af6d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.131056:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039bec57f/0x98c38120c44af6d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.131231:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788309680.131496:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788309680.131503:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000693a1d52/0x98c38120c44af6da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.131511:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=590s v=(0 0) 00010000:00010000:3.0:1788309680.131520:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309680.131524:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000693a1d52/0x98c38120c44af6da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.131535:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000693a1d52/0x98c38120c44af6da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.131543:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000693a1d52/0x98c38120c44af6da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.131550:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000693a1d52/0x98c38120c44af6da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.131566:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788309680.131575:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788309680.131579:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039bec57f/0x98c38120c44af6d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.131586:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30c83da400 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:3.0:1788309680.131590:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039bec57f/0x98c38120c44af6d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.131596:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039bec57f/0x98c38120c44af6d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.131607:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039bec57f/0x98c38120c44af6d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.131625:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039bec57f/0x98c38120c44af6d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.131758:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309680.131764:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000693a1d52/0x98c38120c44af6da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.131771:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30c83da800 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309680.131775:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000693a1d52/0x98c38120c44af6da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.131781:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000693a1d52/0x98c38120c44af6da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.131791:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000693a1d52/0x98c38120c44af6da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.131797:0:23881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000693a1d52/0x98c38120c44af6da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.131811:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.131813:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.131814:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309680.131868:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309680.131871:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309680.131873:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309680.132644:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788309680.132651:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3dea176/0x98c38120c44af6e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.132663:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=590s v=(0 0) 00010000:00010000:3.0:1788309680.132667:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309680.132672:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3dea176/0x98c38120c44af6e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.132683:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3dea176/0x98c38120c44af6e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.132691:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3dea176/0x98c38120c44af6e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.132697:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3dea176/0x98c38120c44af6e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.132721:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788309680.132765:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309680.132771:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3dea176/0x98c38120c44af6e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.132779:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30c83db400 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309680.132783:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3dea176/0x98c38120c44af6e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.132790:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3dea176/0x98c38120c44af6e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.132803:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3dea176/0x98c38120c44af6e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.132811:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3dea176/0x98c38120c44af6e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.132828:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.132830:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.132831:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788309680.133113:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788309680.133125:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000117d2011/0x98c38120c44af6e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.133133:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=590s v=(0 0) 00010000:00010000:3.0:1788309680.133136:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309680.133141:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000117d2011/0x98c38120c44af6e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.133150:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000117d2011/0x98c38120c44af6e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.133159:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000117d2011/0x98c38120c44af6e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.133166:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000117d2011/0x98c38120c44af6e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.133234:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788309680.133497:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788309680.133504:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002032ff19/0x98c38120c44af6ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.133511:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=590s v=(0 0) 00010000:00010000:3.0:1788309680.133514:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309680.133517:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002032ff19/0x98c38120c44af6ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.133526:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002032ff19/0x98c38120c44af6ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.133541:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002032ff19/0x98c38120c44af6ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.133548:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002032ff19/0x98c38120c44af6ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.133686:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788309680.133692:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000117d2011/0x98c38120c44af6e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.133699:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30c83dac00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309680.133702:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000117d2011/0x98c38120c44af6e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.133720:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000117d2011/0x98c38120c44af6e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.133735:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000117d2011/0x98c38120c44af6e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.133747:0:23881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000117d2011/0x98c38120c44af6e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.133767:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309680.133769:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002032ff19/0x98c38120c44af6ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.133775:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30c83db600 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309680.133778:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002032ff19/0x98c38120c44af6ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.133784:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002032ff19/0x98c38120c44af6ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.133794:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002032ff19/0x98c38120c44af6ef lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.133801:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.133803:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.133810:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309680.134176:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788309680.134182:0:24234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002032ff19/0x98c38120c44af6ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788309680.134517:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788309680.134524:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d16c4fd/0x98c38120c44af6f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.134535:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=590s v=(0 0) 00010000:00010000:3.0:1788309680.134538:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309680.134544:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d16c4fd/0x98c38120c44af6f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.134553:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d16c4fd/0x98c38120c44af6f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.134562:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d16c4fd/0x98c38120c44af6f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.134580:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d16c4fd/0x98c38120c44af6f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.134612:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309680.134617:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d16c4fd/0x98c38120c44af6f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.134625:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30c83dba00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309680.134629:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d16c4fd/0x98c38120c44af6f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.134637:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d16c4fd/0x98c38120c44af6f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.134650:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d16c4fd/0x98c38120c44af6f6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.134657:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.134658:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.134660:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309680.134715:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788309680.134720:0:24234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d16c4fd/0x98c38120c44af6f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788309680.137549:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788309680.137561:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d19ef5e6/0x98c38120c44af6fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.137578:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=590s v=(0 0) 00010000:00010000:3.0:1788309680.137583:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309680.137589:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d19ef5e6/0x98c38120c44af6fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.137602:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d19ef5e6/0x98c38120c44af6fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.137611:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d19ef5e6/0x98c38120c44af6fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.137618:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d19ef5e6/0x98c38120c44af6fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.137871:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309680.137878:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d19ef5e6/0x98c38120c44af6fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.137886:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30c83db200 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309680.137891:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d19ef5e6/0x98c38120c44af6fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.137900:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d19ef5e6/0x98c38120c44af6fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.137929:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d19ef5e6/0x98c38120c44af6fd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.137936:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.137938:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.137940:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309680.138196:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788309680.138202:0:24234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d19ef5e6/0x98c38120c44af6fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788309680.138625:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788309680.138632:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000227d0124/0x98c38120c44af704 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.138643:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=590s v=(0 0) 00010000:00010000:3.0:1788309680.138647:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309680.138652:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000227d0124/0x98c38120c44af704 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.138662:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000227d0124/0x98c38120c44af704 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.138671:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000227d0124/0x98c38120c44af704 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.138678:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000227d0124/0x98c38120c44af704 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.138777:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309680.138784:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000227d0124/0x98c38120c44af704 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.138791:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d12db400 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309680.138795:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000227d0124/0x98c38120c44af704 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.138803:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000227d0124/0x98c38120c44af704 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.138816:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000227d0124/0x98c38120c44af704 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.138825:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.138827:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.138829:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309680.139199:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788309680.139205:0:24234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000227d0124/0x98c38120c44af704 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788309680.139520:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788309680.139527:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ba14bf8/0x98c38120c44af70b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.139537:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=590s v=(0 0) 00010000:00010000:3.0:1788309680.139540:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309680.139545:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ba14bf8/0x98c38120c44af70b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.139554:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ba14bf8/0x98c38120c44af70b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.139563:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ba14bf8/0x98c38120c44af70b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.139571:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ba14bf8/0x98c38120c44af70b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.139601:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309680.139607:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ba14bf8/0x98c38120c44af70b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.139624:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d12dae00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309680.139628:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ba14bf8/0x98c38120c44af70b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.139635:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ba14bf8/0x98c38120c44af70b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.139647:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ba14bf8/0x98c38120c44af70b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.139654:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.139656:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.139657:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309680.139724:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788309680.139729:0:24234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ba14bf8/0x98c38120c44af70b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788309680.140049:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788309680.140055:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fda7da2a/0x98c38120c44af712 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.140075:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=590s v=(0 0) 00010000:00010000:3.0:1788309680.140078:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309680.140082:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fda7da2a/0x98c38120c44af712 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.140092:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fda7da2a/0x98c38120c44af712 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.140099:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fda7da2a/0x98c38120c44af712 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.140107:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fda7da2a/0x98c38120c44af712 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.140192:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309680.140198:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fda7da2a/0x98c38120c44af712 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.140205:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d12daa00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309680.140209:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fda7da2a/0x98c38120c44af712 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.140217:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fda7da2a/0x98c38120c44af712 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.140229:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fda7da2a/0x98c38120c44af712 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.140241:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.140243:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.140245:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309680.140365:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788309680.140370:0:24234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fda7da2a/0x98c38120c44af712 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.140463:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788309680.140733:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788309680.140740:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bcae434/0x98c38120c44af719 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.140749:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1788309680.140752:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309680.140757:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bcae434/0x98c38120c44af719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.140779:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bcae434/0x98c38120c44af719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.140787:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bcae434/0x98c38120c44af719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.140794:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bcae434/0x98c38120c44af719 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.140875:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788309680.141273:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788309680.141290:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d30daf90/0x98c38120c44af720 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.141299:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1788309680.141303:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309680.141307:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d30daf90/0x98c38120c44af720 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.141315:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d30daf90/0x98c38120c44af720 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.141322:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d30daf90/0x98c38120c44af720 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.141341:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d30daf90/0x98c38120c44af720 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.141493:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788309680.141499:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bcae434/0x98c38120c44af719 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.141507:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30edf5ae00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309680.141510:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bcae434/0x98c38120c44af719 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.141518:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bcae434/0x98c38120c44af719 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.141531:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bcae434/0x98c38120c44af719 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.141537:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bcae434/0x98c38120c44af719 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.141552:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309680.141556:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d30daf90/0x98c38120c44af720 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.141562:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30edf5bc00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309680.141571:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d30daf90/0x98c38120c44af720 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.141579:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d30daf90/0x98c38120c44af720 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.141589:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d30daf90/0x98c38120c44af720 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.141596:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.141597:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.141599:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309680.141661:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788309680.141667:0:24234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d30daf90/0x98c38120c44af720 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788309680.142375:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788309680.142383:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072b5d89b/0x98c38120c44af727 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.142395:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1788309680.142398:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309680.142403:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072b5d89b/0x98c38120c44af727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.142411:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072b5d89b/0x98c38120c44af727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.142418:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072b5d89b/0x98c38120c44af727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.142425:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072b5d89b/0x98c38120c44af727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.142495:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309680.142500:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072b5d89b/0x98c38120c44af727 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.142507:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30edf5a600 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309680.142510:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072b5d89b/0x98c38120c44af727 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.142517:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072b5d89b/0x98c38120c44af727 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.142529:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072b5d89b/0x98c38120c44af727 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.142588:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309680.142590:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309680.142591:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309680.142640:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788309680.142646:0:24234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072b5d89b/0x98c38120c44af727 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.142773:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788309680.143135:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788309680.143142:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df0c795a/0x98c38120c44af72e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.143152:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1788309680.143155:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309680.143160:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df0c795a/0x98c38120c44af72e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.143169:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df0c795a/0x98c38120c44af72e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.143177:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df0c795a/0x98c38120c44af72e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.143184:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df0c795a/0x98c38120c44af72e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.143202:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788309680.143450:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788309680.143457:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad9827e5/0x98c38120c44af735 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.143470:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1788309680.143473:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309680.143478:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad9827e5/0x98c38120c44af735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.143487:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad9827e5/0x98c38120c44af735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.143494:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad9827e5/0x98c38120c44af735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.143500:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad9827e5/0x98c38120c44af735 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.143561:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788309680.143832:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788309680.143865:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9fc34e1/0x98c38120c44af73c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.143874:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1788309680.143877:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309680.143881:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9fc34e1/0x98c38120c44af73c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.143890:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9fc34e1/0x98c38120c44af73c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.143909:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9fc34e1/0x98c38120c44af73c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.143916:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9fc34e1/0x98c38120c44af73c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.144154:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788309680.144161:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df0c795a/0x98c38120c44af72e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.144169:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30edf5b400 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:1.0:1788309680.144173:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df0c795a/0x98c38120c44af72e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.144181:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df0c795a/0x98c38120c44af72e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.144198:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df0c795a/0x98c38120c44af72e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.144205:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df0c795a/0x98c38120c44af72e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.144221:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788309680.144225:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad9827e5/0x98c38120c44af735 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.144231:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30edf5b200 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:1.0:1788309680.144234:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad9827e5/0x98c38120c44af735 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.144241:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad9827e5/0x98c38120c44af735 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.144264:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad9827e5/0x98c38120c44af735 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.144271:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad9827e5/0x98c38120c44af735 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.144284:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788309680.144287:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9fc34e1/0x98c38120c44af73c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.144293:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30edf5ac00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:1.0:1788309680.144297:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9fc34e1/0x98c38120c44af73c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.144304:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9fc34e1/0x98c38120c44af73c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.144314:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9fc34e1/0x98c38120c44af73c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.144321:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309680.144323:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309680.144325:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.144363:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309680.144506:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788309680.144511:0:24234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9fc34e1/0x98c38120c44af73c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788309680.144897:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788309680.144904:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc33c0bd/0x98c38120c44af743 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.144913:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1788309680.144917:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309680.144923:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc33c0bd/0x98c38120c44af743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.144932:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc33c0bd/0x98c38120c44af743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.144942:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc33c0bd/0x98c38120c44af743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.144969:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc33c0bd/0x98c38120c44af743 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.145196:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309680.145202:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc33c0bd/0x98c38120c44af743 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.145209:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30edf5b600 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309680.145213:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc33c0bd/0x98c38120c44af743 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.145220:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc33c0bd/0x98c38120c44af743 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.145233:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc33c0bd/0x98c38120c44af743 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.145350:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788309680.145356:0:24234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc33c0bd/0x98c38120c44af743 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788309680.145679:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788309680.145686:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000293a860c/0x98c38120c44af74a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.145696:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1788309680.145699:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309680.145704:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000293a860c/0x98c38120c44af74a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.145713:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000293a860c/0x98c38120c44af74a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.145722:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000293a860c/0x98c38120c44af74a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.145730:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000293a860c/0x98c38120c44af74a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.145772:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788309680.145776:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000293a860c/0x98c38120c44af74a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.145792:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30edf5be00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:1.0:1788309680.145795:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000293a860c/0x98c38120c44af74a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.145802:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000293a860c/0x98c38120c44af74a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.145813:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000293a860c/0x98c38120c44af74a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.145820:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309680.145821:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309680.145877:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309680.145979:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788309680.145985:0:24234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000293a860c/0x98c38120c44af74a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788309680.146392:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788309680.146398:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f2ce2f6/0x98c38120c44af751 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.146407:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1788309680.146410:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309680.146415:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f2ce2f6/0x98c38120c44af751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.146425:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f2ce2f6/0x98c38120c44af751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.146433:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f2ce2f6/0x98c38120c44af751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.146440:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f2ce2f6/0x98c38120c44af751 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.146494:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788309680.146699:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788309680.146705:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f2ce2f6/0x98c38120c44af751 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.146713:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30fba6ac00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:1.0:1788309680.146717:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f2ce2f6/0x98c38120c44af751 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.146724:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f2ce2f6/0x98c38120c44af751 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.146737:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f2ce2f6/0x98c38120c44af751 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.146756:0:23881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f2ce2f6/0x98c38120c44af751 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.146773:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309680.146774:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309680.146776:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788309680.147152:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309680.147158:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094b80152/0x98c38120c44af758 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.147167:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=590s v=(0 0) 00010000:00010000:1.0:1788309680.147170:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309680.147174:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094b80152/0x98c38120c44af758 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.147182:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094b80152/0x98c38120c44af758 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.147189:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094b80152/0x98c38120c44af758 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.147196:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094b80152/0x98c38120c44af758 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.147216:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788309680.147514:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309680.147527:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3597efe/0x98c38120c44af75f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.147535:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=590s v=(0 0) 00010000:00010000:1.0:1788309680.147538:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309680.147542:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3597efe/0x98c38120c44af75f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.147551:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3597efe/0x98c38120c44af75f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.147558:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3597efe/0x98c38120c44af75f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.147564:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3597efe/0x98c38120c44af75f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.147572:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788309680.147828:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309680.147835:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b8b9f63/0x98c38120c44af766 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.147872:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=590s v=(0 0) 00010000:00010000:1.0:1788309680.147875:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309680.147879:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b8b9f63/0x98c38120c44af766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.147888:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b8b9f63/0x98c38120c44af766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.147903:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b8b9f63/0x98c38120c44af766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.147911:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b8b9f63/0x98c38120c44af766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.147920:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788309680.148263:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788309680.148270:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094b80152/0x98c38120c44af758 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.148279:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc35f0c00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309680.148282:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094b80152/0x98c38120c44af758 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.148290:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094b80152/0x98c38120c44af758 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.148304:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094b80152/0x98c38120c44af758 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.148320:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094b80152/0x98c38120c44af758 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.148409:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788309680.148414:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3597efe/0x98c38120c44af75f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.148425:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc35f1600 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:2.0:1788309680.148429:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3597efe/0x98c38120c44af75f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.148437:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3597efe/0x98c38120c44af75f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.148448:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3597efe/0x98c38120c44af75f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.148455:0:23881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3597efe/0x98c38120c44af75f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.148468:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309680.148471:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b8b9f63/0x98c38120c44af766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.148477:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc35f1800 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:2.0:1788309680.148480:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b8b9f63/0x98c38120c44af766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.148488:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b8b9f63/0x98c38120c44af766 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.148497:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b8b9f63/0x98c38120c44af766 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.148510:0:23881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b8b9f63/0x98c38120c44af766 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.148523:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309680.148525:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309680.148526:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309680.148582:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309680.148584:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309680.148585:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788309680.148650:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788309680.148656:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061f3384d/0x98c38120c44af76d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.148663:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1788309680.148666:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309680.148670:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061f3384d/0x98c38120c44af76d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.148679:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061f3384d/0x98c38120c44af76d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.148687:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061f3384d/0x98c38120c44af76d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.148695:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061f3384d/0x98c38120c44af76d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.148714:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788309680.149142:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788309680.149154:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb2b073a/0x98c38120c44af774 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.149162:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1788309680.149165:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309680.149169:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb2b073a/0x98c38120c44af774 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.149179:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb2b073a/0x98c38120c44af774 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.149187:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb2b073a/0x98c38120c44af774 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.149194:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb2b073a/0x98c38120c44af774 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.149218:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788309680.149460:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788309680.149466:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061f3384d/0x98c38120c44af76d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.149474:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30fba6be00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:1.0:1788309680.149478:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061f3384d/0x98c38120c44af76d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.149486:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061f3384d/0x98c38120c44af76d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.149499:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061f3384d/0x98c38120c44af76d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.149506:0:23881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061f3384d/0x98c38120c44af76d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.149529:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788309680.149533:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb2b073a/0x98c38120c44af774 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.149539:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30fba6b000 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:1.0:1788309680.149543:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb2b073a/0x98c38120c44af774 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.149551:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb2b073a/0x98c38120c44af774 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.149562:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb2b073a/0x98c38120c44af774 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.149569:0:23881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb2b073a/0x98c38120c44af774 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.149580:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309680.149582:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309680.149584:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788309680.149651:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788309680.149657:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9f95d49/0x98c38120c44af77b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.149665:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1788309680.149667:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309680.149672:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9f95d49/0x98c38120c44af77b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.149680:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9f95d49/0x98c38120c44af77b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.149694:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9f95d49/0x98c38120c44af77b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.149701:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9f95d49/0x98c38120c44af77b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.149721:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788309680.149969:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309680.149975:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9f95d49/0x98c38120c44af77b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.149982:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30fba6bc00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309680.149985:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9f95d49/0x98c38120c44af77b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.149992:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9f95d49/0x98c38120c44af77b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.150013:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9f95d49/0x98c38120c44af77b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.150021:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9f95d49/0x98c38120c44af77b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.150035:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.150037:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.150038:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309680.150162:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788309680.150243:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788309680.150249:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2daa5a7/0x98c38120c44af782 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.150257:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1788309680.150260:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309680.150264:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2daa5a7/0x98c38120c44af782 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.150272:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2daa5a7/0x98c38120c44af782 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.150280:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2daa5a7/0x98c38120c44af782 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.150287:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2daa5a7/0x98c38120c44af782 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.150317:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788309680.150555:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788309680.150560:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000017a9245/0x98c38120c44af789 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.150569:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1788309680.150572:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309680.150576:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000017a9245/0x98c38120c44af789 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.150585:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000017a9245/0x98c38120c44af789 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.150593:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000017a9245/0x98c38120c44af789 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.150600:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000017a9245/0x98c38120c44af789 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.150686:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788309680.151021:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788309680.151027:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ed6abab/0x98c38120c44af790 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.151035:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1788309680.151045:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309680.151050:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ed6abab/0x98c38120c44af790 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.151060:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ed6abab/0x98c38120c44af790 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.151068:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ed6abab/0x98c38120c44af790 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.151075:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ed6abab/0x98c38120c44af790 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.151206:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788309680.151212:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2daa5a7/0x98c38120c44af782 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.151219:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30fba6a600 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:1.0:1788309680.151230:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2daa5a7/0x98c38120c44af782 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.151238:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2daa5a7/0x98c38120c44af782 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.151252:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2daa5a7/0x98c38120c44af782 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.151259:0:23881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2daa5a7/0x98c38120c44af782 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.151275:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788309680.151278:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000017a9245/0x98c38120c44af789 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.151285:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30fba6a400 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:1.0:1788309680.151288:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000017a9245/0x98c38120c44af789 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.151296:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000017a9245/0x98c38120c44af789 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.151305:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000017a9245/0x98c38120c44af789 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.151313:0:23881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000017a9245/0x98c38120c44af789 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.151332:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788309680.151336:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ed6abab/0x98c38120c44af790 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.151342:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30fba6b400 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:1.0:1788309680.151345:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ed6abab/0x98c38120c44af790 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.151353:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ed6abab/0x98c38120c44af790 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.151362:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ed6abab/0x98c38120c44af790 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.151369:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309680.151370:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309680.151372:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.151417:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309680.151484:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309680.151553:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788309680.151559:0:24234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ed6abab/0x98c38120c44af790 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788309680.151919:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788309680.151925:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff8a73aa/0x98c38120c44af797 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.151934:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1788309680.151937:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309680.151942:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8a73aa/0x98c38120c44af797 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.151951:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8a73aa/0x98c38120c44af797 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.151975:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff8a73aa/0x98c38120c44af797 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.151983:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8a73aa/0x98c38120c44af797 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.152195:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788309680.152200:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff8a73aa/0x98c38120c44af797 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.152207:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30fba6b200 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:1.0:1788309680.152210:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8a73aa/0x98c38120c44af797 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.152229:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8a73aa/0x98c38120c44af797 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.152244:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff8a73aa/0x98c38120c44af797 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309680.152252:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309680.152253:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309680.152255:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309680.152311:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788309680.152316:0:24234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8a73aa/0x98c38120c44af797 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788309680.152599:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788309680.152605:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ea970b0/0x98c38120c44af79e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.152613:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1788309680.152616:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309680.152620:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ea970b0/0x98c38120c44af79e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.152629:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ea970b0/0x98c38120c44af79e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.152637:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ea970b0/0x98c38120c44af79e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.152656:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ea970b0/0x98c38120c44af79e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.152689:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309680.152694:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ea970b0/0x98c38120c44af79e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.152707:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30fba6ae00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309680.152711:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ea970b0/0x98c38120c44af79e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.152719:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ea970b0/0x98c38120c44af79e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.152730:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ea970b0/0x98c38120c44af79e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.152739:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.152740:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309680.152742:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309680.152812:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788309680.152817:0:24234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ea970b0/0x98c38120c44af79e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788309680.153465:0:24234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788309680.153473:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adf52267/0x98c38120c44af7a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.153483:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1788309680.153486:0:24234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309680.153491:0:24234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adf52267/0x98c38120c44af7a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.153500:0:24234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adf52267/0x98c38120c44af7a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.153508:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adf52267/0x98c38120c44af7a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309680.153515:0:24234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adf52267/0x98c38120c44af7a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.153671:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309680.153678:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adf52267/0x98c38120c44af7a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.153685:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30fba6a000 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:3.0:1788309680.153688:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf52267/0x98c38120c44af7a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.153702:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf52267/0x98c38120c44af7a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.153715:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adf52267/0x98c38120c44af7a5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.153724:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309680.153726:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309680.153728:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309680.153800:0:24234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788309680.153805:0:24234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adf52267/0x98c38120c44af7a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788309680.154169:0:24234:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:2.0:1788309680.154259:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d3b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22753:x1875178048167936:12345-0@lo:5:osp-pre-0-0.0 Request processed in 40009us (40329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309680.154273:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788309680.154350:0:22753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b07800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22753:1875178048167936:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788309680.154414:0:22753:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788309680.154463:0:22753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22753:1875178048168064:0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1788309680.154474:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309680.154502:0:22753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309680.154534:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30fbbc6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788309680.154558:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048168064 00000100:00100000:1.0:1788309680.154566:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048168064 00000100:00100000:1.0:1788309680.154609:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788309680.154620:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c30c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22753:x1875178048168064:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788309680.154655:0:24235:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:1.0:1788309680.158760:0:24230:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1788309680.158811:0:24230:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788309680.159359:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c30c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22753:x1875178048168064:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4736us (4852us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788309680.159370:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788309680.159435:0:22753:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788309680.159444:0:22753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22753:1875178048168064:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788309680.159458:0:22753:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 10000000:01000000:0.0:1788309680.618633:0:22724:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788309680.618701:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c2fc33d3000 from 13 10000000:01000000:0.0:1788309680.618707:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788309680.618750:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af7ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.618762:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af7ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.618773:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af7ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309680.618798:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048168192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788309680.619166:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309680.619985:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30edf11600 going to sleep for 11 seconds 00000100:00100000:0.0:1788309680.620008:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048168192 00000100:00100000:0.0:1788309680.620016:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048168192 00000100:00100000:0.0:1788309680.620063:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788309680.620072:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+19:22724:x1875178048168192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788309680.620086:0:22720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309680.620102:0:22720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30c1512a00/0x98c38120c44af7b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af7ac expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.620126:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30c1512a00/0x98c38120c44af7b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af7ac expref: 20 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.620136:0:22720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30c1512a00/0x98c38120c44af7b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af7ac expref: 20 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.620145:0:22720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30c1512a00, rc 0) 00000100:00100000:0.0:1788309680.620189:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+20:22724:x1875178048168192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309680.620196:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788309680.620450:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048168192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788309680.620467:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af7ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af7b3 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.620476:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af7ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af7b3 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309680.620534:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048168320:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788309680.620574:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309680.620596:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30edf11600 going to sleep for 11 seconds 00000100:00100000:3.0:1788309680.620649:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048168320 00000100:00100000:3.0:1788309680.620654:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048168320 00000100:00100000:3.0:1788309680.620678:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788309680.620685:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+20:22724:x1875178048168320:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788309680.620699:0:22722:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788309680.620714:0:22722:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788309680.620721:0:22722:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1788309680.620799:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+20:22724:x1875178048168320:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309680.620807:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788309680.621438:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048168320:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788309680.621498:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788309680.621506:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af7ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af7b3 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.621516:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af7ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af7b3 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309680.621527:0:22724:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788309680.621529:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c30c83d6000 from 13 10000000:01000000:0.0:1788309680.621532:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788309680.621564:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1513800/0x98c38120c44af7ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.621572:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c30c1513800/0x98c38120c44af7ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.621582:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c30c1513800/0x98c38120c44af7ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309680.621597:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048168448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788309680.621638:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309680.621685:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30edf11600 going to sleep for 11 seconds 00000100:00100000:0.0:1788309680.621702:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048168448 00000100:00100000:0.0:1788309680.621707:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048168448 00000100:00100000:0.0:1788309680.621743:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788309680.621751:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+20:22724:x1875178048168448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788309680.621763:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309680.621784:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30c1512800/0x98c38120c44af7c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af7ba expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.621806:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30c1512800/0x98c38120c44af7c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af7ba expref: 21 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.621816:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30c1512800/0x98c38120c44af7c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af7ba expref: 21 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309680.621825:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30c1512800, rc 0) 00000100:00100000:0.0:1788309680.622163:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:22724:x1875178048168448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 412us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309680.622171:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788309680.622569:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048168448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309680.622585:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c30c1513800/0x98c38120c44af7ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af7c1 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.622594:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c30c1513800/0x98c38120c44af7ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af7c1 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309680.622644:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048168576:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788309680.622677:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309680.622714:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c60d8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788309680.622728:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048168576 00000100:00100000:2.0:1788309680.622733:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048168576 00000100:00100000:2.0:1788309680.622771:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788309680.622779:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:22724:x1875178048168576:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788309680.622794:0:22720:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788309680.622809:0:22720:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788309680.622812:0:22720:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1788309680.622930:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:22724:x1875178048168576:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 152us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309680.622935:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048168576:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788309680.622937:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 10000000:01000000:3.0:1788309680.623110:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788309680.623117:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1513800/0x98c38120c44af7ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af7c1 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309680.623124:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30c1513800/0x98c38120c44af7ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af7c1 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309681.132186:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309682.157633:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309682.285751:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788309682.285775:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048168704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788309682.285869:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309682.285903:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048168704 00000100:00100000:3.0:1788309682.285912:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048168704 00000100:00100000:3.0:1788309682.285967:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788309682.285977:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048168704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788309682.286028:0:22732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788309682.286080:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048168704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309682.286088:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788309682.286130:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048168704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788309682.288635:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048168832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788309682.288702:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309682.289933:0:23468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048168832 00000100:00100000:3.0:1788309682.289944:0:23468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048168832 00000100:00100000:3.0:1788309682.289990:0:23468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788309682.290000:0:23468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048168832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788309682.290031:0:23468:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788309682.297178:0:23468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048168832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7170us (8467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309682.297192:0:23468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788309682.299317:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048168832:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788309683.178048:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309684.203119:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788309684.432273:0:24599:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg632-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:0.0:1788309685.224066:0:24651:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788309685.224280:0:24651:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788309685.227732:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788309685.354226:0:468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788309685.354232:0:468:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788309685.354236:0:468:0:(import.c:65:import_set_state_nolock()) ffff8c30f9a1b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788309685.354243:0:468:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 590 00000100:00080000:1.0:1788309685.354249:0:468:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788309685.354254:0:468:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c30f9a1b800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:1.0:1788309685.354274:0:468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30fba0ce00 x1875178048169344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788309685.354317:0:468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788309685.354320:0:468:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788309685.354322:0:468:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788309685.354325:0:468:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788309685.354358:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048169344:0@lo:8:kworker.0 00000100:00100000:1.0:1788309685.354421:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309685.354444:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048169344 00000100:00100000:2.0:1788309685.354452:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048169344 00000100:00100000:2.0:1788309685.354482:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788309685.354496:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1875178048169344:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788309685.354517:0:24234:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788309685.354523:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3618:1875178048168960:0@lo:400:kworker.0 00000100:00100000:0.0:1788309685.354553:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309685.354581:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875178048169600:0@lo:400:kworker.0 00000100:00100000:0.0:1788309685.354607:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309685.354608:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1875178048169344:12345-0@lo:8:kworker.0 Request processed in 112us (187us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788309685.354616:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788309685.354634:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788309685.354640:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875178048169472:0@lo:400:kworker.0 00000100:00100000:0.0:1788309685.354677:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309685.354696:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1875178048169984:0@lo:400:kworker.0 00000100:00100000:0.0:1788309685.354715:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309685.354742:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048168960 00000100:00100000:0.0:1788309685.354745:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048168960 00000100:00100000:0.0:1788309685.354778:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788309685.354785:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:3618:x1875178048168960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309685.354835:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:3618:x1875178048168960:12345-0@lo:400:kworker.0 Request processed in 51us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309685.354862:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788309685.354901:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048169600 00000100:00100000:0.0:1788309685.354905:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048169600 00000100:00100000:0.0:1788309685.354928:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788309685.354934:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875178048169600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309685.354967:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875178048169600:12345-0@lo:400:kworker.0 Request processed in 33us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309685.354973:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788309685.354989:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048169472 00000100:00100000:0.0:1788309685.354992:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048169472 00000100:00100000:0.0:1788309685.355014:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048169984 00000100:00100000:0.0:1788309685.355017:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048169984 00000100:00100000:0.0:1788309685.355039:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788309685.355045:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875178048169472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309685.355089:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875178048169472:12345-0@lo:400:kworker.0 Request processed in 45us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309685.355105:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788309685.355118:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788309685.355123:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875178048169984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309685.355150:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875178048169984:12345-0@lo:400:kworker.0 Request processed in 28us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309685.355156:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788309685.355179:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788309685.355199:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c30fba0f800 x1875178048169472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309685.355212:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875178048169472:0@lo:400:kworker.0 00010000:00080000:0.0:1788309685.355221:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c30fba0c000 x1875178048169984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309685.355229:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1875178048169984:0@lo:400:kworker.0 00000100:00100000:0.0:1788309685.355235:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3618:1875178048168960:0@lo:400:kworker.0 00000100:00100000:0.0:1788309685.355243:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875178048169600:0@lo:400:kworker.0 00000100:00100000:3.0:1788309685.357487:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048169088:0@lo:400:kworker.0 00000100:00100000:3.0:1788309685.357550:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309685.357581:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875178048169728:0@lo:400:kworker.0 00000100:00100000:3.0:1788309685.357606:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309685.357627:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788309685.357633:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048169216:0@lo:400:kworker.0 00000100:00100000:3.0:1788309685.357655:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309685.357675:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875178048169856:0@lo:400:kworker.0 00000100:00100000:3.0:1788309685.357705:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788309685.358008:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30f9a1b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788309685.358022:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788309685.358027:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048169344:0@lo:8:kworker.0 00000100:00100000:3.0:1788309685.358130:0:24111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048169088 00000100:00100000:3.0:1788309685.358136:0:24111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048169088 00000100:00100000:3.0:1788309685.358185:0:24111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788309685.358194:0:24111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c30c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048169088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309685.358740:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788309685.358753:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875178048170112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788309685.358945:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309685.358987:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048170112 00000100:00100000:0.0:1788309685.358991:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048170112 00000100:00100000:0.0:1788309685.359035:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788309685.359044:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875178048170112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788309685.359136:0:24237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788309685.359192:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875178048170112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309685.359199:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788309685.359225:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048169728 00000100:00100000:0.0:1788309685.359229:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048169728 00000100:00100000:0.0:1788309685.359255:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048169856 00000100:00100000:0.0:1788309685.359259:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048169856 00000100:00100000:0.0:1788309685.359277:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788309685.359284:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c30ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875178048169728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309685.359322:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c30ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875178048169728:12345-0@lo:400:kworker.0 Request processed in 39us (1714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309685.359328:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788309685.359339:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788309685.359346:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c30c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875178048169856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309685.359375:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c30c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875178048169856:12345-0@lo:400:kworker.0 Request processed in 30us (1669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309685.359380:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788309685.359399:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788309685.359404:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788309685.359445:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875178048170112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788309685.365595:0:24111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c30c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048169088:12345-0@lo:400:kworker.0 Request processed in 7393us (8036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309685.365610:0:24111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788309685.365657:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048169216 00000100:00100000:3.0:1788309685.365665:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048169216 00000100:00100000:3.0:1788309685.365720:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788309685.365729:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c30cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048169216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309685.365803:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c30cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048169216:12345-0@lo:400:kworker.0 Request processed in 76us (8146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309685.365818:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788309685.365879:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048169216:0@lo:400:kworker.0 00010000:00080000:3.0:1788309685.365896:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c30fba0ca80 x1875178048169856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309685.365906:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875178048169856:0@lo:400:kworker.0 00000100:00100000:3.0:1788309685.365917:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048169088:0@lo:400:kworker.0 00010000:00080000:3.0:1788309685.365940:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c30fba0c380 x1875178048169728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309685.365949:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875178048169728:0@lo:400:kworker.0 00000020:00000004:2.0:1788309686.070701:0:24701:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788309686.071146:0:24701:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788309686.253254:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788309686.636551:0:22764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788309687.274138:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309687.404135:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048170240:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788309687.404200:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309687.404232:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788309687.404238:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875178048170368:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788309687.404261:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309687.404900:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048170240 00000100:00100000:1.0:1788309687.404911:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048170240 00000100:00100000:1.0:1788309687.404971:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048170368 00000100:00100000:1.0:1788309687.404974:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048170368 00000100:00100000:1.0:1788309687.404998:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788309687.405007:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048170240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788309687.405039:0:22732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788309687.405090:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048170240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309687.405097:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788309687.405121:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788309687.405128:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875178048170368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788309687.405144:0:22732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788309687.405172:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875178048170368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 45us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309687.405178:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788309687.405223:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875178048170368:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788309687.405238:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048170240:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788309688.299637:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788309688.427756:0:23480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788309689.337171:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309690.347360:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788309690.474325:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788309690.474331:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788309690.474334:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c30f9a1b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788309690.474342:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 595 00000100:00080000:0.0:1788309690.474346:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788309690.474358:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c30f9a1b800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:0.0:1788309690.474381:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c2fc401b480 x1875178048170880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788309690.474410:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788309690.474414:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788309690.474416:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788309690.474420:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788309690.474470:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3617:1875178048170496:0@lo:400:kworker.0 00000100:00100000:0.0:1788309690.474544:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309690.474585:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048171136:0@lo:400:kworker.0 00000100:00100000:0.0:1788309690.474609:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309690.474628:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788309690.474633:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875178048170624:0@lo:400:kworker.0 00000100:00100000:0.0:1788309690.474650:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309690.474663:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875178048171264:0@lo:400:kworker.0 00000100:00100000:0.0:1788309690.474682:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309690.474705:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc414c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048170752:0@lo:400:kworker.0 00000100:00100000:0.0:1788309690.474725:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309690.474740:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875178048171392:0@lo:400:kworker.0 00000100:00100000:0.0:1788309690.474760:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309690.474773:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788309690.474777:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875178048171008:0@lo:400:kworker.0 00000100:00100000:0.0:1788309690.474808:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309690.474830:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875178048171520:0@lo:400:kworker.0 00000100:00100000:0.0:1788309690.474875:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309690.474894:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048170880:0@lo:8:kworker.0 00000100:00100000:0.0:1788309690.474912:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309690.474935:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048170496 00000100:00100000:0.0:1788309690.474941:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048170496 00000100:00100000:0.0:1788309690.474974:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788309690.474982:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:3617:x1875178048170496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309690.475021:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:3617:x1875178048170496:12345-0@lo:400:kworker.0 Request processed in 40us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309690.475027:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788309690.475051:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048171136 00000100:00100000:0.0:1788309690.475054:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048171136 00000100:00100000:0.0:1788309690.475073:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048170624 00000100:00100000:0.0:1788309690.475076:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048170624 00000100:00100000:0.0:1788309690.475090:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788309690.475096:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048171136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309690.475123:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048171136:12345-0@lo:400:kworker.0 Request processed in 27us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309690.475129:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788309690.475138:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788309690.475143:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875178048170624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309690.475176:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875178048170624:12345-0@lo:400:kworker.0 Request processed in 33us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309690.475182:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788309690.475200:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048171264 00000100:00100000:0.0:1788309690.475203:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048171264 00000100:00100000:0.0:1788309690.475225:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048171392 00000100:00100000:0.0:1788309690.475227:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048171392 00000100:00100000:0.0:1788309690.475245:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048171008 00000100:00100000:0.0:1788309690.475248:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048171008 00000100:00100000:0.0:1788309690.475258:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048171520 00000100:00100000:0.0:1788309690.475260:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048171520 00000100:00100000:0.0:1788309690.475274:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788309690.475280:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875178048171264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309690.475307:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875178048171264:12345-0@lo:400:kworker.0 Request processed in 28us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309690.475313:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788309690.475323:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788309690.475327:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc401b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875178048171392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309690.475348:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc401b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875178048171392:12345-0@lo:400:kworker.0 Request processed in 21us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309690.475354:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788309690.475362:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788309690.475367:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875178048171008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309690.475385:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875178048171008:12345-0@lo:400:kworker.0 Request processed in 18us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309690.475390:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788309690.475397:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788309690.475402:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875178048171520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309690.475420:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875178048171520:12345-0@lo:400:kworker.0 Request processed in 19us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309690.475426:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788309690.475441:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048170752 00000100:00100000:0.0:1788309690.475448:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048170752 00000100:00100000:0.0:1788309690.475469:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048170880 00000100:00100000:0.0:1788309690.475471:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048170880 00000100:00100000:0.0:1788309690.475480:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788309690.475485:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4019880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048170752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309690.475510:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4019880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048170752:12345-0@lo:400:kworker.0 Request processed in 25us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309690.475515:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788309690.475524:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788309690.475527:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3616:x1875178048170880:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788309690.475544:0:24236:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788309690.477408:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788309690.477431:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875178048171648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788309690.477516:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309690.477678:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048171648 00000100:00100000:3.0:1788309690.477686:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048171648 00000100:00100000:3.0:1788309690.477751:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788309690.477763:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875178048171648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788309690.477804:0:24237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788309690.477887:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875178048171648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309690.477895:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788309690.477984:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875178048171648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788309690.479124:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875178048170624:0@lo:400:kworker.0 00010000:00080000:2.0:1788309690.479142:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c2fc401aa00 x1875178048171264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309690.479152:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875178048171264:0@lo:400:kworker.0 00000100:00100000:2.0:1788309690.479161:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3617:1875178048170496:0@lo:400:kworker.0 00000100:00100000:2.0:1788309690.479172:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048171136:0@lo:400:kworker.0 00000100:00080000:2.0:1788309690.491913:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788309690.491922:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788309690.491925:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788309690.491990:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c2fc401a300 x1875178048171008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309690.492008:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875178048171008:0@lo:400:kworker.0 00010000:00080000:2.0:1788309690.492024:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c2fc401a680 x1875178048171520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309690.492033:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc401a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875178048171520:0@lo:400:kworker.0 00000100:00100000:2.0:1788309690.492048:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc414c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048170752:0@lo:400:kworker.0 00010000:00080000:2.0:1788309690.492080:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c2fc401ad80 x1875178048171392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309690.492090:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875178048171392:0@lo:400:kworker.0 00000100:00100000:0.0:1788309690.498047:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3616:x1875178048170880:12345-0@lo:8:kworker.0 Request processed in 22512us (23128us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788309690.498061:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788309690.498126:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30f9a1b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788309690.498132:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788309690.498136:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048170880:0@lo:8:kworker.0 00010000:00010000:3.0:1788309691.378011:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309691.497991:0:3616:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788309676/real 1788309676] req@ffff8c30fbbf0e00 x1875178048162304/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788309691 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309691.498021:0:3616:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c30fbbf0e00 x1875178048162304/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788309691 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309691.498031:0:3616:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788309676/real 1788309676] req@ffff8c30fbbf3100 x1875178048162432/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788309691 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309691.498041:0:3616:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c30fbbf3100 x1875178048162432/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788309691 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788309691.498060:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c2fc35ca800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788309691.498078:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788309691.498094:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048162304:0@lo:8:kworker.0 00000100:00080000:1.0:1788309691.498102:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30c7fef800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788309691.498127:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788309691.498130:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048162432:0@lo:8:kworker.0 00000100:00080000:3.0:1788309691.498275:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788309691.498281:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788309691.498284:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c30f9a1b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788309691.498290:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 600 00000100:00100000:1.0:1788309691.498293:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3618:1875178048171776:0@lo:400:kworker.0 00000100:00080000:3.0:1788309691.498295:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788309691.498304:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c30f9a1b800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:3.0:1788309691.498327:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30c30cb800 x1875178048172160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788309691.498360:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788309691.498363:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788309691.498365:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c2fc35ca800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788309691.498369:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 586 00000100:00080000:3.0:1788309691.498372:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788309691.498375:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8c2fc35ca800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:3.0:1788309691.498386:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30c30c8a80 x1875178048172544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788309691.498394:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788309691.498397:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788309691.498405:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c30c7fef800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788309691.498409:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 586 00000100:00080000:3.0:1788309691.498411:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788309691.498414:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8c30c7fef800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:3.0:1788309691.498426:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30fbbf3100 x1875178048172672/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788309691.498466:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048171904:0@lo:400:kworker.0 00000100:00100000:0.0:1788309691.498477:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875178048172288:0@lo:400:kworker.0 00000100:00100000:0.0:1788309691.498515:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309691.498543:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875178048173056:0@lo:400:kworker.0 00000100:00100000:0.0:1788309691.498565:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309691.498585:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788309691.498590:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048172416:0@lo:400:kworker.0 00000100:00100000:0.0:1788309691.498613:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309691.498638:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875178048172032:0@lo:400:kworker.0 00000100:00100000:0.0:1788309691.498675:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309691.498695:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875178048172928:0@lo:400:kworker.0 00000100:00100000:0.0:1788309691.498715:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309691.498744:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048172288 00000100:00100000:0.0:1788309691.498751:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048172288 00000100:00100000:0.0:1788309691.498798:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048173056 00000100:00100000:0.0:1788309691.498801:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048173056 00000100:00100000:0.0:1788309691.498814:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048172928 00000100:00100000:0.0:1788309691.498816:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048172928 00000100:00100000:0.0:1788309691.498828:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788309691.498835:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc401b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875178048172288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309691.498984:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309691.498985:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc401b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875178048172288:12345-0@lo:400:kworker.0 Request processed in 145us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309691.498994:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788309691.499019:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788309691.499027:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875178048173056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309691.499041:0:22727:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788309691.499050:0:22727:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788309691.499058:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875178048173056:12345-0@lo:400:kworker.0 Request processed in 32us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309691.499066:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788309691.499067:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048171776 00000100:00100000:1.0:1788309691.499072:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048171776 00000100:00100000:0.0:1788309691.499081:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788309691.499090:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875178048172928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309691.499124:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875178048172928:12345-0@lo:400:kworker.0 Request processed in 36us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309691.499129:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788309691.499147:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048172416 00000100:00100000:0.0:1788309691.499151:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048172416 00000100:00100000:0.0:1788309691.499174:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788309691.499187:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048172416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309691.499219:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048172416:12345-0@lo:400:kworker.0 Request processed in 32us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309691.499224:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788309691.499243:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048172032 00000100:00100000:0.0:1788309691.499247:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048172032 00000100:00100000:0.0:1788309691.499273:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788309691.499278:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875178048172032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309691.499307:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875178048172032:12345-0@lo:400:kworker.0 Request processed in 28us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309691.499313:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788309691.499332:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309691.499353:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875178048172032:0@lo:400:kworker.0 00000100:00100000:3.0:1788309691.499360:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875178048172800:0@lo:400:kworker.0 00000100:00100000:3.0:1788309691.499387:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309691.499767:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048172416:0@lo:400:kworker.0 00010000:00080000:2.0:1788309691.499792:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c30c30cad80 x1875178048172288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309691.499803:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875178048172288:0@lo:400:kworker.0 00010000:00080000:2.0:1788309691.499815:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c30fbbf3480 x1875178048173056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309691.499823:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875178048173056:0@lo:400:kworker.0 00010000:00080000:0.0:1788309691.499967:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c30fbbf1880 x1875178048172928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309691.499978:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875178048172928:0@lo:400:kworker.0 00000100:00100000:3.0:1788309691.500622:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048171904 00000100:00100000:3.0:1788309691.500631:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048171904 00000100:00100000:3.0:1788309691.500671:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788309691.500673:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788309691.500683:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048171904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309691.500691:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:3618:x1875178048171776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309691.500789:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:3618:x1875178048171776:12345-0@lo:400:kworker.0 Request processed in 95us (2424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309691.500796:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788309691.500980:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048172160:0@lo:8:kworker.0 00000100:00100000:1.0:1788309691.501014:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309691.501052:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048172544:0@lo:8:kworker.0 00000100:00100000:1.0:1788309691.501080:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309691.501125:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048172672:0@lo:8:kworker.0 00000100:00100000:1.0:1788309691.501152:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309691.501187:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048172800 00000100:00100000:1.0:1788309691.501192:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048172800 00000100:00100000:1.0:1788309691.501225:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788309691.501234:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875178048172800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309691.501241:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048171904:12345-0@lo:400:kworker.0 Request processed in 559us (1909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309691.501256:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788309691.501301:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875178048172800:12345-0@lo:400:kworker.0 Request processed in 68us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309691.501310:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788309691.501337:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048172160 00000100:00100000:1.0:1788309691.501337:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048172544 00000100:00100000:2.0:1788309691.501341:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048172160 00000100:00100000:1.0:1788309691.501341:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048172544 00000100:00100000:3.0:1788309691.501347:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048172672 00000100:00100000:3.0:1788309691.501353:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048172672 00000100:00100000:1.0:1788309691.501368:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788309691.501374:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1875178048172544:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788309691.501405:0:24234:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 601 last 0 00000100:00100000:3.0:1788309691.501411:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048171904:0@lo:400:kworker.0 00010000:00080000:3.0:1788309691.501429:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c30fbbf0e00 x1875178048172800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:1.0:1788309691.501432:0:24234:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x98c38120c44af7c8 00000100:00100000:3.0:1788309691.501444:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875178048172800:0@lo:400:kworker.0 00002000:00100000:1.0:1788309691.501450:0:24234:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8c30c7565000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788309691.501457:0:24234:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1788309691.501460:0:24234:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788309691.501532:0:24234:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788309691.501553:0:24234:0:(import.c:65:import_set_state_nolock()) ffff8c30c7562000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788309691.501604:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1875178048172544:12345-0@lo:8:kworker.0 Request processed in 228us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309691.501611:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788309691.501623:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788309691.501624:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00100000:1.0:1788309691.501627:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1875178048172160:12345-0@lo:8:kworker.0 00000100:00080000:2.0:1788309691.501631:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788309691.501637:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00010000:00020000:1.0:1788309691.501638:0:24234:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1788309691.501643:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788309691.501645:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c2fc35ca800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788309691.501663:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1875178048172160:12345-0@lo:8:kworker.0 Request processed in 33us (648us total) trans 0 rc -19/-19 00000004:00080000:2.0:1788309691.501666:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788309691.501668:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788309691.501671:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048172544:0@lo:8:kworker.0 00000100:00100000:1.0:1788309691.501679:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788309691.501683:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1875178048172672:12345-0@lo:8:kworker.0 00000100:00080000:2.0:1788309691.501689:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30f9a1b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788309691.501693:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788309691.501695:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048172160:0@lo:8:kworker.0 00010000:00020000:1.0:1788309691.501699:0:24234:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788309691.501734:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1875178048172672:12345-0@lo:8:kworker.0 Request processed in 49us (582us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788309691.501740:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788309691.501752:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30c7fef800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788309691.501761:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788309691.501764:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048172672:0@lo:8:kworker.0 00000004:00080000:3.0:1788309691.502635:0:23470:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788309691.502655:0:23470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23470:1875178048173312:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788309691.502699:0:23470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309691.502723:0:23470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c60def00 going to sleep for 11 seconds 00000100:00100000:3.0:1788309691.502740:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048173312 00000100:00100000:3.0:1788309691.502745:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048173312 00000100:00100000:3.0:1788309691.502793:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788309691.502801:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23470:x1875178048173312:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788309691.502886:0:23469:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788309691.503033:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788309691.503044:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048173184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788309691.503075:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788309691.503229:0:23469:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 601572388542ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788309691.503235:0:23469:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788309691.503507:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3618:1875178048171776:0@lo:400:kworker.0 00000100:00080000:3.0:1788309691.504515:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788309691.504544:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048173184 00000100:00100000:3.0:1788309691.504556:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048173184 00000100:00100000:3.0:1788309691.504606:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788309691.504619:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d3b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3617:x1875178048173184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788309691.504644:0:24237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788309691.504764:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d3b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3617:x1875178048173184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 150us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309691.504772:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788309691.504869:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048173184:0@lo:13:osp-pre-0-1.0 00002000:00080000:2.0:1788309691.507224:0:24236:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788309691.507235:0:24236:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788309691.507324:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23470:x1875178048173312:12345-0@lo:7:osp-pre-0-1.0 Request processed in 4520us (4621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309691.507334:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788309691.507606:0:23470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23470:1875178048173312:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788309691.507621:0:23470:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788309691.507658:0:23470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23470:1875178048173440:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788309691.507696:0:23470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309691.507730:0:23470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c60def00 going to sleep for 11 seconds 00000100:00100000:1.0:1788309691.507753:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048173440 00000100:00100000:1.0:1788309691.507760:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048173440 00000100:00100000:1.0:1788309691.507822:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788309691.507832:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23470:x1875178048173440:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788309691.507902:0:24234:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1788309691.507949:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23470:x1875178048173440:12345-0@lo:5:osp-pre-0-1.0 Request processed in 118us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309691.507955:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788309691.508017:0:23470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23470:1875178048173440:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788309691.508027:0:23470:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788309691.508056:0:23470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23470:1875178048173568:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788309691.508095:0:23470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309691.508119:0:23470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c60def00 going to sleep for 11 seconds 00000100:00100000:2.0:1788309691.508144:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048173568 00000100:00100000:2.0:1788309691.508149:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048173568 00000100:00100000:2.0:1788309691.508181:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788309691.508189:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23470:x1875178048173568:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788309691.508214:0:24236:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000004:00080000:1.0:1788309691.508519:0:23460:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000001:00080000:2.0:1788309691.530342:0:24230:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:2.0:1788309691.530576:0:24230:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788309691.531484:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23470:x1875178048173568:12345-0@lo:5:osp-pre-0-1.0 Request processed in 23290us (23383us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788309691.531495:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788309691.532176:0:23470:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1788309691.532186:0:23470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23470:1875178048173568:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788309691.532200:0:23470:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1788309691.532251:0:23470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23470:1875178048173696:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788309691.532287:0:23470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309691.532311:0:23470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c60def00 going to sleep for 11 seconds 00000100:00100000:0.0:1788309691.532755:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048173696 00000100:00100000:0.0:1788309691.532762:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048173696 00000100:00100000:0.0:1788309691.532857:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788309691.532867:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23470:x1875178048173696:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788309691.532929:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23470:x1875178048173696:12345-0@lo:900:osp-pre-0-1.0 Request processed in 64us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309691.532944:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788309691.533406:0:23470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c30fbbf2a00 x1875178048173696/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788309707 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309691.533419:0:23470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23470:1875178048173696:0@lo:900:osp-pre-0-1.0 00000020:01000004:0.0:1788309692.097766:0:25048:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788309692.097771:0:25048:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788309692.097772:0:25048:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788309692.098179:0:25048:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c30fbbcb800 00000020:01000004:0.0:1788309692.098201:0:25048:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788309692.098216:0:25048:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788309692.098229:0:25048:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8c30ed8cb370) 00000020:00000080:0.0:1788309692.098246:0:25048:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788309692.138170:0:25048:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788309692.141630:0:25048:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788309692.142222:0:25048:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788309692.142420:0:25048:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788309692.142606:0:25048:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788309692.142801:0:25048:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788309692.143207:0:25048:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:1.0:1788309692.144080:0:25048:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788309692.144275:0:25048:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788309692.144293:0:25048:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788309692.144303:0:25048:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x98c38120c44af7d6 00000020:01000004:1.0:1788309692.144309:0:25048:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788309692.144330:0:25048:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.132@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788309692.144333:0:25048:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788309692.144339:0:25048:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788309692.144365:0:25048:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788309692.144368:0:25048:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.132@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788309692.166476:0:25048:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.132@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788309692.166515:0:25048:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.132@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788309692.166520:0:25048:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788309692.166522:0:25048:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788309692.166523:0:25048:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788309692.166524:0:25048:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788309692.166525:0:25048:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788309692.166527:0:25048:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788309692.166529:0:25048:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788309692.166530:0:25048:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788309692.166532:0:25048:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788309692.166536:0:25048:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788309692.166538:0:25048:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788309692.166539:0:25048:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788309692.166541:0:25048:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788309692.166542:0:25048:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788309692.166543:0:25048:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788309692.166544:0:25048:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788309692.166545:0:25048:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788309692.166546:0:25048:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788309692.166553:0:25048:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788309692.166578:0:25048:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788309692.166596:0:25048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048173824:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788309692.166770:0:25048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309692.166826:0:25048:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c30bd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309692.167028:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048173824 00000100:00100000:1.0:1788309692.167036:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048173824 00000100:00100000:1.0:1788309692.167136:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788309692.167146:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:25048:x1875178048173824:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788309692.167183:0:22719:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788309692.167186:0:22719:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788309692.167190:0:22719:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788309692.167507:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:25048:x1875178048173824:12345-0@lo:253:mount.lustre.0 Request processed in 362us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309692.167516:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788309692.167608:0:25048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048173824:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788309692.167619:0:25048:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788309692.167622:0:25048:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788309692.167623:0:25048:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788309692.167625:0:25048:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788309692.167626:0:25048:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788309692.167627:0:25048:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788309692.167628:0:25048:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788309692.167630:0:25048:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788309692.167631:0:25048:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788309692.167633:0:25048:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788309692.167651:0:25048:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c30fbbcb800 from lustre-OST0001 10000000:01000000:3.0:1788309692.167689:0:25048:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788309692.167692:0:25048:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788309692.167700:0:25048:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c2fc23bb370 local copy 00010000:00010000:3.0:1788309692.167710:0:25048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1512200/0x98c38120c44af409 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af410 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309692.167802:0:25048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048173952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788309692.167833:0:25048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309692.168072:0:25048:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2335480 going to sleep for 11 seconds 00000100:00100000:0.0:1788309692.168106:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048173952 00000100:00100000:0.0:1788309692.168112:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048173952 00000100:00100000:0.0:1788309692.168142:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788309692.168150:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:25048:x1875178048173952:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788309692.168266:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:25048:x1875178048173952:12345-0@lo:501:mount.lustre.0 Request processed in 117us (432us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788309692.168273:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788309692.168372:0:25048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048173952:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788309692.168386:0:25048:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788309692.168404:0:25048:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788309692.168411:0:25048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30c1512200/0x98c38120c44af409 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af410 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309692.168430:0:25048:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30c1512200/0x98c38120c44af409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af410 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309692.168453:0:25048:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c30fbbcb800 10000000:01000000:3.0:1788309692.168457:0:25048:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788309692.168462:0:25048:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788309692.168464:0:25048:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788309692.168468:0:25048:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788309692.168470:0:25048:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788309692.168490:0:25048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30d12dae00/0x98c38120c44af7dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309692.168497:0:25048:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c30d12dae00/0x98c38120c44af7dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309692.168505:0:25048:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c30d12dae00/0x98c38120c44af7dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309692.168518:0:25048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048174080:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788309692.168543:0:25048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309692.168604:0:25048:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc2335480 going to sleep for 11 seconds 00000100:00100000:0.0:1788309692.168633:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048174080 00000100:00100000:0.0:1788309692.168637:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048174080 00000100:00100000:0.0:1788309692.168739:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788309692.168748:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:25048:x1875178048174080:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788309692.168757:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309692.168768:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30edf5b600/0x98c38120c44af7e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af7dd expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309692.168797:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30edf5b600/0x98c38120c44af7e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af7dd expref: 22 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309692.168807:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30edf5b600/0x98c38120c44af7e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af7dd expref: 22 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309692.168815:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30edf5b600, rc 0) 00000100:00100000:0.0:1788309692.168878:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+22:25048:x1875178048174080:12345-0@lo:101:mount.lustre.0 Request processed in 131us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309692.168884:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788309692.168976:0:25048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048174080:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788309692.168990:0:25048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c30d12dae00/0x98c38120c44af7dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af7e4 expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309692.168998:0:25048:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c30d12dae00/0x98c38120c44af7dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af7e4 expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788309692.170016:0:25048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1788309692.170540:0:25048:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788309692.172366:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788309692.172409:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788309692.172424:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788309692.172437:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788309692.172452:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788309692.172467:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788309692.172480:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788309692.172493:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788309692.172506:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1788309692.172528:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1788309692.172534:0:25048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1788309692.172628:0:25048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048174208:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788309692.172687:0:25048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309692.172788:0:25048:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c30bd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309692.172899:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048174208 00000100:00100000:0.0:1788309692.172907:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048174208 00000100:00100000:0.0:1788309692.172968:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788309692.172978:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+22:25048:x1875178048174208:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788309692.173110:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+22:25048:x1875178048174208:12345-0@lo:501:mount.lustre.0 Request processed in 133us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309692.173118:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788309692.173294:0:25048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048174208:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788309692.173327:0:25048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048174336:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788309692.173370:0:25048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309692.173389:0:25048:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c30bd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788309692.173443:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048174336 00000100:00100000:2.0:1788309692.173449:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048174336 00000100:00100000:2.0:1788309692.173471:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788309692.173478:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+22:25048:x1875178048174336:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788309692.174266:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+22:25048:x1875178048174336:12345-0@lo:503:mount.lustre.0 Request processed in 786us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309692.174274:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788309692.174366:0:25048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048174336:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788309692.174914:0:25048:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788309692.174999:0:25048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048174464:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788309692.175048:0:25048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309692.175075:0:25048:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30d28f5600 going to sleep for 11 seconds 00000100:00100000:0.0:1788309692.175197:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048174464 00000100:00100000:0.0:1788309692.175204:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048174464 00000100:00100000:0.0:1788309692.175246:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788309692.175255:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+22:25048:x1875178048174464:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788309692.175735:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+22:25048:x1875178048174464:12345-0@lo:502:mount.lustre.0 Request processed in 479us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309692.175744:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788309692.175911:0:25048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048174464:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788309692.176153:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788309692.176183:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788309692.176198:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788309692.176216:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788309692.176230:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788309692.176244:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788309692.176257:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788309692.176268:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788309692.176282:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1788309692.176309:0:25048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048174592:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788309692.176352:0:25048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309692.176432:0:25048:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30d28f5600 going to sleep for 11 seconds 00000100:00100000:2.0:1788309692.176493:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048174592 00000100:00100000:2.0:1788309692.176504:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048174592 00000100:00100000:2.0:1788309692.176548:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788309692.176556:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+22:25048:x1875178048174592:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788309692.176759:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+22:25048:x1875178048174592:12345-0@lo:502:mount.lustre.0 Request processed in 203us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309692.176766:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788309692.177044:0:25048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048174592:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788309692.177112:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1788309692.177122:0:25048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1788309692.177761:0:25052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788309692.177769:0:25052:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788309692.177785:0:25052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309692.177788:0:25052:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788309692.177793:0:25052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788309692.177807:0:25052:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8c30ed8c8000) 00000020:00000080:0.0:1788309692.177828:0:25052:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788309692.177833:0:25052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788309692.180105:0:25052:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c30fbbcb800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788309692.180120:0:25052:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788309692.180129:0:25052:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x98c38120c44af7f2 00010000:00010000:0.0:1788309692.184209:0:25052:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1788309692.184591:0:25052:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:0.0:1788309692.186072:0:25052:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1788309692.187115:0:25052:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788309692.187131:0:25052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788309692.187136:0:25052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309692.187138:0:25052:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788309692.187141:0:25052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788309692.187144:0:25052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309692.187146:0:25052:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788309692.187148:0:25052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788309692.187150:0:25052:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788309692.187152:0:25052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788309692.187154:0:25052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309692.187155:0:25052:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788309692.187157:0:25052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788309692.187159:0:25052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309692.187161:0:25052:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788309692.187163:0:25052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788309692.187186:0:25052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788309692.187188:0:25052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788309692.187189:0:25052:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788309692.187192:0:25052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1788309692.188052:0:25048:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788309692.188083:0:25048:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788309692.188104:0:25048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30d12dae00/0x98c38120c44af7dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af7e4 expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309692.188116:0:25048:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30d12dae00/0x98c38120c44af7dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af7e4 expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788309692.188124:0:25048:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c30fbbcb800 from 1 10000000:01000000:3.0:1788309692.188126:0:25048:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788309692.188159:0:25048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30d12daa00/0x98c38120c44af7f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309692.188167:0:25048:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c30d12daa00/0x98c38120c44af7f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309692.188185:0:25048:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c30d12daa00/0x98c38120c44af7f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309692.188206:0:25048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048174720:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788309692.188263:0:25048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309692.189051:0:25048:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30d28f5600 going to sleep for 11 seconds 00000100:00100000:2.0:1788309692.189159:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048174720 00000100:00100000:2.0:1788309692.189166:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048174720 00000100:00100000:2.0:1788309692.189248:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788309692.189258:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+22:25048:x1875178048174720:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788309692.189269:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309692.189284:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30fba6b400/0x98c38120c44af800 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af7f9 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309692.189306:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30fba6b400/0x98c38120c44af800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af7f9 expref: 23 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309692.189317:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30fba6b400/0x98c38120c44af800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af7f9 expref: 23 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309692.189325:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30fba6b400, rc 0) 00000100:00100000:2.0:1788309692.189381:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+23:25048:x1875178048174720:12345-0@lo:101:mount.lustre.0 Request processed in 125us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309692.189387:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788309692.189452:0:25048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048174720:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788309692.189467:0:25048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c30d12daa00/0x98c38120c44af7f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af800 expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309692.189477:0:25048:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c30d12daa00/0x98c38120c44af7f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af800 expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788309692.196049:0:25048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1788309692.196363:0:25048:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788309692.196589:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788309692.196615:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788309692.196632:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788309692.196647:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788309692.197079:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788309692.197098:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788309692.197111:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1788309692.197122:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1788309692.197134:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1788309692.197146:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1788309692.197167:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1788309692.197186:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1788309692.197191:0:25048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1788309692.197309:0:25048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048174848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788309692.197370:0:25048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309692.197454:0:25048:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f638c240 going to sleep for 11 seconds 00000100:00100000:0.0:1788309692.197501:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048174848 00000100:00100000:0.0:1788309692.197507:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048174848 00000100:00100000:0.0:1788309692.197588:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788309692.197598:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+23:25048:x1875178048174848:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788309692.197711:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+23:25048:x1875178048174848:12345-0@lo:501:mount.lustre.0 Request processed in 115us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309692.197726:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788309692.197802:0:25048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048174848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788309692.197831:0:25048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048174976:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788309692.197897:0:25048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309692.198220:0:25048:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f638c240 going to sleep for 11 seconds 00000100:00100000:3.0:1788309692.198259:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048174976 00000100:00100000:3.0:1788309692.198264:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048174976 00000100:00100000:2.0:1788309692.198303:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788309692.198312:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+23:25048:x1875178048174976:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788309692.198399:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+23:25048:x1875178048174976:12345-0@lo:503:mount.lustre.0 Request processed in 87us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309692.198414:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788309692.198497:0:25048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048174976:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788309692.198867:0:25048:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788309692.198927:0:25048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048175104:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788309692.199041:0:25048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309692.199066:0:25048:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f638c240 going to sleep for 11 seconds 00000100:00100000:2.0:1788309692.199129:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048175104 00000100:00100000:2.0:1788309692.199133:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048175104 00000100:00100000:2.0:1788309692.199158:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788309692.199166:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+23:25048:x1875178048175104:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788309692.199258:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+23:25048:x1875178048175104:12345-0@lo:502:mount.lustre.0 Request processed in 92us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309692.199264:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788309692.199339:0:25048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048175104:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788309692.199485:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788309692.199507:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788309692.199519:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788309692.199532:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788309692.199544:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788309692.199571:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788309692.199585:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788309692.199598:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1788309692.199611:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788309692.199623:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1788309692.199637:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1788309692.199666:0:25048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048175232:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788309692.199701:0:25048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309692.199767:0:25048:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f638c240 going to sleep for 11 seconds 00000100:00100000:0.0:1788309692.199870:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048175232 00000100:00100000:0.0:1788309692.199874:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048175232 00000100:00100000:0.0:1788309692.199900:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788309692.199907:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+23:25048:x1875178048175232:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788309692.200058:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+23:25048:x1875178048175232:12345-0@lo:502:mount.lustre.0 Request processed in 150us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309692.200065:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788309692.200235:0:25048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048175232:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788309692.200276:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1788309692.200283:0:25048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788309692.201186:0:25056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788309692.201196:0:25056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309692.201198:0:25056:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788309692.201206:0:25056:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c30fbbcb800 00000020:00000080:1.0:1788309692.201209:0:25056:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788309692.201216:0:25056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788309692.201218:0:25056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309692.201219:0:25056:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788309692.201222:0:25056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788309692.201224:0:25056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309692.201225:0:25056:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788309692.201228:0:25056:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c30fbbcb800 00000020:00000080:1.0:1788309692.201231:0:25056:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788309692.201285:0:25056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788309692.201289:0:25056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309692.201290:0:25056:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788309692.201293:0:25056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788309692.201295:0:25056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309692.201296:0:25056:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788309692.201300:0:25056:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c30fbbcb800 00000020:00000080:1.0:1788309692.201302:0:25056:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788309692.201319:0:25056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788309692.201322:0:25056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309692.201323:0:25056:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788309692.201325:0:25056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788309692.201333:0:25056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309692.201335:0:25056:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788309692.201339:0:25056:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c30fbbcb800 00000020:00000080:1.0:1788309692.201341:0:25056:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788309692.201362:0:25056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788309692.201364:0:25056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788309692.201366:0:25056:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788309692.201368:0:25056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1788309692.203010:0:25048:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788309692.203065:0:25048:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788309692.203091:0:25048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30d12daa00/0x98c38120c44af7f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af800 expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309692.203103:0:25048:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30d12daa00/0x98c38120c44af7f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af800 expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309692.203159:0:25048:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788309692.203163:0:25048:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c30fbbcb800 10000000:01000000:1.0:1788309692.203165:0:25048:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c30fbbcb800 10000000:01000000:1.0:1788309692.203169:0:25048:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788309692.203175:0:25048:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c30fbbcb800 from 1 10000000:01000000:1.0:1788309692.203178:0:25048:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788309692.203211:0:25048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1e00/0x98c38120c44af807 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309692.203219:0:25048:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1e00/0x98c38120c44af807 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309692.203230:0:25048:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1e00/0x98c38120c44af807 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309692.203251:0:25048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048175360:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788309692.203316:0:25048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309692.203349:0:25048:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f638c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788309692.203412:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048175360 00000100:00100000:3.0:1788309692.203419:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048175360 00000100:00100000:3.0:1788309692.203468:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788309692.203478:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+23:25048:x1875178048175360:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788309692.203489:0:22720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309692.203500:0:22720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30d12db400/0x98c38120c44af80e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af807 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309692.203523:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30d12db400/0x98c38120c44af80e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af807 expref: 24 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309692.203532:0:22720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30d12db400/0x98c38120c44af80e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af807 expref: 24 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309692.203540:0:22720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30d12db400, rc 0) 00000100:00100000:3.0:1788309692.203576:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:25048:x1875178048175360:12345-0@lo:101:mount.lustre.0 Request processed in 100us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309692.203582:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788309692.203660:0:25048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048175360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788309692.203674:0:25048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1e00/0x98c38120c44af807 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af80e expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309692.203684:0:25048:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1e00/0x98c38120c44af807 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af80e expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788309692.207187:0:25048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1788309692.207476:0:25048:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788309692.207664:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788309692.207690:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1788309692.207707:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1788309692.207721:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1788309692.207735:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1788309692.207749:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1788309692.207763:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1788309692.207792:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1788309692.207809:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788309692.207824:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1788309692.207861:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1788309692.207878:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1788309692.207908:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1788309692.207924:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1788309692.208006:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1788309692.208025:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1788309692.208040:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1788309692.208051:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1788309692.208065:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1788309692.208078:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1788309692.208101:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1788309692.208114:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1788309692.208127:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1788309692.208140:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1788309692.208152:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1788309692.208163:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1788309692.208174:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1788309692.208185:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1788309692.208209:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1788309692.208224:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1788309692.208236:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1788309692.208249:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1788309692.208263:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1788309692.208277:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1788309692.208291:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1788309692.208305:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1788309692.208318:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1788309692.208333:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1788309692.208348:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1788309692.208362:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1788309692.208376:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1788309692.208390:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1788309692.208404:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1788309692.208418:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1788309692.208447:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1788309692.208463:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1788309692.208477:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1788309692.208493:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1788309692.208615:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1788309692.208637:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1788309692.208655:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1788309692.208660:0:25048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1788309692.208745:0:25048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048175488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788309692.208822:0:25048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309692.211922:0:25048:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f638c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788309692.213068:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048175488 00000100:00100000:2.0:1788309692.213079:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048175488 00000100:00100000:2.0:1788309692.213127:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788309692.213136:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:25048:x1875178048175488:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788309692.213281:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:25048:x1875178048175488:12345-0@lo:501:mount.lustre.0 Request processed in 145us (4458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309692.213288:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788309692.214296:0:25048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048175488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788309692.214344:0:25048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048175616:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788309692.214396:0:25048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309692.214424:0:25048:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f638c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788309692.214923:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048175616 00000100:00100000:2.0:1788309692.214930:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048175616 00000100:00100000:2.0:1788309692.214971:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788309692.214980:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:25048:x1875178048175616:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788309692.215171:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:25048:x1875178048175616:12345-0@lo:503:mount.lustre.0 Request processed in 191us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309692.215177:0:25048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048175616:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788309692.215178:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000040:00080000:1.0:1788309692.215556:0:25048:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788309692.215619:0:25048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048175744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788309692.215657:0:25048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309692.215730:0:25048:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f638c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788309692.216628:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048175744 00000100:00100000:0.0:1788309692.216635:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048175744 00000100:00100000:0.0:1788309692.216874:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788309692.216999:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:25048:x1875178048175744:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788309692.217140:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:25048:x1875178048175744:12345-0@lo:502:mount.lustre.0 Request processed in 258us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309692.217148:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788309692.217163:0:25048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048175744:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788309692.217348:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788309692.217377:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788309692.217392:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788309692.217406:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788309692.217419:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788309692.217431:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788309692.217457:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788309692.217472:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788309692.217484:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788309692.217495:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788309692.217506:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788309692.217518:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788309692.217529:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788309692.217634:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788309692.217652:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788309692.217675:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788309692.217689:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788309692.217701:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788309692.217713:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788309692.217725:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788309692.217737:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788309692.217747:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788309692.217770:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788309692.217801:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788309692.217814:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1788309692.217826:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1788309692.217856:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1788309692.217872:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1788309692.217883:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1788309692.217896:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1788309692.217908:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1788309692.217918:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1788309692.217989:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1788309692.218010:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1788309692.218022:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1788309692.218034:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1788309692.218047:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1788309692.218060:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1788309692.218087:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1788309692.218101:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1788309692.218114:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1788309692.218127:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1788309692.218141:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1788309692.218155:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1788309692.218167:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1788309692.218178:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1788309692.218190:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1788309692.218202:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1788309692.218253:0:25048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048175872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788309692.218305:0:25048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309692.218340:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048175872 00000100:00100000:1.0:1788309692.218345:0:25048:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f638c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788309692.218345:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048175872 00000100:00100000:0.0:1788309692.218381:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788309692.218388:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:25048:x1875178048175872:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788309692.218495:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:25048:x1875178048175872:12345-0@lo:502:mount.lustre.0 Request processed in 107us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309692.218502:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788309692.219065:0:25048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048175872:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788309692.219216:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1788309692.219241:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1788309692.219268:0:25048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048176000:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788309692.219313:0:25048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309692.219344:0:25048:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f638c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788309692.219582:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048176000 00000100:00100000:0.0:1788309692.219588:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048176000 00000100:00100000:0.0:1788309692.219628:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788309692.219636:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:25048:x1875178048176000:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788309692.219852:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:25048:x1875178048176000:12345-0@lo:502:mount.lustre.0 Request processed in 192us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309692.219860:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788309692.219927:0:25048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048176000:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788309692.220044:0:25048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1788309692.220053:0:25048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788309692.224137:0:25061:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788309692.224154:0:25061:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8c30c7b34d28) 00000020:00000080:3.0:1788309692.224184:0:25061:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1788309692.224272:0:25061:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c30fbbcb800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788309692.224277:0:25061:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c30fbbcb800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788309692.224279:0:25061:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c30fbbcb800 3 00010000:00080000:3.0:1788309692.224318:0:25061:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c30f50a8800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.132@tcp at head 00010000:00010000:3.0:1788309692.227454:0:25061:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1788309692.228032:0:25061:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788309692.228077:0:25061:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788309692.228090:0:25061:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x98c38120c44af81c 00000100:00080000:3.0:1788309692.228099:0:25061:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788309692.228104:0:25061:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c30f50a8800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:3.0:1788309692.228134:0:25061:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30fbbf2a00 x1875178048176128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788309692.228161:0:25061:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788309692.228279:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1875178048176128:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788309692.228344:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309692.228827:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048176128 00000100:00100000:1.0:1788309692.228834:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048176128 00000100:00080000:3.0:1788309692.229079:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788309692.229083:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788309692.229086:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c30f9a1b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788309692.229091:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 601 00000100:00080000:3.0:1788309692.229094:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788309692.229099:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c30f9a1b800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:3.0:1788309692.229114:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30fbbf3480 x1875178048176512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788309692.229114:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788309692.229122:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d3b06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1875178048176128:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788309692.229144:0:22727:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 602 last 0 00000100:00080000:3.0:1788309692.229147:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788309692.229149:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788309692.229151:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c30c7fef800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788309692.229154:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 601 00000100:00080000:3.0:1788309692.229162:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788309692.229165:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8c30c7fef800 using connection 192.168.206.132@tcp/0@lo 00000020:00000080:1.0:1788309692.229174:0:22727:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x98c38120c44af823 00000100:00100000:3.0:1788309692.229176:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c2fc40e2a00 x1875178048177024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00100000:1.0:1788309692.229188:0:22727:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1788309692.229211:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048176256:0@lo:400:kworker.0 00000100:00080000:1.0:1788309692.229217:0:22727:0:(import.c:65:import_set_state_nolock()) ffff8c2fc2a7c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788309692.229250:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309692.229274:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc40e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875178048176896:0@lo:400:kworker.0 00000100:00100000:3.0:1788309692.229295:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309692.229316:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788309692.229321:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048176384:0@lo:400:kworker.0 00000100:00100000:3.0:1788309692.229340:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309692.229353:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc40e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875178048177152:0@lo:400:kworker.0 00000100:00100000:3.0:1788309692.229373:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309692.229398:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc40e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875178048176640:0@lo:400:kworker.0 00000100:00100000:3.0:1788309692.229417:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309692.229430:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc40e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875178048177280:0@lo:400:kworker.0 00000100:00100000:3.0:1788309692.229446:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309692.229457:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788309692.229462:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc40e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048176768:0@lo:400:kworker.0 00000100:00100000:3.0:1788309692.229479:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309692.229494:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc40e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875178048177408:0@lo:400:kworker.0 00000100:00100000:3.0:1788309692.229515:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309692.229534:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048176896 00000100:00100000:3.0:1788309692.229538:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048176896 00000100:00100000:2.0:1788309692.230038:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048177152 00000100:00100000:2.0:1788309692.230049:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048177152 00000100:00100000:1.0:1788309692.230207:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d3b06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875178048176128:12345-0@lo:38:llog_process_th.0 Request processed in 1083us (1861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309692.230216:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788309692.230232:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048176640 00000100:00100000:1.0:1788309692.230235:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048176640 00000100:00100000:1.0:1788309692.230249:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048177280 00000100:00100000:1.0:1788309692.230256:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048177280 00000100:00100000:2.0:1788309692.230293:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048177408 00000100:00100000:2.0:1788309692.230297:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048177408 00000100:00100000:2.0:1788309692.230317:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788309692.230324:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc40e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875178048177152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309692.230367:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc40e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875178048177152:12345-0@lo:400:kworker.0 Request processed in 44us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309692.230373:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788309692.230385:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788309692.230390:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc40e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875178048176640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309692.230422:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc40e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875178048176640:12345-0@lo:400:kworker.0 Request processed in 31us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309692.230428:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788309692.230439:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788309692.230445:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc40e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875178048177408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309692.230470:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc40e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875178048177408:12345-0@lo:400:kworker.0 Request processed in 27us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309692.230475:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788309692.230497:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048176512:0@lo:8:kworker.0 00000100:00100000:2.0:1788309692.230525:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309692.230546:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc40e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048177024:0@lo:8:kworker.0 00000100:00100000:2.0:1788309692.230566:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788309692.230590:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c30fbbf2a00 x1875178048176128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788309702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309692.230600:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788309692.230607:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788309692.230619:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788309692.230623:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788309692.230626:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30f50a8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788309692.230633:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1875178048176128:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788309692.230788:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c2fc40e0000 x1875178048177408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309692.230799:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc40e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875178048177408:0@lo:400:kworker.0 00010000:00080000:2.0:1788309692.230810:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c2fc40e1180 x1875178048176640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309692.230811:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048176256 00000100:00100000:0.0:1788309692.230815:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048176256 00000100:00100000:2.0:1788309692.230818:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc40e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875178048176640:0@lo:400:kworker.0 00000100:00100000:0.0:1788309692.230859:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048176768 00010000:00080000:2.0:1788309692.230862:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c2fc40e0a80 x1875178048177152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309692.230862:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048176768 00000100:00100000:2.0:1788309692.230872:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc40e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875178048177152:0@lo:400:kworker.0 00000100:00100000:0.0:1788309692.230882:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788309692.230888:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc40e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048176256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309692.230930:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc40e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048176256:12345-0@lo:400:kworker.0 Request processed in 42us (1679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309692.231068:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048176384 00000100:00100000:3.0:1788309692.231077:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048176384 00000100:00100000:3.0:1788309692.231095:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048176512 00000100:00100000:3.0:1788309692.231098:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048176512 00000100:00100000:3.0:1788309692.231105:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048177024 00000100:00100000:3.0:1788309692.231107:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048177024 00000100:00100000:3.0:1788309692.231116:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788309692.231122:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc40e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875178048176896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309692.231154:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc40e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875178048176896:12345-0@lo:400:kworker.0 Request processed in 33us (1858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309692.231160:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788309692.231172:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788309692.231176:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc40e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048176384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309692.231201:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc40e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048176384:12345-0@lo:400:kworker.0 Request processed in 25us (1860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309692.231207:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788309692.231217:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788309692.231221:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d3b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3616:x1875178048176512:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788309692.231266:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d3b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3616:x1875178048176512:12345-0@lo:8:kworker.0 Request processed in 43us (740us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788309692.231272:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788309692.231275:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788309692.231280:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30f9a1b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1788309692.231283:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788309692.231284:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788309692.231286:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d3b04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3616:x1875178048177024:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788309692.231287:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048176512:0@lo:8:kworker.0 00000100:00100000:3.0:1788309692.231324:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d3b04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3616:x1875178048177024:12345-0@lo:8:kworker.0 Request processed in 36us (757us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788309692.231328:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00100000:3.0:1788309692.231330:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788309692.231332:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30c7fef800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788309692.231335:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788309692.231337:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc40e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048177024:0@lo:8:kworker.0 00000100:00100000:0.0:1788309692.231389:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788309692.231404:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788309692.231410:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc40e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048176768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309692.231498:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc40e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048176768:12345-0@lo:400:kworker.0 Request processed in 89us (2017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309692.231505:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788309692.231546:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048176384:0@lo:400:kworker.0 00000100:00100000:0.0:1788309692.231556:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048176256:0@lo:400:kworker.0 00000100:00100000:0.0:1788309692.231570:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc40e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875178048176896:0@lo:400:kworker.0 00000100:00100000:3.0:1788309692.233460:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc40e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048176768:0@lo:400:kworker.0 00000020:01000004:0.0:1788309692.234074:0:25061:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788309692.234098:0:25061:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8c2fc2ab4d28) 00000020:00000080:0.0:1788309692.234121:0:25061:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788309692.234200:0:25061:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c30fbbcb800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788309692.234204:0:25061:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c30fbbcb800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788309692.234213:0:25061:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c30fbbcb800 3 00010000:00080000:0.0:1788309692.234239:0:25061:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c2fc2041800@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.132@tcp at head 00000100:00100000:1.0:1788309692.234248:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788309692.234262:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc40e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875178048177280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309692.234341:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc40e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875178048177280:12345-0@lo:400:kworker.0 Request processed in 85us (4893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309692.234349:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1788309692.234369:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788309692.234374:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788309692.234376:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788309692.234404:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c2fc40e2d80 x1875178048177280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309692.234416:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc40e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875178048177280:0@lo:400:kworker.0 00010000:00010000:0.0:1788309692.236131:0:25061:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1788309692.236342:0:25061:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788309692.236381:0:25061:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788309692.236392:0:25061:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x98c38120c44af831 00000100:00080000:0.0:1788309692.236400:0:25061:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788309692.236405:0:25061:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8c2fc2041800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:0.0:1788309692.236441:0:25061:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c2fc401ad80 x1875178048177536/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788309692.236469:0:25061:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788309692.236651:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1875178048177536:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788309692.236721:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309692.236753:0:25009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048177536 00000100:00100000:2.0:1788309692.236759:0:25009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048177536 00000100:00100000:2.0:1788309692.236805:0:25009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788309692.236813:0:25009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc40e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1875178048177536:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788309692.236836:0:25009:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 602 last 0 00000040:00080000:0.0:1788309692.236919:0:25061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:00000080:2.0:1788309692.237249:0:25009:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x98c38120c44af838 00000004:00100000:2.0:1788309692.237263:0:25009:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788309692.237291:0:25009:0:(import.c:65:import_set_state_nolock()) ffff8c2fc4307800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788309692.237352:0:25009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc40e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875178048177536:12345-0@lo:38:llog_process_th.0 Request processed in 538us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309692.237360:0:25009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788309692.237414:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c2fc401ad80 x1875178048177536/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788309702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309692.237425:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788309692.237432:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1788309692.237438:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788309692.237442:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788309692.237444:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c2fc2041800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788309692.237450:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1875178048177536:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1788309692.237551:0:25048:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788309692.237603:0:25048:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788309692.237625:0:25048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1e00/0x98c38120c44af807 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af80e expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309692.237636:0:25048:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f1e00/0x98c38120c44af807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af80e expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788309692.237711:0:25048:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788309692.237713:0:25048:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788309692.237715:0:25048:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788309692.237716:0:25048:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788309692.237717:0:25048:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788309692.237718:0:25048:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788309692.237719:0:25048:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788309692.237721:0:25048:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788309692.237722:0:25048:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788309692.237726:0:25048:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788309692.237728:0:25048:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788309692.237732:0:25048:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788309692.237733:0:25048:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788309692.237734:0:25048:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788309692.237735:0:25048:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788309692.237736:0:25048:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788309692.237736:0:25048:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788309692.237737:0:25048:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788309692.237738:0:25048:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788309692.237754:0:25048:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788309692.237766:0:25048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048177664:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788309692.237816:0:25048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309692.237862:0:25048:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f638c900 going to sleep for 11 seconds 00000100:00100000:1.0:1788309692.237878:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048177664 00000100:00100000:1.0:1788309692.237883:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048177664 00000100:00100000:1.0:1788309692.237913:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788309692.237920:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:25048:x1875178048177664:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788309692.238016:0:22722:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788309692.238030:0:22722:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788309692.244396:0:22722:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788309692.244417:0:22722:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788309692.244557:0:22744:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788309692.244563:0:22744:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788309692.244583:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c30d12da600/0x98c38120c44af83f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309692.244600:0:22744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c30c1512a00/0x98c38120c44af7b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af7ac expref: 24 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309692.244609:0:22744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c30c1512800/0x98c38120c44af7c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af7ba expref: 24 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309692.244616:0:22744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c30d12da600/0x98c38120c44af83f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309692.244652:0:22744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c30c1512800/0x98c38120c44af7c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x98c38120c44af7ba expref: 24 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309692.244665:0:22744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c30c1512800/0x98c38120c44af7c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x98c38120c44af7ba expref: 24 pid: 22719 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309692.244693:0:22744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc40e2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22744:1875178048177792:0@lo:104: 00000100:00100000:3.0:1788309692.244751:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788309692.244862:0:22744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c30c1512a00/0x98c38120c44af7b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x98c38120c44af7ac expref: 24 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309692.244872:0:22744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c30c1512a00/0x98c38120c44af7b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x98c38120c44af7ac expref: 24 pid: 22720 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309692.244881:0:22744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc40e3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22744:1875178048177920:0@lo:104: 00000100:00100000:3.0:1788309692.244904:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309692.245031:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:25048:x1875178048177664:12345-0@lo:253:mount.lustre.0 Request processed in 7109us (7213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309692.245041:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788309692.245101:0:25048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b0d6b2e-d97d-4371-bf12-107712db0d6d:25048:1875178048177664:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788309692.245113:0:25048:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788309692.245116:0:25048:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788309692.245118:0:25048:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788309692.245120:0:25048:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788309692.245121:0:25048:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788309692.245122:0:25048:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788309692.245124:0:25048:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788309692.245125:0:25048:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788309692.245127:0:25048:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788309692.245134:0:25048:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788309692.245148:0:25048:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788309692.246659:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048177792 00000100:00100000:0.0:1788309692.246668:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048177792 00000100:00100000:3.0:1788309692.246693:0:22744:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f997de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788309692.246697:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048177920 00000100:00100000:0.0:1788309692.246700:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048177920 00000100:00100000:0.0:1788309692.246714:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788309692.246723:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc40e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+4:22744:x1875178048177792:12345-0@lo:104: 00010000:00010000:0.0:1788309692.246736:0:22711:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff8c30c1513800/0x98c38120c44af7ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af7c1 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309692.246824:0:22711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788309692.246830:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc40e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+4:22744:x1875178048177792:12345-0@lo:104: Request processed in 108us (2079us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309692.246851:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788309692.246869:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788309692.246875:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc40e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+3:22744:x1875178048177920:12345-0@lo:104: 00010000:00010000:2.0:1788309692.246878:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309692.246884:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c30c1513800/0x98c38120c44af7ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af7c1 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309692.246892:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30c1513800 already unused, calling callback (ffffffffc1507c20) 10000000:00010000:2.0:1788309692.246896:0:23881:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c30c1513800/0x98c38120c44af7ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x98c38120c44af7c1 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309692.246904:0:23881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c30c1513800/0x98c38120c44af7ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x98c38120c44af7c1 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788309692.246912:0:23881:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c30c1513800/0x98c38120c44af7ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x98c38120c44af7c1 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309692.246917:0:23881:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788309692.246959:0:23881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff8c30c1513800/0x98c38120c44af7ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af7c1 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309692.246966:0:23881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788309692.246984:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c30c1513800/0x98c38120c44af7ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af7c1 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309692.246998:0:23881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c30c1513800/0x98c38120c44af7ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af7c1 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309692.247009:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309692.247010:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309692.247012:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309692.247204:0:22711:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af7ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af7b3 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309692.247530:0:22711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788309692.247535:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc40e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+3:22744:x1875178048177920:12345-0@lo:104: Request processed in 661us (2631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309692.247543:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788309692.247566:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3619:1875178048178048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788309692.247596:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788309692.247630:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309692.247635:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af7ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af7b3 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309692.247641:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30c1513600 already unused, calling callback (ffffffffc1507c20) 10000000:00010000:0.0:1788309692.247644:0:22716:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af7ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x98c38120c44af7b3 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309692.247652:0:22716:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af7ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x98c38120c44af7b3 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788309692.247658:0:22716:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af7ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x98c38120c44af7b3 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309692.247663:0:22716:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788309692.247683:0:22716:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af7ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af7b3 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309692.247689:0:22716:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788309692.247698:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af7ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af7b3 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309692.247714:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c30c1513600/0x98c38120c44af7ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af7b3 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309692.247728:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309692.247729:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309692.247730:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309692.247739:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048178048 00000100:00100000:0.0:1788309692.247743:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048178048 00010000:00010000:0.0:1788309692.247761:0:22714:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c30c1512800/0x98c38120c44af7c1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af7ba expref: 24 pid: 22719 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309692.247794:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788309692.247801:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc401a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:3619:x1875178048178048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788309692.247810:0:22714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309692.247815:0:22714:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c30c1512800/0x98c38120c44af7c1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af7ba expref: 24 pid: 22719 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309692.247825:0:22714:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c30c1512800/0x98c38120c44af7c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x98c38120c44af7ba expref: 24 pid: 22719 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309692.247861:0:22714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309692.247997:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc401a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:3619:x1875178048178048:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309692.248004:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788309692.248023:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3620:1875178048178176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788309692.248106:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309692.248148:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3619:1875178048178048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788309692.248176:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048178176 00000100:00100000:0.0:1788309692.248179:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048178176 00010000:00010000:0.0:1788309692.248191:0:22713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c30c1512a00/0x98c38120c44af7b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af7ac expref: 24 pid: 22720 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309692.248208:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788309692.248213:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc401b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:3620:x1875178048178176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788309692.248231:0:22713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309692.248236:0:22713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c30c1512a00/0x98c38120c44af7b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af7ac expref: 24 pid: 22720 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309692.248244:0:22713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c30c1512a00/0x98c38120c44af7b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x98c38120c44af7ac expref: 24 pid: 22720 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309692.248256:0:22713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c30d12da600/0x98c38120c44af83f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309692.248330:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30d12da600/0x98c38120c44af83f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788309692.248345:0:22713:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003783523s 00010000:00010000:0.0:1788309692.248350:0:22713:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c30d12da600/0x98c38120c44af83f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309692.248357:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c30d12da600/0x98c38120c44af83f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309692.248364:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c30d12da600/0x98c38120c44af83f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309692.248370:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c30d12da600/0x98c38120c44af83f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309692.248380:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d12da600 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309692.248385:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c30d12da600/0x98c38120c44af83f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309692.248392:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c30d12da600/0x98c38120c44af83f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309692.248400:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c30d12da600/0x98c38120c44af83f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309692.248408:0:22713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309692.248516:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc401b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:3620:x1875178048178176:12345-0@lo:103:ldlm_bl.0 Request processed in 302us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309692.248523:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788309692.248618:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3620:1875178048178176:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788309692.249042:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30c1512800/0x98c38120c44af7c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x98c38120c44af7ba expref: 23 pid: 22719 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309692.249054:0:22744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc40e2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22744:1875178048177792:0@lo:104: 00010000:00010000:3.0:1788309692.249065:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30c1512a00/0x98c38120c44af7b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x98c38120c44af7ac expref: 22 pid: 22720 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309692.249071:0:22744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc40e3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22744:1875178048177920:0@lo:104: 00010000:00010000:3.0:1788309692.249085:0:22744:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c30d12da600/0x98c38120c44af83f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309692.249093:0:22744:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c30d12da600/0x98c38120c44af83f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309692.249098:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c30d12da600/0x98c38120c44af83f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309692.249114:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30d12da600/0x98c38120c44af83f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1788309692.251310:0:25048:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1788309692.254680:0:25048:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788309692.254689:0:25048:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788309692.254752:0:25048:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788309692.254800:0:25048:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.132@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788309692.254817:0:25048:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788309692.254856:0:25048:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788309692.255477:0:25048:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788309692.255670:0:25048:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788309692.395209:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309692.523481:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875178048178304:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788309692.523550:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309692.523679:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048178304 00000100:00100000:0.0:1788309692.523686:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048178304 00000100:00100000:0.0:1788309692.523728:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788309692.523737:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875178048178304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788309692.523770:0:22732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788309692.524119:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875178048178304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309692.524128:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788309692.524171:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875178048178304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788309692.524185:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788309692.524191:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048178432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788309692.524217:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309692.524244:0:23468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048178432 00000100:00100000:0.0:1788309692.524248:0:23468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048178432 00000100:00100000:0.0:1788309692.524270:0:23468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788309692.524275:0:23468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc401aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048178432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788309692.524292:0:23468:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788309692.524322:0:23468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc401aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048178432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 46us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309692.524328:0:23468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788309692.524353:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048178432:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1788309693.075335:0:25115:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788309693.075566:0:25115:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788309693.419414:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788309694.190629:0:22724:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788309694.190637:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c2fc33d3000 from 14 10000000:01000000:0.0:1788309694.190642:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788309694.190684:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b200/0x98c38120c44af846 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309694.190696:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b200/0x98c38120c44af846 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309694.190707:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b200/0x98c38120c44af846 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309694.190747:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc401a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048178560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788309694.190819:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309694.190881:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c5726c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788309694.192126:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048178560 00000100:00100000:1.0:1788309694.192137:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048178560 00000100:00100000:1.0:1788309694.192195:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788309694.192205:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+22:22724:x1875178048178560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788309694.192218:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309694.192234:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c2fc35f1a00/0x98c38120c44af84d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af846 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309694.192258:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c2fc35f1a00/0x98c38120c44af84d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af846 expref: 23 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309694.192269:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c2fc35f1a00/0x98c38120c44af84d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af846 expref: 23 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309694.192278:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c2fc35f1a00, rc 0) 00000100:00100000:1.0:1788309694.192338:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+23:22724:x1875178048178560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (1519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309694.192344:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788309694.192399:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc401a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048178560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788309694.192417:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b200/0x98c38120c44af846 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af84d expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309694.192427:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b200/0x98c38120c44af846 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af84d expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309694.192497:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048178688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788309694.192531:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309694.192556:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc29963c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309694.192569:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048178688 00000100:00100000:1.0:1788309694.192573:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048178688 00000100:00100000:1.0:1788309694.192594:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788309694.192600:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+23:22724:x1875178048178688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788309694.192612:0:22722:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788309694.192627:0:22722:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788309694.192629:0:22722:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788309694.192699:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+23:22724:x1875178048178688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 98us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309694.192706:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788309694.192733:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048178688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788309694.192795:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788309694.192802:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b200/0x98c38120c44af846 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af84d expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309694.192810:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30edf5b200/0x98c38120c44af846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af84d expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788309694.192820:0:22724:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788309694.192822:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c30c83d6000 from 14 10000000:01000000:1.0:1788309694.192825:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788309694.192860:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44af854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309694.192877:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44af854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309694.192885:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44af854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309694.192898:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048178816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788309694.192924:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309694.192938:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc29963c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309694.192949:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048178816 00000100:00100000:1.0:1788309694.192952:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048178816 00000100:00100000:1.0:1788309694.192974:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788309694.192980:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+23:22724:x1875178048178816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788309694.192987:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309694.192994:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c2fc35f1600/0x98c38120c44af85b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44af854 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309694.193007:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c2fc35f1600/0x98c38120c44af85b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44af854 expref: 24 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309694.193014:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c2fc35f1600/0x98c38120c44af85b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af854 expref: 24 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309694.193020:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c2fc35f1600, rc 0) 00000100:00100000:1.0:1788309694.193045:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:22724:x1875178048178816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 65us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309694.193050:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788309694.193086:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048178816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788309694.193096:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44af854 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af85b expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309694.193104:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44af854 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44af85b expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309694.193138:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048178944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788309694.193163:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309694.193180:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc29963c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309694.193189:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048178944 00000100:00100000:1.0:1788309694.193192:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048178944 00000100:00100000:1.0:1788309694.193211:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788309694.193216:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:22724:x1875178048178944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788309694.193226:0:22722:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788309694.193236:0:22722:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788309694.193239:0:22722:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788309694.193288:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:22724:x1875178048178944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 71us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309694.193295:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788309694.193319:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048178944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788309694.193351:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788309694.193356:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44af854 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af85b expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309694.193364:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c2fc35f0c00/0x98c38120c44af854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44af85b expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309694.443046:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309695.478868:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309695.594190:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc40e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048179072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788309695.594261:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309695.594391:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048179072 00000100:00100000:1.0:1788309695.594399:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048179072 00000100:00100000:1.0:1788309695.594464:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788309695.594473:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc401a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048179072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788309695.594499:0:24237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:3.0:1788309695.594565:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788309695.598125:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc401a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048179072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3643us (3854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309695.598141:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788309695.600998:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc40e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048179072:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788309696.491563:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309696.618136:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788309696.618157:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc40e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875178048179200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788309696.618221:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309696.618270:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048179200 00000100:00100000:3.0:1788309696.618277:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048179200 00000100:00100000:3.0:1788309696.618332:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788309696.618341:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc40e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875178048179200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788309696.618363:0:24237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788309696.618405:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc40e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875178048179200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309696.618412:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788309696.618432:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788309696.618469:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc40e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875178048179200:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1788309696.877785:0:22764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788309697.514081:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788309697.643021:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788309697.643027:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788309697.643030:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c30f9a1b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788309697.643041:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c30f9a1b800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:2.0:1788309697.643063:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30d3b04700 x1875178048179840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788309697.643096:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788309697.643099:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788309697.643101:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c30c7fef800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788309697.643105:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8c30c7fef800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:2.0:1788309697.643115:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c30fbbf3100 x1875178048180352/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788309697.643167:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048179584:0@lo:400:kworker.0 00000100:00100000:2.0:1788309697.643233:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309697.643285:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875178048180224:0@lo:400:kworker.0 00000100:00100000:0.0:1788309697.643295:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048179328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788309697.643310:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309697.643347:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875178048180864:0@lo:400:kworker.0 00000100:00100000:2.0:1788309697.643386:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309697.643411:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788309697.643418:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048179712:0@lo:400:kworker.0 00000100:00100000:0.0:1788309697.643423:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309697.643452:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309697.643456:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875178048179968:0@lo:400:kworker.0 00000100:00100000:2.0:1788309697.643475:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875178048180480:0@lo:400:kworker.0 00000100:00100000:1.0:1788309697.644695:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3618:1875178048179456:0@lo:400:kworker.0 00000100:00100000:2.0:1788309697.646388:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309697.646440:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875178048180992:0@lo:400:kworker.0 00000100:00100000:2.0:1788309697.646486:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309697.646528:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048179840:0@lo:8:kworker.0 00000100:00100000:2.0:1788309697.646556:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309697.646578:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048180352:0@lo:8:kworker.0 00000100:00100000:2.0:1788309697.646599:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309697.646633:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048180224 00000100:00100000:2.0:1788309697.646642:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048180224 00000100:00100000:2.0:1788309697.646681:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048179712 00000100:00100000:2.0:1788309697.646685:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048179712 00000100:00100000:2.0:1788309697.646712:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048179840 00000100:00100000:2.0:1788309697.646715:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048179840 00000100:00100000:2.0:1788309697.646723:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048180352 00000100:00100000:2.0:1788309697.646725:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048180352 00000100:00100000:2.0:1788309697.646739:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788309697.646761:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c30c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875178048180224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309697.646815:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c30c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875178048180224:12345-0@lo:400:kworker.0 Request processed in 68us (3504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309697.646823:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788309697.646865:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788309697.646873:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c30cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048179712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309697.646918:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c30cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048179712:12345-0@lo:400:kworker.0 Request processed in 46us (3465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309697.646924:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788309697.646938:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788309697.646943:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3616:x1875178048179840:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788309697.646971:0:24235:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 607 last 0 00000020:00000080:2.0:1788309697.646996:0:24235:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x98c38120c44af862 00002000:00100000:2.0:1788309697.647008:0:24235:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8c30c7368000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788309697.647012:0:24235:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788309697.647014:0:24235:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788309697.647171:0:24235:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788309697.647192:0:24235:0:(import.c:65:import_set_state_nolock()) ffff8c30c736c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788309697.647231:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3616:x1875178048179840:12345-0@lo:8:kworker.0 Request processed in 287us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309697.647238:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788309697.647252:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788309697.647256:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3616:x1875178048180352:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788309697.647284:0:24235:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 607 last 0 00000020:00000080:2.0:1788309697.647298:0:24235:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x98c38120c44af869 00002000:00100000:2.0:1788309697.647305:0:24235:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8c30c736e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788309697.647308:0:24235:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1788309697.647309:0:24235:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788309697.647330:0:24235:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788309697.647342:0:24235:0:(import.c:65:import_set_state_nolock()) ffff8c30c736e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788309697.647373:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3616:x1875178048180352:12345-0@lo:8:kworker.0 Request processed in 115us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309697.647385:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788309697.647409:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048180864 00000100:00100000:2.0:1788309697.647414:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048180864 00000100:00100000:2.0:1788309697.647441:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048180480 00000100:00100000:2.0:1788309697.647445:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048180480 00000100:00100000:2.0:1788309697.647458:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048180992 00000100:00100000:2.0:1788309697.647461:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048180992 00000100:00100000:2.0:1788309697.647475:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788309697.647482:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c30cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875178048180864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309697.647514:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c30cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875178048180864:12345-0@lo:400:kworker.0 Request processed in 33us (4127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309697.647521:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788309697.647533:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788309697.647539:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c30c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875178048180480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309697.647567:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c30c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875178048180480:12345-0@lo:400:kworker.0 Request processed in 28us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309697.647573:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788309697.647583:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788309697.647588:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875178048180992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309697.647616:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875178048180992:12345-0@lo:400:kworker.0 Request processed in 28us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309697.647621:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788309697.647641:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788309697.647645:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788309697.647647:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788309697.647672:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c30d3b04700 x1875178048179840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788309722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788309697.647696:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788309697.647703:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788309697.647708:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788309697.647710:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30f9a1b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788309697.647733:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788309697.647738:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875178048179840:0@lo:8:kworker.0 00010000:00080000:2.0:1788309697.647765:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c30fbbf3100 x1875178048180352/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788309722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788309697.647775:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788309697.647779:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788309697.647781:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788309697.647784:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8c30c7fef800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788309697.647801:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788309697.647804:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875178048180352:0@lo:8:kworker.0 00000004:00080000:2.0:1788309697.647832:0:22754:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788309697.647910:0:22754:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 607717070654ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788309697.647917:0:22754:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788309697.648308:0:23472:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788309697.648329:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc40e2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23472:1875178048181376:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788309697.648365:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309697.648399:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f997d3c0 going to sleep for 11 seconds 00000004:00080000:3.0:1788309697.648411:0:23471:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788309697.648470:0:23471:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 607717630157ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788309697.648482:0:23471:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788309697.649707:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048179712:0@lo:400:kworker.0 00010000:00080000:2.0:1788309697.649723:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c30fbbf1880 x1875178048180480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309697.649733:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875178048180480:0@lo:400:kworker.0 00010000:00080000:2.0:1788309697.649743:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c30c30cb800 x1875178048180992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309697.649762:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875178048180992:0@lo:400:kworker.0 00000100:00100000:2.0:1788309697.649784:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875178048180224:0@lo:400:kworker.0 00010000:00080000:2.0:1788309697.649796:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c30c30c8700 x1875178048180864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309697.649804:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875178048180864:0@lo:400:kworker.0 00000100:00100000:2.0:1788309697.649983:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048181376 00000100:00100000:2.0:1788309697.649990:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048181376 00000100:00100000:2.0:1788309697.650035:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788309697.650043:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc40e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23472:x1875178048181376:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788309697.653534:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788309697.653617:0:22755:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:0.0:1788309697.653640:0:22755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc41d1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22755:1875178048181632:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788309697.653690:0:22755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309697.653703:0:22755:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30fbbdf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309697.653726:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048179584 00000100:00100000:0.0:1788309697.653732:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048179584 00000100:00100000:0.0:1788309697.653804:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048179328 00000100:00100000:0.0:1788309697.653807:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048179328 00000100:00100000:0.0:1788309697.653828:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788309697.653836:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c30c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048179584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309697.653906:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c30c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048179584:12345-0@lo:400:kworker.0 Request processed in 70us (10672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309697.653920:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788309697.653938:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788309697.653944:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048179328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788309697.653968:0:22732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788309697.654021:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048179328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (10602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309697.654026:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788309697.654049:0:24234:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788309697.654056:0:24234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:3.0:1788309697.654426:0:23460:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788309697.654595:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788309697.654608:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc41d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875178048181504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788309697.654646:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309697.654809:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048181504 00000100:00100000:3.0:1788309697.655104:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048181504 00000100:00100000:1.0:1788309697.655269:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048179968 00000100:00100000:1.0:1788309697.655274:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048179968 00000100:00100000:0.0:1788309697.655295:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048179584:0@lo:400:kworker.0 00000100:00100000:1.0:1788309697.655313:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788309697.655323:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875178048179968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309697.655338:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875178048180608:0@lo:400:kworker.0 00000100:00100000:0.0:1788309697.655379:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309697.655380:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875178048179968:12345-0@lo:400:kworker.0 Request processed in 56us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309697.655390:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788309697.655406:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048180608 00000100:00100000:0.0:1788309697.655410:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048180608 00000100:00100000:0.0:1788309697.655443:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788309697.655449:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875178048180608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309697.655489:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875178048180608:12345-0@lo:400:kworker.0 Request processed in 40us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309697.655496:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788309697.655524:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c30fbbf3480 x1875178048180608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309697.655535:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875178048180608:0@lo:400:kworker.0 00000100:00100000:0.0:1788309697.655563:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875178048181120:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788309697.655577:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788309697.655583:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788309697.655594:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309697.655619:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048181120 00000100:00100000:0.0:1788309697.655623:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048181120 00000100:00100000:0.0:1788309697.655646:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788309697.655651:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875178048181120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788309697.655672:0:22732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788309697.655703:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875178048181120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309697.655709:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788309697.655740:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875178048181120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788309697.655769:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048179328:0@lo:41:osp-pre-0-1.0 00010000:00080000:0.0:1788309697.655779:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c30d3b05500 x1875178048179968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309697.655788:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875178048179968:0@lo:400:kworker.0 00000100:00100000:0.0:1788309697.655803:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788309697.655808:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc40e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048181248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788309697.655834:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309697.655862:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048181248 00000100:00100000:3.0:1788309697.655867:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048181248 00000100:00100000:3.0:1788309697.656119:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788309697.656128:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875178048181504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788309697.656145:0:24237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788309697.656189:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875178048181504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (1542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309697.656196:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788309697.656207:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788309697.656213:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3617:x1875178048181248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788309697.656224:0:24237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00010000:00080000:0.0:1788309697.656234:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c2fc41d2300 x1875178048181504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309697.656251:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc41d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875178048181504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788309697.656259:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3617:x1875178048181248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309697.656267:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788309697.656315:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c2fc40e2300 x1875178048181248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788309713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309697.656330:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc40e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048181248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788309697.657558:0:24236:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788309697.657569:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048181632 00000100:00100000:1.0:1788309697.657574:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048181632 00000100:00100000:1.0:1788309697.657626:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309697.657656:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048179456 00000100:00100000:1.0:1788309697.657660:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048179456 00000100:00100000:1.0:1788309697.657687:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788309697.657694:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:3618:x1875178048179456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309697.657882:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875178048180096:0@lo:400:kworker.0 00000100:00100000:0.0:1788309697.658112:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309697.658144:0:23468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048180096 00000100:00100000:0.0:1788309697.658148:0:23468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048180096 00000100:00100000:0.0:1788309697.658175:0:23468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788309697.658182:0:23468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875178048180096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309697.658219:0:23468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875178048180096:12345-0@lo:400:kworker.0 Request processed in 38us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309697.658225:0:23468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788309697.658260:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875178048180096:0@lo:400:kworker.0 00000100:00100000:0.0:1788309697.658268:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1875178048180736:0@lo:400:kworker.0 00000100:00100000:0.0:1788309697.658290:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309697.658309:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048180736 00000100:00100000:0.0:1788309697.658312:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048180736 00000100:00100000:0.0:1788309697.658343:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788309697.658349:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875178048180736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309697.658377:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875178048180736:12345-0@lo:400:kworker.0 Request processed in 28us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309697.658382:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788309697.658398:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788309697.658414:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c30fbbf2a00 x1875178048180736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309697.658423:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fbbf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1875178048180736:0@lo:400:kworker.0 00000100:00100000:1.0:1788309697.662369:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:3618:x1875178048179456:12345-0@lo:400:kworker.0 Request processed in 4669us (4736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309697.662390:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788309697.662471:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3618:1875178048179456:0@lo:400:kworker.0 00000100:00100000:0.0:1788309697.662567:0:25402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788309697.662579:0:25402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22755:x1875178048181632:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788309697.663086:0:22707:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:0.0:1788309697.670929:0:25402:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788309697.670941:0:25402:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1788309697.670947:0:25402:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00080000:1.0:1788309697.671117:0:24235:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788309697.671122:0:24235:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788309697.671207:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc40e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23472:x1875178048181376:12345-0@lo:7:osp-pre-1-1.0 Request processed in 21161us (22837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309697.671216:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788309697.671505:0:23472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c2fc40e2a00 x1875178048181376/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788309713 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309697.671520:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc40e2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23472:1875178048181376:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788309697.671532:0:23472:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788309697.671566:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc40e2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23472:1875178048181760:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788309697.671609:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309697.671676:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f997d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309697.677134:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048181760 00000100:00100000:1.0:1788309697.677151:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048181760 00000100:00100000:1.0:1788309697.677217:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788309697.677229:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc40e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23472:x1875178048181760:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788309697.677261:0:24236:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1788309697.677338:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc40e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23472:x1875178048181760:12345-0@lo:5:osp-pre-1-1.0 Request processed in 112us (5729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309697.677345:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788309697.679096:0:23472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c2fc40e2a00 x1875178048181760/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788309713 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309697.679113:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc40e2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23472:1875178048181760:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788309697.679127:0:23472:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788309697.679167:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc40e2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23472:1875178048181888:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788309697.679211:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309697.679235:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f997d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309697.679331:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048181888 00000100:00100000:1.0:1788309697.679336:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048181888 00000100:00100000:1.0:1788309697.679381:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788309697.679389:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc40e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23472:x1875178048181888:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788309697.679420:0:24235:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000001:00080000:1.0:1788309697.696680:0:25049:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1788309697.696695:0:25049:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788309697.696706:0:25049:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1788309697.699710:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788309697.699723:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d30daf90/0x98c38120c44af870 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.699740:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=607s v=(0 0) 00010000:00010000:0.0:1788309697.699754:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788309697.699761:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d30daf90/0x98c38120c44af870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.699779:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d30daf90/0x98c38120c44af870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.699791:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d30daf90/0x98c38120c44af870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.699799:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d30daf90/0x98c38120c44af870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.699818:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788309697.699830:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309697.699835:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d30daf90/0x98c38120c44af870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.699863:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30edf5bc00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.699867:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d30daf90/0x98c38120c44af870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.699884:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d30daf90/0x98c38120c44af870 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.699900:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d30daf90/0x98c38120c44af870 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309697.702183:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc40e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23472:x1875178048181888:12345-0@lo:5:osp-pre-1-1.0 Request processed in 22786us (22963us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788309697.702198:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788309697.702262:0:23472:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00010000:00010000:0.0:1788309697.702450:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d30daf90/0x98c38120c44af870 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.702472:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.702474:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.702476:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309697.702786:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc40e2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23472:1875178048181888:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788309697.702802:0:23472:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:3.0:1788309697.702902:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc40e2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23472:1875178048182016:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788309697.703128:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309697.703159:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f997d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309697.703503:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048182016 00000100:00100000:1.0:1788309697.703510:0:22739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048182016 00000100:00100000:1.0:1788309697.703552:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788309697.703561:0:22739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc40e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23472:x1875178048182016:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788309697.703626:0:22739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc40e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23472:x1875178048182016:12345-0@lo:900:osp-pre-1-1.0 Request processed in 66us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309697.703641:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788309697.703787:0:23472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c2fc40e2a00 x1875178048182016/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788309713 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309697.703800:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc40e2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23472:1875178048182016:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1788309697.704106:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.704114:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b8b9f63/0x98c38120c44af877 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.704127:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.704131:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.704137:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b8b9f63/0x98c38120c44af877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.704151:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b8b9f63/0x98c38120c44af877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.704161:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b8b9f63/0x98c38120c44af877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.704169:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b8b9f63/0x98c38120c44af877 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.704191:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:02000400:2.0:1788309697.704315:0:25406:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg632-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788309697.704351:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309697.704359:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b8b9f63/0x98c38120c44af877 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.704367:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc35f1800 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.704372:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8b9f63/0x98c38120c44af877 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.704381:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8b9f63/0x98c38120c44af877 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.704397:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b8b9f63/0x98c38120c44af877 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.704416:0:23881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b8b9f63/0x98c38120c44af877 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.704432:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.704434:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.704436:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788309697.709981:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.709996:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000884ad041/0x98c38120c44af87e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.710013:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.710017:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.710041:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000884ad041/0x98c38120c44af87e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.710057:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000884ad041/0x98c38120c44af87e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.710068:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000884ad041/0x98c38120c44af87e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.710075:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000884ad041/0x98c38120c44af87e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.710098:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788309697.710341:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309697.710349:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000884ad041/0x98c38120c44af87e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.710357:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc35f0200 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.710362:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000884ad041/0x98c38120c44af87e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.710370:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000884ad041/0x98c38120c44af87e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.710388:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000884ad041/0x98c38120c44af87e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.710396:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000884ad041/0x98c38120c44af87e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.710417:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.710419:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.710421:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788309697.710543:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.710549:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2792b78/0x98c38120c44af885 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.710557:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.710560:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.710564:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2792b78/0x98c38120c44af885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.710572:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2792b78/0x98c38120c44af885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.710579:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2792b78/0x98c38120c44af885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.710596:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2792b78/0x98c38120c44af885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.710648:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788309697.713467:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.713481:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad64c7d2/0x98c38120c44af88c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.713498:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.713502:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.713508:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad64c7d2/0x98c38120c44af88c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.713521:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad64c7d2/0x98c38120c44af88c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.713530:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad64c7d2/0x98c38120c44af88c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.713536:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad64c7d2/0x98c38120c44af88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.716604:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788309697.718181:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788309697.718193:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2792b78/0x98c38120c44af885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309697.718206:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc35f0800 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:2.0:1788309697.718210:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2792b78/0x98c38120c44af885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309697.718221:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2792b78/0x98c38120c44af885 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309697.718245:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2792b78/0x98c38120c44af885 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309697.718268:0:23881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2792b78/0x98c38120c44af885 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309697.718292:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788309697.718295:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad64c7d2/0x98c38120c44af88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309697.718302:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc35f1c00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:2.0:1788309697.718306:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad64c7d2/0x98c38120c44af88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309697.718314:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad64c7d2/0x98c38120c44af88c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309697.718325:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad64c7d2/0x98c38120c44af88c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309697.718332:0:23881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad64c7d2/0x98c38120c44af88c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309697.718344:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309697.718346:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309697.718348:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788309697.720326:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.720339:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005095f22c/0x98c38120c44af893 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.720360:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.720364:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.720372:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005095f22c/0x98c38120c44af893 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.720384:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005095f22c/0x98c38120c44af893 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.720394:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005095f22c/0x98c38120c44af893 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.720402:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005095f22c/0x98c38120c44af893 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.720421:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788309697.720829:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309697.720853:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005095f22c/0x98c38120c44af893 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.720863:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337c400 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.720867:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005095f22c/0x98c38120c44af893 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.720875:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005095f22c/0x98c38120c44af893 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.720891:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005095f22c/0x98c38120c44af893 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.720899:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005095f22c/0x98c38120c44af893 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788309697.721077:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.721083:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2321699/0x98c38120c44af89a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.721092:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.721095:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.721099:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2321699/0x98c38120c44af89a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.721109:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2321699/0x98c38120c44af89a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.721128:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2321699/0x98c38120c44af89a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.721135:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2321699/0x98c38120c44af89a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.721152:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788309697.721392:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309697.721397:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2321699/0x98c38120c44af89a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.721405:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337cc00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.721409:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2321699/0x98c38120c44af89a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.721418:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2321699/0x98c38120c44af89a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.721441:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2321699/0x98c38120c44af89a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.721448:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2321699/0x98c38120c44af89a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.721460:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.721463:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.721465:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309697.721548:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309697.721554:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309697.721556:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309697.721565:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788309697.721796:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.721802:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020b01203/0x98c38120c44af8a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.721812:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.721815:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.721820:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020b01203/0x98c38120c44af8a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.721830:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020b01203/0x98c38120c44af8a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.721863:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020b01203/0x98c38120c44af8a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.721873:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020b01203/0x98c38120c44af8a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.721899:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788309697.722306:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309697.722311:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020b01203/0x98c38120c44af8a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.722319:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337ce00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.722322:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020b01203/0x98c38120c44af8a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.722330:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020b01203/0x98c38120c44af8a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.722343:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020b01203/0x98c38120c44af8a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.722351:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020b01203/0x98c38120c44af8a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.722380:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.722382:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.722384:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788309697.722805:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.722813:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004376c84f/0x98c38120c44af8a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.722823:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.722827:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.722832:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004376c84f/0x98c38120c44af8a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.722869:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004376c84f/0x98c38120c44af8a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.722877:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004376c84f/0x98c38120c44af8a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.722884:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004376c84f/0x98c38120c44af8a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.722902:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788309697.722983:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309697.722988:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004376c84f/0x98c38120c44af8a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.722996:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337d800 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.723000:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004376c84f/0x98c38120c44af8a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.723009:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004376c84f/0x98c38120c44af8a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.723021:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004376c84f/0x98c38120c44af8a8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.723030:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.723031:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.723033:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309697.723058:0:25402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004376c84f/0x98c38120c44af8a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788309697.724074:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.724083:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071981a10/0x98c38120c44af8af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.724101:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.724105:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.724110:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071981a10/0x98c38120c44af8af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.724120:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071981a10/0x98c38120c44af8af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.724129:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071981a10/0x98c38120c44af8af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.724136:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071981a10/0x98c38120c44af8af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.724148:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788309697.724669:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.724677:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c083e10c/0x98c38120c44af8b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.724686:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.724690:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.724694:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c083e10c/0x98c38120c44af8b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.724703:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c083e10c/0x98c38120c44af8b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.724721:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c083e10c/0x98c38120c44af8b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.724729:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c083e10c/0x98c38120c44af8b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.724742:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788309697.725279:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788309697.725287:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071981a10/0x98c38120c44af8af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309697.725297:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337c200 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:3.0:1788309697.725302:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071981a10/0x98c38120c44af8af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309697.725311:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071981a10/0x98c38120c44af8af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309697.725332:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071981a10/0x98c38120c44af8af lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309697.725340:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071981a10/0x98c38120c44af8af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309697.725365:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788309697.725369:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c083e10c/0x98c38120c44af8b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309697.725375:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337c000 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:3.0:1788309697.725379:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c083e10c/0x98c38120c44af8b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309697.725385:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c083e10c/0x98c38120c44af8b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309697.725404:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c083e10c/0x98c38120c44af8b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309697.725410:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c083e10c/0x98c38120c44af8b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.725416:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309697.725425:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309697.725428:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788309697.725430:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788309697.727209:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788309697.727223:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d30daf90/0x98c38120c44af8bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.727240:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=607s v=(0 0) 00010000:00010000:0.0:1788309697.727250:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788309697.727257:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d30daf90/0x98c38120c44af8bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.727274:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d30daf90/0x98c38120c44af8bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.727284:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d30daf90/0x98c38120c44af8bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.727292:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d30daf90/0x98c38120c44af8bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.727307:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788309697.727489:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788309697.727496:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d30daf90/0x98c38120c44af8bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.727505:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30edf5bc00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:1.0:1788309697.727509:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d30daf90/0x98c38120c44af8bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.727518:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d30daf90/0x98c38120c44af8bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.727534:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d30daf90/0x98c38120c44af8bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.727541:0:23881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d30daf90/0x98c38120c44af8bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.727556:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309697.727563:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309697.727565:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788309697.727820:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788309697.727827:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bcae434/0x98c38120c44af8c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.727835:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=607s v=(0 0) 00010000:00010000:0.0:1788309697.727998:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788309697.728003:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bcae434/0x98c38120c44af8c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.728014:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bcae434/0x98c38120c44af8c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.728022:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bcae434/0x98c38120c44af8c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.728034:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bcae434/0x98c38120c44af8c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.728145:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788309697.728477:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.728484:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059eea51d/0x98c38120c44af8cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.728493:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.728496:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.728500:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059eea51d/0x98c38120c44af8cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.728509:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059eea51d/0x98c38120c44af8cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.728516:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059eea51d/0x98c38120c44af8cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.728523:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059eea51d/0x98c38120c44af8cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.728582:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788309697.728588:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bcae434/0x98c38120c44af8c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.728596:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30edf5ae00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.728599:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bcae434/0x98c38120c44af8c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.728607:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bcae434/0x98c38120c44af8c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.728619:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bcae434/0x98c38120c44af8c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.728626:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bcae434/0x98c38120c44af8c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.728640:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309697.728643:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059eea51d/0x98c38120c44af8cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.728649:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337c600 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.728659:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059eea51d/0x98c38120c44af8cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.728667:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059eea51d/0x98c38120c44af8cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.728676:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059eea51d/0x98c38120c44af8cb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.728682:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.728683:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.728685:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309697.728739:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788309697.728754:0:25402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059eea51d/0x98c38120c44af8cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788309697.729258:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.729266:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004376c84f/0x98c38120c44af8d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.729288:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.729292:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.729296:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004376c84f/0x98c38120c44af8d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.729307:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004376c84f/0x98c38120c44af8d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.729316:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004376c84f/0x98c38120c44af8d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.729323:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004376c84f/0x98c38120c44af8d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.729369:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309697.729375:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004376c84f/0x98c38120c44af8d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.729383:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337d800 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.729386:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004376c84f/0x98c38120c44af8d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.729395:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004376c84f/0x98c38120c44af8d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.729405:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004376c84f/0x98c38120c44af8d2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.729413:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.729419:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.729421:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309697.729479:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788309697.729484:0:25402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004376c84f/0x98c38120c44af8d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788309697.729735:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.729741:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f8af539/0x98c38120c44af8d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.729760:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.729763:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.729767:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f8af539/0x98c38120c44af8d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.729787:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f8af539/0x98c38120c44af8d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.729796:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f8af539/0x98c38120c44af8d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.729803:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f8af539/0x98c38120c44af8d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.729829:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309697.729834:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f8af539/0x98c38120c44af8d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.729856:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337d200 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.729860:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f8af539/0x98c38120c44af8d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.729867:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f8af539/0x98c38120c44af8d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.729878:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f8af539/0x98c38120c44af8d9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.729887:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.729888:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.729890:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309697.729998:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788309697.730003:0:25402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f8af539/0x98c38120c44af8d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788309697.730245:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.730251:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b9c34dd/0x98c38120c44af8e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.730258:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.730261:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.730265:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b9c34dd/0x98c38120c44af8e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.730273:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b9c34dd/0x98c38120c44af8e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.730292:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b9c34dd/0x98c38120c44af8e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.730298:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b9c34dd/0x98c38120c44af8e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.730321:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309697.730326:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b9c34dd/0x98c38120c44af8e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.730332:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337dc00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.730335:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b9c34dd/0x98c38120c44af8e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.730343:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b9c34dd/0x98c38120c44af8e0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.730359:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b9c34dd/0x98c38120c44af8e0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.730367:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.730369:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.730371:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309697.730421:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788309697.730425:0:25402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b9c34dd/0x98c38120c44af8e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788309697.730736:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.730742:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9d73f9a/0x98c38120c44af8e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.730762:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.730764:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.730769:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9d73f9a/0x98c38120c44af8e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.730778:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9d73f9a/0x98c38120c44af8e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.730785:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9d73f9a/0x98c38120c44af8e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.730802:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9d73f9a/0x98c38120c44af8e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.730828:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309697.730833:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9d73f9a/0x98c38120c44af8e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.730861:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337d000 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.730864:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9d73f9a/0x98c38120c44af8e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.730872:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9d73f9a/0x98c38120c44af8e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.730882:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9d73f9a/0x98c38120c44af8e7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.730890:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.730892:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.730894:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309697.731004:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788309697.731010:0:25402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9d73f9a/0x98c38120c44af8e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788309697.731313:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.731319:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000ef6dc4/0x98c38120c44af8ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.731328:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.731332:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.731336:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000ef6dc4/0x98c38120c44af8ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.731345:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000ef6dc4/0x98c38120c44af8ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.731354:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000ef6dc4/0x98c38120c44af8ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.731362:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000ef6dc4/0x98c38120c44af8ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.731399:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309697.731404:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000ef6dc4/0x98c38120c44af8ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.731420:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337ca00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.731424:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000ef6dc4/0x98c38120c44af8ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.731432:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000ef6dc4/0x98c38120c44af8ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.731443:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000ef6dc4/0x98c38120c44af8ee lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.731451:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.731452:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.731454:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309697.731510:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788309697.731515:0:25402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000ef6dc4/0x98c38120c44af8ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788309697.731788:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.731794:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e727f1b1/0x98c38120c44af8f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.731802:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.731805:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.731809:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e727f1b1/0x98c38120c44af8f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.731818:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e727f1b1/0x98c38120c44af8f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.731826:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e727f1b1/0x98c38120c44af8f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.731832:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e727f1b1/0x98c38120c44af8f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.731887:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309697.731892:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e727f1b1/0x98c38120c44af8f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.731900:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337d600 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.731961:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e727f1b1/0x98c38120c44af8f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.731972:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e727f1b1/0x98c38120c44af8f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.731982:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e727f1b1/0x98c38120c44af8f5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.731996:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.731998:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.732000:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309697.732058:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788309697.732062:0:25402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e727f1b1/0x98c38120c44af8f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788309697.732371:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.732377:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2ee0350/0x98c38120c44af8fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.732386:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.732389:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.732393:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2ee0350/0x98c38120c44af8fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.732402:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2ee0350/0x98c38120c44af8fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.732411:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2ee0350/0x98c38120c44af8fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.732417:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2ee0350/0x98c38120c44af8fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.732680:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309697.732687:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2ee0350/0x98c38120c44af8fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.732694:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337c800 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.732699:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2ee0350/0x98c38120c44af8fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.732706:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2ee0350/0x98c38120c44af8fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.732719:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2ee0350/0x98c38120c44af8fc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.732726:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.732728:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.732730:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309697.732797:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788309697.732802:0:25402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2ee0350/0x98c38120c44af8fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788309697.733151:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.733157:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f3a4387/0x98c38120c44af903 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.733176:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.733179:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.733184:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f3a4387/0x98c38120c44af903 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.733193:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f3a4387/0x98c38120c44af903 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.733200:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f3a4387/0x98c38120c44af903 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.733207:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f3a4387/0x98c38120c44af903 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.733250:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309697.733255:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f3a4387/0x98c38120c44af903 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.733263:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337d400 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.733266:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f3a4387/0x98c38120c44af903 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.733279:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f3a4387/0x98c38120c44af903 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.733290:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f3a4387/0x98c38120c44af903 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.733297:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.733298:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.733300:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309697.733349:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788309697.733353:0:25402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f3a4387/0x98c38120c44af903 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788309697.733623:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.733630:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024844643/0x98c38120c44af90a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.733638:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.733641:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.733645:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024844643/0x98c38120c44af90a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.733665:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024844643/0x98c38120c44af90a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.733672:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024844643/0x98c38120c44af90a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.733679:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024844643/0x98c38120c44af90a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.733704:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309697.733710:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024844643/0x98c38120c44af90a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.733717:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337de00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.733721:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024844643/0x98c38120c44af90a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.733729:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024844643/0x98c38120c44af90a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.733740:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024844643/0x98c38120c44af90a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.733759:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.733761:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.733762:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309697.733822:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788309697.733827:0:25402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024844643/0x98c38120c44af90a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788309697.734167:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.734174:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074531a04/0x98c38120c44af911 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.734184:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.734187:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.734192:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074531a04/0x98c38120c44af911 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.734202:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074531a04/0x98c38120c44af911 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.734222:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074531a04/0x98c38120c44af911 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.734229:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074531a04/0x98c38120c44af911 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.734279:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309697.734284:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074531a04/0x98c38120c44af911 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.734292:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337da00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.734296:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074531a04/0x98c38120c44af911 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.734304:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074531a04/0x98c38120c44af911 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.734316:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074531a04/0x98c38120c44af911 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.734324:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.734326:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.734328:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309697.734380:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788309697.734385:0:25402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074531a04/0x98c38120c44af911 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788309697.734677:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.734683:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c083e10c/0x98c38120c44af918 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.734692:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.734695:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.734699:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c083e10c/0x98c38120c44af918 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.734708:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c083e10c/0x98c38120c44af918 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.734716:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c083e10c/0x98c38120c44af918 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.734735:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c083e10c/0x98c38120c44af918 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.734769:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309697.734774:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c083e10c/0x98c38120c44af918 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.734781:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337c000 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.734784:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c083e10c/0x98c38120c44af918 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.734792:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c083e10c/0x98c38120c44af918 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.734815:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c083e10c/0x98c38120c44af918 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.734824:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.734825:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.734827:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309697.734923:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788309697.734928:0:25402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c083e10c/0x98c38120c44af918 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788309697.735222:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.735229:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071981a10/0x98c38120c44af91f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.735237:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.735240:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.735244:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071981a10/0x98c38120c44af91f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.735253:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071981a10/0x98c38120c44af91f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.735261:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071981a10/0x98c38120c44af91f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.735267:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071981a10/0x98c38120c44af91f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.735301:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309697.735306:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071981a10/0x98c38120c44af91f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.735314:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337c200 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.735317:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071981a10/0x98c38120c44af91f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.735324:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071981a10/0x98c38120c44af91f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.735335:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071981a10/0x98c38120c44af91f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.735342:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.735344:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.735345:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309697.735398:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788309697.735403:0:25402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071981a10/0x98c38120c44af91f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788309697.735680:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.735686:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020b01203/0x98c38120c44af926 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.735693:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.735696:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.735700:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020b01203/0x98c38120c44af926 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.735709:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020b01203/0x98c38120c44af926 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.735715:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020b01203/0x98c38120c44af926 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.735721:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020b01203/0x98c38120c44af926 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.735760:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309697.735764:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020b01203/0x98c38120c44af926 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.735782:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337ce00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.735786:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020b01203/0x98c38120c44af926 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.735793:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020b01203/0x98c38120c44af926 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.735804:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020b01203/0x98c38120c44af926 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.735812:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.735814:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.735815:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309697.735930:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788309697.735935:0:25402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020b01203/0x98c38120c44af926 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788309697.736277:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.736283:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2321699/0x98c38120c44af92d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.736291:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.736295:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.736299:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2321699/0x98c38120c44af92d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.736308:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2321699/0x98c38120c44af92d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.736315:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2321699/0x98c38120c44af92d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.736322:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2321699/0x98c38120c44af92d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.736350:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309697.736354:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2321699/0x98c38120c44af92d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.736361:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337cc00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.736366:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2321699/0x98c38120c44af92d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.736375:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2321699/0x98c38120c44af92d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.736387:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2321699/0x98c38120c44af92d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.736403:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.736405:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.736406:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309697.736465:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788309697.736471:0:25402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2321699/0x98c38120c44af92d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788309697.736776:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.736782:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005095f22c/0x98c38120c44af934 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.736799:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.736803:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.736807:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005095f22c/0x98c38120c44af934 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.736816:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005095f22c/0x98c38120c44af934 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.736824:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005095f22c/0x98c38120c44af934 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.736831:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005095f22c/0x98c38120c44af934 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.736924:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309697.736930:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005095f22c/0x98c38120c44af934 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.736938:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc337c400 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.736941:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005095f22c/0x98c38120c44af934 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.736948:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005095f22c/0x98c38120c44af934 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.736960:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005095f22c/0x98c38120c44af934 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.736967:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.736969:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.736970:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309697.737061:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788309697.737065:0:25402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005095f22c/0x98c38120c44af934 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788309697.737362:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.737368:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008edf2eb3/0x98c38120c44af93b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.737375:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.737379:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.737383:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008edf2eb3/0x98c38120c44af93b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.737402:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008edf2eb3/0x98c38120c44af93b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.737409:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008edf2eb3/0x98c38120c44af93b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.737416:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008edf2eb3/0x98c38120c44af93b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.737446:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309697.737450:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008edf2eb3/0x98c38120c44af93b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.737457:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d3d91c00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.737461:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008edf2eb3/0x98c38120c44af93b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.737475:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008edf2eb3/0x98c38120c44af93b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.737487:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008edf2eb3/0x98c38120c44af93b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.737495:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.737497:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.737499:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309697.737551:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788309697.737556:0:25402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008edf2eb3/0x98c38120c44af93b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788309697.737957:0:25402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788309697.737964:0:25402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a35fd7da/0x98c38120c44af942 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.737973:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1788309697.737976:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788309697.737980:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a35fd7da/0x98c38120c44af942 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.737991:0:25402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a35fd7da/0x98c38120c44af942 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.738010:0:25402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a35fd7da/0x98c38120c44af942 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309697.738018:0:25402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a35fd7da/0x98c38120c44af942 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.738252:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309697.738258:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a35fd7da/0x98c38120c44af942 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.738266:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d3d91e00 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309697.738270:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a35fd7da/0x98c38120c44af942 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.738279:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a35fd7da/0x98c38120c44af942 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.738291:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a35fd7da/0x98c38120c44af942 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309697.738298:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.738299:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309697.738301:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309697.738358:0:25402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788309697.738364:0:25402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a35fd7da/0x98c38120c44af942 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788309697.738413:0:25402:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:1.0:1788309697.738508:0:25402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22755:x1875178048181632:12345-0@lo:5:osp-pre-1-0.0 Request processed in 75929us (84813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309697.738516:0:25402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788309697.738609:0:22755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc41d1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22755:1875178048181632:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788309697.738624:0:22755:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1788309697.738678:0:22755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30c8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22755:1875178048182144:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788309697.738716:0:22755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309697.738761:0:22755:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c5948540 going to sleep for 11 seconds 00000100:00100000:1.0:1788309697.738807:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048182144 00000100:00100000:1.0:1788309697.738813:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048182144 00000100:00100000:1.0:1788309697.738880:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788309697.738890:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c30cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22755:x1875178048182144:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788309697.738934:0:24236:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:1.0:1788309697.741224:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c30cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22755:x1875178048182144:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2331us (2503us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788309697.741235:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1788309697.741313:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309697.741458:0:22755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30c8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22755:1875178048182144:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788309697.741473:0:22755:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:0.0:1788309698.540013:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788309698.635400:0:25458:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788309698.636757:0:25458:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1788309698.668090:0:23480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1788309699.424717:0:25508:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788309699.425360:0:25508:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788309699.563058:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309699.690120:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309699.690469:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037590528 00000100:00100000:1.0:1788309699.690480:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037590528 00000100:00100000:1.0:1788309699.690544:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 114 00000100:00100000:1.0:1788309699.690552:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2387:x1875178037590528:12345-192.168.206.32@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788309699.690580:0:22720:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e8262932-b44d-4278-93be-21ab2fbade5b@192.168.206.32@tcp t0 exp 0000000000000000 cur 609 last 0 00000020:00000080:1.0:1788309699.690609:0:22720:0:(genops.c:1385:class_connect()) connect: client e8262932-b44d-4278-93be-21ab2fbade5b, cookie 0x98c38120c44af949 00000100:00080000:1.0:1788309699.690753:0:22720:0:(import.c:65:import_set_state_nolock()) ffff8c2fc2a7f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788309699.690825:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8262932-b44d-4278-93be-21ab2fbade5b+5:2387:x1875178037590528:12345-192.168.206.32@tcp:250:mount.lustre.0 Request processed in 271us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309699.690832:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 114 00000100:00100000:1.0:1788309699.698677:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309699.699410:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037590656 00000100:00100000:2.0:1788309699.699421:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037590656 00000100:00100000:3.0:1788309699.699646:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 115 00000100:00100000:3.0:1788309699.699656:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+5:18056:x1875178037590656:12345-192.168.206.32@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788309699.699673:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309699.699691:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30d12da200/0x98c38120c44af950 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193a31 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309699.699761:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30d12da200/0x98c38120c44af950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193a31 expref: 6 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309699.699775:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30d12da200/0x98c38120c44af950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193a31 expref: 6 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309699.699784:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30d12da200, rc 0) 00000100:00100000:3.0:1788309699.700125:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+6:18056:x1875178037590656:12345-192.168.206.32@tcp:101:mount.lustre.0 Request processed in 469us (1457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309699.700132:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 115 00000100:00100000:0.0:1788309699.714441:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309699.714541:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037590784 00000100:00100000:2.0:1788309699.714551:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037590784 00000100:00100000:2.0:1788309699.714606:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 116 00000100:00100000:2.0:1788309699.714617:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8262932-b44d-4278-93be-21ab2fbade5b+6:18056:x1875178037590784:12345-192.168.206.32@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788309699.714745:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8262932-b44d-4278-93be-21ab2fbade5b+6:18056:x1875178037590784:12345-192.168.206.32@tcp:501:mount.lustre.0 Request processed in 118us (301us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788309699.714753:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 116 00000100:00100000:0.0:1788309699.717381:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309699.717467:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037590912 00000100:00100000:1.0:1788309699.717476:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037590912 00000100:00100000:1.0:1788309699.717528:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 117 00000100:00100000:1.0:1788309699.717538:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+6:18056:x1875178037590912:12345-192.168.206.32@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788309699.717552:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309699.717567:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30d3d90e00/0x98c38120c44af957 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193a38 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309699.717592:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30d3d90e00/0x98c38120c44af957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193a38 expref: 7 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309699.717602:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30d3d90e00/0x98c38120c44af957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193a38 expref: 7 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309699.717612:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30d3d90e00, rc 0) 00000100:00100000:1.0:1788309699.717870:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+7:18056:x1875178037590912:12345-192.168.206.32@tcp:101:mount.lustre.0 Request processed in 332us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309699.717877:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 117 00000100:00100000:3.0:1788309699.721183:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309699.721271:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037591040 00000100:00100000:1.0:1788309699.721281:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037591040 00000100:00100000:1.0:1788309699.721333:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 118 00000100:00100000:1.0:1788309699.721342:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8262932-b44d-4278-93be-21ab2fbade5b+7:18056:x1875178037591040:12345-192.168.206.32@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788309699.721485:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8262932-b44d-4278-93be-21ab2fbade5b+8:18056:x1875178037591040:12345-192.168.206.32@tcp:501:mount.lustre.0 Request processed in 143us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309699.721494:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 118 00000100:00100000:0.0:1788309699.728315:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309699.729935:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037591168 00000100:00100000:1.0:1788309699.729947:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037591168 00000100:00100000:1.0:1788309699.730209:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 119 00000100:00100000:1.0:1788309699.730221:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+8:18056:x1875178037591168:12345-192.168.206.32@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788309699.730370:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+8:18056:x1875178037591168:12345-192.168.206.32@tcp:503:mount.lustre.0 Request processed in 151us (2062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309699.730378:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 119 00000100:00100000:0.0:1788309699.734306:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309699.734390:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037591296 00000100:00100000:2.0:1788309699.734398:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037591296 00000100:00100000:2.0:1788309699.734448:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 120 00000100:00100000:2.0:1788309699.734457:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8262932-b44d-4278-93be-21ab2fbade5b+8:18074:x1875178037591296:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788309699.734614:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8262932-b44d-4278-93be-21ab2fbade5b+8:18074:x1875178037591296:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 157us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309699.734621:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 120 00000100:00100000:2.0:1788309699.755593:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309699.755685:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037591424 00000100:00100000:1.0:1788309699.755695:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037591424 00000100:00100000:1.0:1788309699.755760:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 121 00000100:00100000:1.0:1788309699.755771:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+8:18074:x1875178037591424:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788309699.758263:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+8:18074:x1875178037591424:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 2484us (2669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309699.758278:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 121 00000100:00100000:0.0:1788309699.770829:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309699.775188:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037591552 00000100:00100000:3.0:1788309699.775202:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037591552 00000100:00100000:3.0:1788309699.775275:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 122 00000100:00100000:3.0:1788309699.775287:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8262932-b44d-4278-93be-21ab2fbade5b+8:18074:x1875178037591552:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788309699.776630:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8262932-b44d-4278-93be-21ab2fbade5b+8:18074:x1875178037591552:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 1337us (5803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309699.776641:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 122 00000100:00100000:2.0:1788309699.788054:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309699.788195:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037591680 00000100:00100000:0.0:1788309699.788204:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037591680 00000100:00100000:0.0:1788309699.788257:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 123 00000100:00100000:0.0:1788309699.788267:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+8:18056:x1875178037591680:12345-192.168.206.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788309699.788282:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309699.788298:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30edf5bc00/0x98c38120c44af95e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193a69 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309699.788326:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30edf5bc00/0x98c38120c44af95e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193a69 expref: 9 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309699.788349:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30edf5bc00/0x98c38120c44af95e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193a69 expref: 9 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309699.788359:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30edf5bc00, rc 0) 00000100:00100000:0.0:1788309699.788626:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+9:18056:x1875178037591680:12345-192.168.206.32@tcp:101:mount.lustre.0 Request processed in 359us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309699.788634:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 123 00000100:00100000:2.0:1788309699.793602:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309699.793713:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037591808 00000100:00100000:3.0:1788309699.793724:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037591808 00000100:00100000:3.0:1788309699.793788:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 124 00000100:00100000:3.0:1788309699.793797:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8262932-b44d-4278-93be-21ab2fbade5b+9:18056:x1875178037591808:12345-192.168.206.32@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788309699.793818:0:22720:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788309699.793877:0:22720:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788309699.793882:0:22720:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788309699.793885:0:22720:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788309699.793888:0:22720:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788309699.793890:0:22720:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1788309699.802374:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8262932-b44d-4278-93be-21ab2fbade5b+9:18056:x1875178037591808:12345-192.168.206.32@tcp:256:mount.lustre.0 Request processed in 8568us (8772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309699.802388:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 124 00000100:00100000:0.0:1788309699.805687:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309699.805789:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037591936 00000100:00100000:3.0:1788309699.805798:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037591936 00000100:00100000:0.0:1788309699.806094:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 125 00000100:00100000:0.0:1788309699.806105:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+9:18056:x1875178037591936:12345-192.168.206.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788309699.806121:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309699.806139:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44af965 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193a70 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309699.806165:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44af965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193a70 expref: 10 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309699.806175:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44af965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193a70 expref: 10 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309699.806184:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30edf5ae00, rc 0) 00000100:00100000:0.0:1788309699.806244:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+10:18056:x1875178037591936:12345-192.168.206.32@tcp:101:mount.lustre.0 Request processed in 141us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309699.806251:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 125 00000100:00100000:3.0:1788309699.810157:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309699.810986:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037592064 00000100:00100000:1.0:1788309699.810996:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037592064 00000100:00100000:1.0:1788309699.811057:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 126 00000100:00100000:1.0:1788309699.811067:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8262932-b44d-4278-93be-21ab2fbade5b+10:18056:x1875178037592064:12345-192.168.206.32@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788309699.811212:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8262932-b44d-4278-93be-21ab2fbade5b+10:18056:x1875178037592064:12345-192.168.206.32@tcp:501:mount.lustre.0 Request processed in 145us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309699.811220:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 126 00000100:00100000:3.0:1788309699.812721:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309699.813263:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037592192 00000100:00100000:0.0:1788309699.813271:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037592192 00000100:00100000:0.0:1788309699.813367:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 127 00000100:00100000:0.0:1788309699.813377:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+10:18056:x1875178037592192:12345-192.168.206.32@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788309699.813541:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+10:18056:x1875178037592192:12345-192.168.206.32@tcp:503:mount.lustre.0 Request processed in 164us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309699.813549:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 127 00000100:00100000:1.0:1788309699.817153:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309699.817389:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037592320 00000100:00100000:3.0:1788309699.817410:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037592320 00000100:00100000:3.0:1788309699.817467:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 128 00000100:00100000:3.0:1788309699.817493:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc36ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8262932-b44d-4278-93be-21ab2fbade5b+10:18078:x1875178037592320:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788309699.817632:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc36ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8262932-b44d-4278-93be-21ab2fbade5b+10:18078:x1875178037592320:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 141us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309699.817640:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 128 00000100:00100000:3.0:1788309699.822091:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309699.822317:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037592448 00000100:00100000:0.0:1788309699.822327:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037592448 00000100:00100000:0.0:1788309699.822572:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 129 00000100:00100000:0.0:1788309699.822584:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc36ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+10:18078:x1875178037592448:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788309699.822770:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc36ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+10:18078:x1875178037592448:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 188us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309699.822779:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 129 00000100:00100000:0.0:1788309699.832329:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309699.832384:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309699.837460:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037592576 00000100:00100000:3.0:1788309699.837476:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037592576 00000100:00100000:3.0:1788309699.837514:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037592832 00000100:00100000:3.0:1788309699.837517:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037592832 00000100:00100000:3.0:1788309699.837552:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:3.0:1788309699.837561:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2387:x1875178037592576:12345-192.168.206.32@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788309699.837589:0:22728:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from d9c1e3b0-2cc2-448d-b78b-db0c8de47f15@192.168.206.32@tcp t0 exp 0000000000000000 cur 609 last 0 00000020:00000080:3.0:1788309699.837637:0:22728:0:(genops.c:1385:class_connect()) connect: client d9c1e3b0-2cc2-448d-b78b-db0c8de47f15, cookie 0x98c38120c44af96c 00000100:00100000:1.0:1788309699.837755:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 8 00000100:00100000:1.0:1788309699.837761:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2387:x1875178037592832:12345-192.168.206.32@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788309699.837777:0:22727:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from d9c1e3b0-2cc2-448d-b78b-db0c8de47f15@192.168.206.32@tcp t0 exp 0000000000000000 cur 609 last 0 00000020:00000080:1.0:1788309699.837810:0:22727:0:(genops.c:1385:class_connect()) connect: client d9c1e3b0-2cc2-448d-b78b-db0c8de47f15, cookie 0x98c38120c44af973 00000004:00100000:1.0:1788309699.837833:0:22727:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:1.0:1788309699.838244:0:22727:0:(import.c:65:import_set_state_nolock()) ffff8c2fc2a7d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788309699.838311:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:2387:x1875178037592832:12345-192.168.206.32@tcp:38:mount.lustre.0 Request processed in 548us (5926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309699.838319:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 8 00000004:00100000:3.0:1788309699.838504:0:22728:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:3.0:1788309699.839126:0:22728:0:(import.c:65:import_set_state_nolock()) ffff8c2fc365c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788309699.839168:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:2387:x1875178037592576:12345-192.168.206.32@tcp:38:mount.lustre.0 Request processed in 1607us (6847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309699.839175:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:1.0:1788309699.841496:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309699.841603:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037592960 00000100:00100000:0.0:1788309699.841612:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037592960 00000100:00100000:0.0:1788309699.841730:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 9 00000100:00100000:0.0:1788309699.841754:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:0:x1875178037592960:12345-192.168.206.32@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788309699.841788:0:22727:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788309699.841890:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:0:x1875178037592960:12345-192.168.206.32@tcp:41:mount.lustre.0 Request processed in 139us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309699.841911:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 9 00000100:00080000:2.0:1788309699.842701:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788309699.845574:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309699.845714:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037592704 00000100:00100000:3.0:1788309699.845723:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037592704 00000100:00100000:3.0:1788309699.845807:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00100000:3.0:1788309699.845816:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:0:x1875178037592704:12345-192.168.206.32@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788309699.845885:0:22728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788309699.845959:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:0:x1875178037592704:12345-192.168.206.32@tcp:41:mount.lustre.0 Request processed in 144us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309699.845967:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00080000:2.0:1788309699.846336:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309699.853988:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309699.854197:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037593088 00000100:00100000:0.0:1788309699.854209:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037593088 00000100:00100000:0.0:1788309699.854271:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 11 00000100:00100000:0.0:1788309699.854283:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:18056:x1875178037593088:12345-192.168.206.32@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788309699.854316:0:22727:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788309699.854461:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:18056:x1875178037593088:12345-192.168.206.32@tcp:41:mount.lustre.0 Request processed in 180us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309699.854469:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 11 00000100:00100000:1.0:1788309699.861416:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309699.861496:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037593216 00000100:00100000:3.0:1788309699.861506:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037593216 00000100:00100000:3.0:1788309699.861573:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 12 00000100:00100000:3.0:1788309699.861583:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:18056:x1875178037593216:12345-192.168.206.32@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788309699.861689:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:18056:x1875178037593216:12345-192.168.206.32@tcp:40:mount.lustre.0 Request processed in 106us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309699.861696:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 12 00000100:00100000:1.0:1788309699.873225:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309699.873320:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309699.873358:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309699.873666:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037593344 00000100:00100000:3.0:1788309699.873676:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037593344 00000100:00100000:3.0:1788309699.873714:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037593472 00000100:00100000:3.0:1788309699.873717:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037593472 00000100:00100000:3.0:1788309699.873747:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 21 00000100:00100000:3.0:1788309699.873755:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2387:x1875178037593344:12345-192.168.206.32@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788309699.873788:0:24235:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d9c1e3b0-2cc2-448d-b78b-db0c8de47f15@192.168.206.32@tcp t0 exp 0000000000000000 cur 609 last 0 00000020:00000080:3.0:1788309699.873817:0:24235:0:(genops.c:1385:class_connect()) connect: client d9c1e3b0-2cc2-448d-b78b-db0c8de47f15, cookie 0x98c38120c44af97a 00002000:00100000:3.0:1788309699.873827:0:24235:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d9c1e3b0-2cc2-448d-b78b-db0c8de47f15/ffff8c2fc365e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788309699.873871:0:24235:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:3.0:1788309699.874041:0:24235:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788309699.874069:0:24235:0:(import.c:65:import_set_state_nolock()) ffff8c2fc365a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788309699.874141:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:2387:x1875178037593344:12345-192.168.206.32@tcp:8:mount.lustre.0 Request processed in 384us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309699.874148:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 21 00000100:00100000:3.0:1788309699.874166:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 22 00000100:00100000:3.0:1788309699.874172:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2387:x1875178037593472:12345-192.168.206.32@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788309699.874188:0:24235:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d9c1e3b0-2cc2-448d-b78b-db0c8de47f15@192.168.206.32@tcp t0 exp 0000000000000000 cur 609 last 0 00000020:00000080:3.0:1788309699.874219:0:24235:0:(genops.c:1385:class_connect()) connect: client d9c1e3b0-2cc2-448d-b78b-db0c8de47f15, cookie 0x98c38120c44af981 00002000:00100000:3.0:1788309699.874225:0:24235:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d9c1e3b0-2cc2-448d-b78b-db0c8de47f15/ffff8c2fc365f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788309699.874237:0:24235:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:3.0:1788309699.874334:0:24235:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788309699.874351:0:24235:0:(import.c:65:import_set_state_nolock()) ffff8c30f5f87800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788309699.874375:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:2387:x1875178037593472:12345-192.168.206.32@tcp:8:mount.lustre.0 Request processed in 203us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309699.874382:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 22 00000100:00100000:0.0:1788309699.877396:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037593600 00000100:00100000:0.0:1788309699.877468:0:22739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037593600 00000100:00100000:0.0:1788309699.877580:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 3 00000100:00100000:0.0:1788309699.877591:0:22739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:18056:x1875178037593600:12345-192.168.206.32@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788309699.877679:0:22739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:18056:x1875178037593600:12345-192.168.206.32@tcp:900:mount.lustre.0 Request processed in 90us (4462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309699.877687:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 3 00000100:00100000:1.0:1788309699.884042:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309699.884289:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037593728 00000100:00100000:3.0:1788309699.884298:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037593728 00000100:00100000:3.0:1788309699.884386:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 0 00000100:00100000:3.0:1788309699.884396:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:18056:x1875178037593728:12345-192.168.206.32@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788309699.885920:0:22730:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1445us 00000004:00200000:1.0:1788309699.902421:0:22730:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788309699.902549:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:18056:x1875178037593728:12345-192.168.206.32@tcp:33:mount.lustre.0 Request processed in 18149us (18510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309699.902574:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 0 00000100:00100000:2.0:1788309700.068144:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309700.068229:0:25009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037593856 00000100:00100000:3.0:1788309700.068238:0:25009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037593856 00000100:00100000:3.0:1788309700.068339:0:25009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 13 00000100:00100000:3.0:1788309700.068350:0:25009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:18102:x1875178037593856:12345-192.168.206.32@tcp:101:mkdir.0 00010000:00010000:3.0:1788309700.068367:0:25009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309700.068390:0:25009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da600/0x98c38120c44af988 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193aa1 expref: -99 pid: 25009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309700.068469:0:25009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da800/0x98c38120c44af98f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309700.068484:0:25009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da800/0x98c38120c44af98f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309700.068499:0:25009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da800/0x98c38120c44af98f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309700.068563:0:25009:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788309700.068567:0:25009:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788309700.068601:0:25009:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da800/0x98c38120c44af98f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309700.068629:0:25009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da600/0x98c38120c44af988 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193aa1 expref: 8 pid: 25009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309700.068650:0:25009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da800/0x98c38120c44af98f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193aa1 expref: 7 pid: 25009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309700.068660:0:25009:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c2fc3256b00) 00010000:00010000:3.0:1788309700.068663:0:25009:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788309700.068666:0:25009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30d12da800, rc 0) 00000100:00100000:3.0:1788309700.068810:0:25009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+7:18102:x1875178037593856:12345-192.168.206.32@tcp:101:mkdir.0 Request processed in 386us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309700.068817:0:25009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 13 00010000:00010000:0.0:1788309700.586125:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788309700.717080:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788309700.717103:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc40e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048182272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788309700.717170:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309700.717269:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048182272 00000100:00100000:3.0:1788309700.717276:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048182272 00000100:00100000:3.0:1788309700.717342:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788309700.717352:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048182272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788309700.717371:0:24237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788309700.717423:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048182272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309700.717430:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788309700.717536:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc40e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048182272:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788309700.718010:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788309701.612199:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309701.738106:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc40e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048182400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788309701.738188:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309701.738491:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048182400 00000100:00100000:3.0:1788309701.738500:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048182400 00000100:00100000:3.0:1788309701.738597:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788309701.738608:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048182400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788309701.738636:0:24238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788309701.738685:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048182400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309701.738691:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788309701.738758:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788309701.738874:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc40e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048182400:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788309702.092166:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309702.095211:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037593984 00000100:00100000:3.0:1788309702.095224:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037593984 00000100:00100000:3.0:1788309702.095373:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 14 00000100:00100000:3.0:1788309702.095385:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+7:18154:x1875178037593984:12345-192.168.206.32@tcp:41:lfs.0 00000004:00000024:3.0:1788309702.095424:0:22728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788309702.097682:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+7:18154:x1875178037593984:12345-192.168.206.32@tcp:41:lfs.0 Request processed in 2290us (5515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309702.097695:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 14 00000100:00080000:2.0:1788309702.099908:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309702.101410:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309702.101759:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037594112 00000100:00100000:0.0:1788309702.101769:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037594112 00000100:00100000:0.0:1788309702.101862:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 15 00000100:00100000:0.0:1788309702.101874:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:18154:x1875178037594112:12345-192.168.206.32@tcp:41:lfs.0 00000004:00000024:0.0:1788309702.101910:0:22727:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788309702.101994:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:18154:x1875178037594112:12345-192.168.206.32@tcp:41:lfs.0 Request processed in 122us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309702.102001:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 15 00000100:00080000:2.0:1788309702.102294:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788309702.115196:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309702.117639:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037594240 00000100:00100000:3.0:1788309702.117651:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037594240 00000100:00100000:3.0:1788309702.117798:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00100000:3.0:1788309702.117810:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:18154:x1875178037594240:12345-192.168.206.32@tcp:13:lfs.0 00002000:00000024:3.0:1788309702.117832:0:24238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00080000:2.0:1788309702.118010:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788309702.118054:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:18154:x1875178037594240:12345-192.168.206.32@tcp:13:lfs.0 Request processed in 246us (2866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309702.118062:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00100000:0.0:1788309702.121506:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309702.121786:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037594368 00000100:00100000:3.0:1788309702.121798:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037594368 00000100:00080000:2.0:1788309702.122019:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788309702.122222:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 11 00000100:00100000:3.0:1788309702.122237:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:18154:x1875178037594368:12345-192.168.206.32@tcp:13:lfs.0 00002000:00000024:3.0:1788309702.122313:0:24238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788309702.122446:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:18154:x1875178037594368:12345-192.168.206.32@tcp:13:lfs.0 Request processed in 212us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309702.122455:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 11 00000100:00100000:1.0:1788309702.350070:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309702.352387:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037594496 00000100:00100000:3.0:1788309702.352401:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037594496 00000100:00100000:3.0:1788309702.352472:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 130 00000100:00100000:3.0:1788309702.352482:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc36ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8262932-b44d-4278-93be-21ab2fbade5b+10:18188:x1875178037594496:12345-192.168.206.32@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788309702.352497:0:22720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309702.352513:0:22720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30d12da600/0x98c38120c44af996 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193aa8 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309702.352540:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30d12da600/0x98c38120c44af996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193aa8 expref: 11 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309702.352565:0:22720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30d12da600/0x98c38120c44af996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193aa8 expref: 11 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309702.352574:0:22720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30d12da600, rc 0) 00000100:00100000:3.0:1788309702.352643:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc36ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8262932-b44d-4278-93be-21ab2fbade5b+11:18188:x1875178037594496:12345-192.168.206.32@tcp:101:mount.lustre.0 Request processed in 162us (2582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309702.352649:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 130 00000100:00100000:1.0:1788309702.355169:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309702.355313:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037594624 00000100:00100000:3.0:1788309702.355322:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037594624 00000100:00100000:3.0:1788309702.355373:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 131 00000100:00100000:3.0:1788309702.355382:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f613a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8262932-b44d-4278-93be-21ab2fbade5b+11:18188:x1875178037594624:12345-192.168.206.32@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788309702.355527:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f613a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8262932-b44d-4278-93be-21ab2fbade5b+11:18188:x1875178037594624:12345-192.168.206.32@tcp:501:mount.lustre.0 Request processed in 145us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309702.355555:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 131 00000100:00100000:1.0:1788309702.371015:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309702.371155:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037594752 00000100:00100000:0.0:1788309702.371174:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037594752 00000100:00100000:0.0:1788309702.371254:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 132 00000100:00100000:0.0:1788309702.371267:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f6139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+11:18188:x1875178037594752:12345-192.168.206.32@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788309702.371509:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f6139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+11:18188:x1875178037594752:12345-192.168.206.32@tcp:503:mount.lustre.0 Request processed in 243us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309702.371520:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 132 00000100:00100000:2.0:1788309702.376912:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309702.377138:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037594880 00000100:00100000:1.0:1788309702.377148:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037594880 00000100:00100000:1.0:1788309702.377297:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 133 00000100:00100000:1.0:1788309702.377307:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f6139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8262932-b44d-4278-93be-21ab2fbade5b+11:18193:x1875178037594880:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788309702.377464:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f6139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8262932-b44d-4278-93be-21ab2fbade5b+11:18193:x1875178037594880:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 157us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309702.377472:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 133 00000100:00100000:1.0:1788309702.405668:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309702.405767:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037595008 00000100:00100000:0.0:1788309702.405777:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037595008 00000100:00100000:0.0:1788309702.405831:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 134 00000100:00100000:0.0:1788309702.405877:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f613bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+11:18193:x1875178037595008:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788309702.406218:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f613bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+11:18193:x1875178037595008:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 368us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309702.406228:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 134 00000100:00100000:0.0:1788309702.413626:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309702.414567:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037595136 00000100:00100000:1.0:1788309702.414577:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037595136 00000100:00100000:1.0:1788309702.414634:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 135 00000100:00100000:1.0:1788309702.414644:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f6138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8262932-b44d-4278-93be-21ab2fbade5b+11:18193:x1875178037595136:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788309702.414812:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f6138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8262932-b44d-4278-93be-21ab2fbade5b+11:18193:x1875178037595136:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 168us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309702.414820:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 135 00000100:00100000:2.0:1788309702.426958:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309702.427308:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037595264 00000100:00100000:0.0:1788309702.427317:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037595264 00000100:00100000:0.0:1788309702.427373:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 136 00000100:00100000:0.0:1788309702.427383:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f613b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+11:18188:x1875178037595264:12345-192.168.206.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788309702.427398:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309702.427415:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30edf5be00/0x98c38120c44af99d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193ad9 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309702.427440:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30edf5be00/0x98c38120c44af99d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193ad9 expref: 12 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309702.427450:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30edf5be00/0x98c38120c44af99d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193ad9 expref: 12 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309702.427459:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30edf5be00, rc 0) 00000100:00100000:0.0:1788309702.427532:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f613b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+12:18188:x1875178037595264:12345-192.168.206.32@tcp:101:mount.lustre.0 Request processed in 149us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309702.427539:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 136 00000100:00100000:2.0:1788309702.433163:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309702.433250:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037595392 00000100:00100000:3.0:1788309702.433259:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037595392 00000100:00100000:3.0:1788309702.433314:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 137 00000100:00100000:3.0:1788309702.433325:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f6138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8262932-b44d-4278-93be-21ab2fbade5b+12:18188:x1875178037595392:12345-192.168.206.32@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788309702.433349:0:22722:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788309702.433373:0:22722:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788309702.433378:0:22722:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788309702.433381:0:22722:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788309702.433384:0:22722:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788309702.433386:0:22722:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1788309702.436475:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f6138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8262932-b44d-4278-93be-21ab2fbade5b+12:18188:x1875178037595392:12345-192.168.206.32@tcp:256:mount.lustre.0 Request processed in 3142us (3310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309702.436488:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 137 00000100:00100000:2.0:1788309702.441653:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309702.442891:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037595520 00000100:00100000:1.0:1788309702.442902:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037595520 00000100:00100000:1.0:1788309702.442963:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 138 00000100:00100000:1.0:1788309702.442974:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f6139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8262932-b44d-4278-93be-21ab2fbade5b+12:18188:x1875178037595520:12345-192.168.206.32@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788309702.442990:0:22720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309702.443007:0:22720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30d3d90400/0x98c38120c44af9a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193ae0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309702.443053:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30d3d90400/0x98c38120c44af9a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193ae0 expref: 13 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309702.443064:0:22720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30d3d90400/0x98c38120c44af9a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193ae0 expref: 13 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309702.443074:0:22720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30d3d90400, rc 0) 00000100:00100000:1.0:1788309702.443148:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f6139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8262932-b44d-4278-93be-21ab2fbade5b+13:18188:x1875178037595520:12345-192.168.206.32@tcp:101:mount.lustre.0 Request processed in 175us (1502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309702.443155:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 138 00000100:00100000:2.0:1788309702.448962:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309702.449140:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037595648 00000100:00100000:3.0:1788309702.449165:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037595648 00000100:00100000:3.0:1788309702.449328:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 139 00000100:00100000:3.0:1788309702.449339:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f6139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8262932-b44d-4278-93be-21ab2fbade5b+13:18188:x1875178037595648:12345-192.168.206.32@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788309702.449767:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f6139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8262932-b44d-4278-93be-21ab2fbade5b+13:18188:x1875178037595648:12345-192.168.206.32@tcp:501:mount.lustre.0 Request processed in 428us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309702.449776:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 139 00000100:00100000:3.0:1788309702.457500:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309702.465563:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037595776 00000100:00100000:0.0:1788309702.465587:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037595776 00000100:00100000:0.0:1788309702.465693:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 140 00000100:00100000:0.0:1788309702.465708:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f6138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+13:18188:x1875178037595776:12345-192.168.206.32@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788309702.467345:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f6138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+13:18188:x1875178037595776:12345-192.168.206.32@tcp:503:mount.lustre.0 Request processed in 1630us (9847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309702.467361:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 140 00000100:00100000:2.0:1788309702.473577:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309702.474122:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037595904 00000100:00100000:3.0:1788309702.474136:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037595904 00000100:00100000:3.0:1788309702.474210:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 141 00000100:00100000:3.0:1788309702.474221:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f6138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8262932-b44d-4278-93be-21ab2fbade5b+13:18196:x1875178037595904:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788309702.474417:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f6138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8262932-b44d-4278-93be-21ab2fbade5b+13:18196:x1875178037595904:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 197us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309702.474426:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 141 00000100:00100000:2.0:1788309702.484488:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309702.484626:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037596032 00000100:00100000:0.0:1788309702.484641:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037596032 00000100:00100000:0.0:1788309702.484757:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 142 00000100:00100000:0.0:1788309702.484770:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f613ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+13:18196:x1875178037596032:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788309702.485089:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f613ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+13:18196:x1875178037596032:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 320us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309702.485098:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 142 00000100:00100000:2.0:1788309702.500599:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309702.500662:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309702.500689:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309702.500750:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309702.500801:0:25402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037596800 00000100:00100000:2.0:1788309702.500812:0:25402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037596800 00000100:00100000:0.0:1788309702.500866:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037596288 00000100:00100000:0.0:1788309702.500872:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037596288 00000100:00100000:2.0:1788309702.500916:0:25402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037596672 00000100:00100000:0.0:1788309702.500917:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037596544 00000100:00100000:2.0:1788309702.500922:0:25402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037596672 00000100:00100000:0.0:1788309702.500923:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037596544 00000100:00100000:2.0:1788309702.500958:0:25402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:0.0:1788309702.500961:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 34 00000100:00100000:0.0:1788309702.500976:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+7:2388:x1875178037596288:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1788309702.500977:0:25402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d3b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:2388:x1875178037596800:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1788309702.501097:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 8 00000100:00100000:1.0:1788309702.501108:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d3b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:2388:x1875178037596672:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1788309702.501176:0:25402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d3b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:2388:x1875178037596800:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 207us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309702.501200:0:25402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:3.0:1788309702.506267:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 35 00000100:00100000:3.0:1788309702.506302:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:2388:x1875178037596544:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1788309702.506499:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+7:2388:x1875178037596288:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 5518us (5903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309702.506515:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 34 00000100:00100000:1.0:1788309702.507709:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d3b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:2388:x1875178037596672:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 6594us (6947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309702.507739:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 8 00000100:00100000:0.0:1788309702.511445:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309702.511518:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309702.511610:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037596160 00000100:00100000:1.0:1788309702.511623:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037596160 00000100:00100000:1.0:1788309702.511739:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037596928 00000100:00100000:1.0:1788309702.511743:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037596928 00000100:00100000:1.0:1788309702.511761:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 16 00000100:00100000:1.0:1788309702.511770:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2387:x1875178037596160:12345-192.168.206.32@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788309702.511806:0:22729:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5df0760e-86a4-46ba-b845-119bf6d92cdd@192.168.206.32@tcp t0 exp 0000000000000000 cur 612 last 0 00000020:00000080:1.0:1788309702.512022:0:22729:0:(genops.c:1385:class_connect()) connect: client 5df0760e-86a4-46ba-b845-119bf6d92cdd, cookie 0x98c38120c44af9ab 00000004:00100000:1.0:1788309702.512056:0:22729:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:1.0:1788309702.512180:0:22729:0:(import.c:65:import_set_state_nolock()) ffff8c2fc2a78000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788309702.512282:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5df0760e-86a4-46ba-b845-119bf6d92cdd+6:2387:x1875178037596160:12345-192.168.206.32@tcp:38:mount.lustre.0 Request processed in 511us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309702.512292:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 16 00000100:00100000:1.0:1788309702.512315:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 17 00000100:00100000:1.0:1788309702.512320:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2387:x1875178037596928:12345-192.168.206.32@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788309702.512337:0:22729:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 5df0760e-86a4-46ba-b845-119bf6d92cdd@192.168.206.32@tcp t0 exp 0000000000000000 cur 612 last 0 00000020:00000080:1.0:1788309702.512363:0:22729:0:(genops.c:1385:class_connect()) connect: client 5df0760e-86a4-46ba-b845-119bf6d92cdd, cookie 0x98c38120c44af9b2 00000004:00100000:1.0:1788309702.512376:0:22729:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:1.0:1788309702.512425:0:22729:0:(import.c:65:import_set_state_nolock()) ffff8c30c7561000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788309702.512448:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5df0760e-86a4-46ba-b845-119bf6d92cdd+6:2387:x1875178037596928:12345-192.168.206.32@tcp:38:mount.lustre.0 Request processed in 126us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309702.512454:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 17 00000100:00100000:1.0:1788309702.512498:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:2388:x1875178037596544:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 6214us (11836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309702.512505:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 35 00000100:00100000:2.0:1788309702.517518:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309702.518681:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309702.518922:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037597184 00000100:00100000:1.0:1788309702.518937:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037597184 00000100:00100000:1.0:1788309702.519046:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037596416 00000100:00100000:1.0:1788309702.519051:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037596416 00000100:00100000:2.0:1788309702.519073:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 18 00000100:00100000:0.0:1788309702.519126:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309702.519396:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d3b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5df0760e-86a4-46ba-b845-119bf6d92cdd+7:18188:x1875178037597184:12345-192.168.206.32@tcp:41:mount.lustre.0 00000100:00100000:1.0:1788309702.519424:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037597056 00000004:00000024:2.0:1788309702.519431:0:22728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788309702.519431:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037597056 00000100:00100000:1.0:1788309702.519471:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 19 00000100:00100000:1.0:1788309702.519485:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5df0760e-86a4-46ba-b845-119bf6d92cdd+7:0:x1875178037596416:12345-192.168.206.32@tcp:41:mount.lustre.0 00000100:00100000:2.0:1788309702.519506:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d3b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5df0760e-86a4-46ba-b845-119bf6d92cdd+7:18188:x1875178037597184:12345-192.168.206.32@tcp:41:mount.lustre.0 Request processed in 117us (2001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309702.519515:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 18 00000004:00000024:1.0:1788309702.519518:0:22729:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788309702.519545:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 20 00000100:00100000:2.0:1788309702.519556:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5df0760e-86a4-46ba-b845-119bf6d92cdd+6:0:x1875178037597056:12345-192.168.206.32@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788309702.519572:0:22728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788309702.519594:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5df0760e-86a4-46ba-b845-119bf6d92cdd+6:0:x1875178037596416:12345-192.168.206.32@tcp:41:mount.lustre.0 Request processed in 109us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309702.519612:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5df0760e-86a4-46ba-b845-119bf6d92cdd+6:0:x1875178037597056:12345-192.168.206.32@tcp:41:mount.lustre.0 Request processed in 56us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309702.519627:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 20 00000100:00100000:1.0:1788309702.520071:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 19 00000100:00080000:3.0:1788309702.524689:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788309702.524700:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788309702.532317:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309702.532433:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037597312 00000100:00100000:1.0:1788309702.532446:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037597312 00000100:00100000:1.0:1788309702.532517:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 21 00000100:00100000:1.0:1788309702.532529:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d3b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5df0760e-86a4-46ba-b845-119bf6d92cdd+6:18188:x1875178037597312:12345-192.168.206.32@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788309702.532683:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d3b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5df0760e-86a4-46ba-b845-119bf6d92cdd+6:18188:x1875178037597312:12345-192.168.206.32@tcp:40:mount.lustre.0 Request processed in 156us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309702.532693:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 21 00000100:00100000:2.0:1788309702.541960:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309702.542059:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037597696 00000100:00100000:2.0:1788309702.542072:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037597696 00000100:00100000:0.0:1788309702.542116:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309702.542161:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 4 00000100:00100000:2.0:1788309702.542177:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30d3b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5df0760e-86a4-46ba-b845-119bf6d92cdd+6:18188:x1875178037597696:12345-192.168.206.32@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788309702.542277:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30d3b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5df0760e-86a4-46ba-b845-119bf6d92cdd+6:18188:x1875178037597696:12345-192.168.206.32@tcp:900:mount.lustre.0 Request processed in 105us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309702.542285:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 4 00000100:00100000:0.0:1788309702.544502:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309702.548738:0:25402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037597440 00000100:00100000:3.0:1788309702.548752:0:25402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037597440 00000100:00100000:0.0:1788309702.548989:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309702.551033:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037597824 00000100:00100000:3.0:1788309702.551045:0:22731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037597824 00000100:00100000:3.0:1788309702.551114:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 1 00000100:00100000:3.0:1788309702.551125:0:22731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f03d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5df0760e-86a4-46ba-b845-119bf6d92cdd+6:18188:x1875178037597824:12345-192.168.206.32@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788309702.551207:0:22731:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788309702.551284:0:22731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f03d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5df0760e-86a4-46ba-b845-119bf6d92cdd+6:18188:x1875178037597824:12345-192.168.206.32@tcp:33:mount.lustre.0 Request processed in 161us (2299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309702.551292:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 1 00000100:00100000:1.0:1788309702.557294:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037597568 00000100:00100000:1.0:1788309702.557309:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037597568 00000100:00100000:1.0:1788309702.557428:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 23 00000100:00100000:1.0:1788309702.557437:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc401ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2387:x1875178037597568:12345-192.168.206.32@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788309702.557484:0:24234:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5df0760e-86a4-46ba-b845-119bf6d92cdd@192.168.206.32@tcp t0 exp 0000000000000000 cur 612 last 0 00000020:00000080:1.0:1788309702.557516:0:24234:0:(genops.c:1385:class_connect()) connect: client 5df0760e-86a4-46ba-b845-119bf6d92cdd, cookie 0x98c38120c44af9b9 00002000:00100000:1.0:1788309702.557526:0:24234:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5df0760e-86a4-46ba-b845-119bf6d92cdd/ffff8c30c7566800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788309702.557537:0:24234:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1788309702.557613:0:24234:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788309702.557644:0:24234:0:(import.c:65:import_set_state_nolock()) ffff8c30c7566000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788309702.557734:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc401ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5df0760e-86a4-46ba-b845-119bf6d92cdd+6:2387:x1875178037597568:12345-192.168.206.32@tcp:8:mount.lustre.0 Request processed in 285us (13229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309702.557743:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 23 00000100:00100000:0.0:1788309702.558470:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 24 00000100:00100000:0.0:1788309702.558478:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2387:x1875178037597440:12345-192.168.206.32@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788309702.558499:0:24236:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5df0760e-86a4-46ba-b845-119bf6d92cdd@192.168.206.32@tcp t0 exp 0000000000000000 cur 612 last 0 00000020:00000080:0.0:1788309702.558527:0:24236:0:(genops.c:1385:class_connect()) connect: client 5df0760e-86a4-46ba-b845-119bf6d92cdd, cookie 0x98c38120c44af9c0 00002000:00100000:0.0:1788309702.558534:0:24236:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5df0760e-86a4-46ba-b845-119bf6d92cdd/ffff8c30f50a9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788309702.558543:0:24236:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1788309702.558584:0:24236:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788309702.558602:0:24236:0:(import.c:65:import_set_state_nolock()) ffff8c30f50af800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788309702.558650:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5df0760e-86a4-46ba-b845-119bf6d92cdd+6:2387:x1875178037597440:12345-192.168.206.32@tcp:8:mount.lustre.0 Request processed in 171us (16544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309702.558656:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 24 00010000:00010000:0.0:1788309702.634545:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309702.703794:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309702.704178:0:25009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037597952 00000100:00100000:1.0:1788309702.704188:0:25009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037597952 00000100:00100000:1.0:1788309702.704244:0:25009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 22 00000100:00100000:1.0:1788309702.704254:0:25009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc40e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5df0760e-86a4-46ba-b845-119bf6d92cdd+6:18219:x1875178037597952:12345-192.168.206.32@tcp:101:mkdir.0 00010000:00010000:1.0:1788309702.704285:0:25009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309702.704306:0:25009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44af9c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193b11 expref: -99 pid: 25009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309702.704380:0:25009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91400/0x98c38120c44af9ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309702.704394:0:25009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91400/0x98c38120c44af9ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309702.704406:0:25009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91400/0x98c38120c44af9ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309702.704444:0:25009:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788309702.704448:0:25009:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788309702.704468:0:25009:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91400/0x98c38120c44af9ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309702.704492:0:25009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44af9c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b11 expref: 8 pid: 25009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309702.704508:0:25009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91400/0x98c38120c44af9ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b11 expref: 7 pid: 25009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309702.704516:0:25009:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c2fc3256b00) 00010000:00010000:1.0:1788309702.704518:0:25009:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788309702.704521:0:25009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30d3d91400, rc 0) 00000100:00100000:1.0:1788309702.704586:0:25009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc40e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5df0760e-86a4-46ba-b845-119bf6d92cdd+7:18219:x1875178037597952:12345-192.168.206.32@tcp:101:mkdir.0 Request processed in 334us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309702.704593:0:25009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 22 00000100:00100000:3.0:1788309702.762325:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc40e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875178048182528:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788309702.762354:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30f03d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875178048182784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788309702.762388:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309702.762388:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309702.762502:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048182528 00000100:00100000:2.0:1788309702.762521:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048182528 00000100:00100000:2.0:1788309702.762577:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788309702.762587:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc35db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875178048182528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788309702.762610:0:24237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788309702.762695:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875178048182912:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788309702.764523:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788309702.764571:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048182784 00000100:00100000:3.0:1788309702.764580:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048182784 00000100:00100000:3.0:1788309702.764626:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788309702.764635:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f03d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875178048182784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788309702.764660:0:22732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788309702.764740:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f03d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875178048182784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (2351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309702.764748:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788309702.764774:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30f03d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875178048182656:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788309702.765024:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309702.765067:0:23468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048182656 00000100:00100000:3.0:1788309702.765071:0:23468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048182656 00000100:00100000:3.0:1788309702.765092:0:23468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788309702.765098:0:23468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc35d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875178048182656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788309702.765111:0:23468:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788309702.765144:0:23468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc35d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875178048182656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 45us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309702.765149:0:23468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788309702.765189:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30f03d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875178048182656:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788309702.766232:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc35d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3618:1875178048183040:0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.766277:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309702.766324:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc35d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875178048183552:0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.766352:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309702.766377:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc35dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1875178048184064:0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.766406:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309702.766429:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788309702.766435:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc35d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875178048183424:0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.766455:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309702.766478:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc35da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1875178048183936:0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.766497:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309702.766538:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc35db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048183168:0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.766560:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309702.766576:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc35d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875178048183680:0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.766595:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309702.766610:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc35d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875178048184192:0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.766630:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309702.766643:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788309702.766648:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc35d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048183296:0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.766669:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309702.766686:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc35d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875178048183808:0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.766704:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309702.766736:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048184064 00000100:00100000:3.0:1788309702.766742:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048184064 00000100:00100000:3.0:1788309702.766779:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048183424 00000100:00100000:3.0:1788309702.766782:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048183424 00000100:00100000:3.0:1788309702.766805:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048183936 00000100:00100000:3.0:1788309702.766808:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048183936 00000100:00100000:3.0:1788309702.766823:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048183680 00000100:00100000:3.0:1788309702.766825:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048183680 00000100:00100000:3.0:1788309702.766863:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048184192 00000100:00100000:3.0:1788309702.766867:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048184192 00000100:00100000:3.0:1788309702.767354:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048183808 00000100:00100000:3.0:1788309702.767359:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048183808 00000100:00100000:3.0:1788309702.767386:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788309702.767395:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc35d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875178048184064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.767453:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc35d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875178048184064:12345-0@lo:400:kworker.0 Request processed in 60us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309702.767460:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788309702.767487:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788309702.767493:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc35d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875178048183424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.767537:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc35d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875178048183424:12345-0@lo:400:kworker.0 Request processed in 43us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309702.767544:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788309702.767556:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788309702.767562:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc35da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875178048183936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.767588:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc35da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875178048183936:12345-0@lo:400:kworker.0 Request processed in 27us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309702.767594:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788309702.767606:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788309702.767610:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc35daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875178048183680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.767641:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc35daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875178048183680:12345-0@lo:400:kworker.0 Request processed in 30us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309702.767646:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788309702.767657:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788309702.767663:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875178048184192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.767690:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875178048184192:12345-0@lo:400:kworker.0 Request processed in 28us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309702.767695:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788309702.767704:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788309702.767710:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875178048183808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.767744:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875178048183808:12345-0@lo:400:kworker.0 Request processed in 34us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309702.767750:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788309702.767777:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788309702.767781:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788309702.768052:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc35d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875178048183808:0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.768065:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc35d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875178048183680:0@lo:400:kworker.0 00010000:00080000:3.0:1788309702.768077:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c2fc35d9c00 x1875178048184192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309702.768088:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc35d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875178048184192:0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.768124:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc35d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875178048183424:0@lo:400:kworker.0 00010000:00080000:3.0:1788309702.768134:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c2fc35da680 x1875178048183936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788309702.768142:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc35da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1875178048183936:0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.768154:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc35dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1875178048184064:0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.768209:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048183552 00000100:00100000:3.0:1788309702.768213:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048183552 00000100:00100000:3.0:1788309702.768240:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048183168 00000100:00100000:3.0:1788309702.768243:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048183168 00000100:00100000:3.0:1788309702.768260:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048183296 00000100:00100000:3.0:1788309702.768263:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048183296 00000100:00100000:3.0:1788309702.768277:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788309702.768282:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc35dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875178048183552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.768426:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc35dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875178048183552:12345-0@lo:400:kworker.0 Request processed in 143us (2073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309702.768434:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788309702.768446:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788309702.768452:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc35db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048183168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.768494:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc35db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048183168:12345-0@lo:400:kworker.0 Request processed in 42us (1932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309702.768500:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788309702.768512:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788309702.768518:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1875178048183296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.768546:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1875178048183296:12345-0@lo:400:kworker.0 Request processed in 29us (1877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309702.768551:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788309702.768566:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788309702.768569:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788309702.768586:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc35d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048183296:0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.768595:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc35db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048183168:0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.768618:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc35d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875178048183552:0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.768640:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048183040 00000100:00100000:3.0:1788309702.768643:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048183040 00000100:00100000:3.0:1788309702.768670:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788309702.768676:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f613b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:3618:x1875178048183040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788309702.768710:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f613b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:3618:x1875178048183040:12345-0@lo:400:kworker.0 Request processed in 34us (2432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309702.768716:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788309702.768759:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc35d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3618:1875178048183040:0@lo:400:kworker.0 00000100:00100000:0.0:1788309702.769231:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30f03d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875178048182784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788309702.771533:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc35db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875178048182528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 8939us (9135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309702.771546:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788309702.771937:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc40e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875178048182528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788309702.776134:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309702.777446:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048182912 00000100:00100000:3.0:1788309702.777458:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048182912 00000100:00100000:3.0:1788309702.777531:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788309702.777541:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1875178048182912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788309702.777562:0:24238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788309702.777644:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1875178048182912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309702.777651:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788309702.777961:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875178048182912:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788309703.663811:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788309703.795028:0:25049:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5df0760e-86a4-46ba-b845-119bf6d92cdd 00000001:00100000:1.0:1788309703.795039:0:25049:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d9c1e3b0-2cc2-448d-b78b-db0c8de47f15 00000001:00080000:1.0:1788309703.795047:0:25049:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:1.0:1788309704.682384:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788309705.211681:0:25606:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788309705.707343:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309705.834442:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30ff4e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875178048184320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788309705.834512:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309705.835679:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048184320 00000100:00100000:1.0:1788309705.835690:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048184320 00000100:00100000:1.0:1788309705.835755:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788309705.835765:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f03d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875178048184320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788309705.835795:0:24238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:3.0:1788309705.836104:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1788309705.836906:0:23460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5df0760e-86a4-46ba-b845-119bf6d92cdd 00000001:00100000:3.0:1788309705.836916:0:23460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d9c1e3b0-2cc2-448d-b78b-db0c8de47f15 00000001:00100000:2.0:1788309705.837915:0:24230:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5df0760e-86a4-46ba-b845-119bf6d92cdd 00000001:00100000:2.0:1788309705.837923:0:24230:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d9c1e3b0-2cc2-448d-b78b-db0c8de47f15 00000100:00100000:1.0:1788309705.843525:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f03d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875178048184320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7749us (9001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309705.843543:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000001:00100000:2.0:1788309705.844712:0:22707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5df0760e-86a4-46ba-b845-119bf6d92cdd 00000001:00100000:2.0:1788309705.844724:0:22707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d9c1e3b0-2cc2-448d-b78b-db0c8de47f15 00000100:00100000:0.0:1788309705.847671:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30ff4e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875178048184320:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788309706.090573:0:22764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788309706.733677:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309706.858238:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30ff4e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048184448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788309706.858312:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309706.858416:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048184448 00000100:00100000:2.0:1788309706.858425:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048184448 00000100:00100000:2.0:1788309706.858495:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788309706.858505:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048184448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788309706.858525:0:24237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788309706.858566:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048184448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309706.858572:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788309706.858732:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788309706.858950:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30ff4e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048184448:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788309707.704070:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309707.704100:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309707.704118:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309707.704134:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309707.704158:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309707.704179:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309707.704196:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309707.704213:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309707.704237:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309707.704262:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037598080 00000100:00100000:0.0:1788309707.704271:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037598080 00000100:00100000:0.0:1788309707.704319:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 144 00000100:00100000:0.0:1788309707.704329:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f613b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+13:2390:x1875178037598080:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1788309707.704391:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f613b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+13:2390:x1875178037598080:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 63us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309707.704399:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 144 00000100:00100000:3.0:1788309707.707145:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037598208 00000100:00100000:3.0:1788309707.707159:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037598208 00000100:00100000:3.0:1788309707.707217:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037598720 00000100:00100000:3.0:1788309707.707220:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037598720 00000100:00100000:3.0:1788309707.707230:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037598336 00000100:00100000:3.0:1788309707.707232:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037598336 00000100:00100000:3.0:1788309707.707242:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037598848 00000100:00100000:3.0:1788309707.707244:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037598848 00000100:00100000:3.0:1788309707.707259:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 42 00000100:00100000:3.0:1788309707.707268:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f03d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:2390:x1875178037598208:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1788309707.707332:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f03d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:2390:x1875178037598208:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 65us (3267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309707.707339:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 42 00000100:00100000:3.0:1788309707.707353:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 43 00000100:00100000:3.0:1788309707.707359:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f03d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5df0760e-86a4-46ba-b845-119bf6d92cdd+6:2390:x1875178037598720:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1788309707.707382:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f03d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5df0760e-86a4-46ba-b845-119bf6d92cdd+6:2390:x1875178037598720:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 23us (3263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309707.707396:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 43 00000100:00100000:3.0:1788309707.707409:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 44 00000100:00100000:3.0:1788309707.707415:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f03d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+5:2390:x1875178037598336:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1788309707.707438:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f03d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+5:2390:x1875178037598336:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 23us (3258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309707.707443:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 44 00000100:00100000:3.0:1788309707.707452:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 45 00000100:00100000:3.0:1788309707.707458:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f03d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5df0760e-86a4-46ba-b845-119bf6d92cdd+5:2390:x1875178037598848:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1788309707.707475:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f03d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5df0760e-86a4-46ba-b845-119bf6d92cdd+5:2390:x1875178037598848:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 18us (3261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309707.707481:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 45 00000100:00100000:3.0:1788309707.707496:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037598464 00000100:00100000:3.0:1788309707.707499:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037598464 00000100:00100000:3.0:1788309707.707516:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037598976 00000100:00100000:3.0:1788309707.707518:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037598976 00000100:00100000:3.0:1788309707.707529:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037598592 00000100:00100000:3.0:1788309707.707531:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037598592 00000100:00100000:3.0:1788309707.707539:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037599104 00000100:00100000:3.0:1788309707.707542:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037599104 00000100:00100000:3.0:1788309707.707554:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 12 00000100:00100000:3.0:1788309707.707559:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f03d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+5:2390:x1875178037598464:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1788309707.707583:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f03d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+5:2390:x1875178037598464:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 24us (3483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309707.707588:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 12 00000100:00100000:3.0:1788309707.707598:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 13 00000100:00100000:3.0:1788309707.707609:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f03d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5df0760e-86a4-46ba-b845-119bf6d92cdd+5:2390:x1875178037598976:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1788309707.707648:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f03d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5df0760e-86a4-46ba-b845-119bf6d92cdd+5:2390:x1875178037598976:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 38us (3513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309707.707654:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 13 00000100:00100000:3.0:1788309707.707666:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 14 00000100:00100000:3.0:1788309707.707673:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f03d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+5:2390:x1875178037598592:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1788309707.707704:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f03d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+5:2390:x1875178037598592:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 21us (3496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309707.707711:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 14 00000100:00100000:3.0:1788309707.707721:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 15 00000100:00100000:3.0:1788309707.707727:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c7054850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5df0760e-86a4-46ba-b845-119bf6d92cdd+5:2390:x1875178037599104:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1788309707.707744:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c7054850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5df0760e-86a4-46ba-b845-119bf6d92cdd+5:2390:x1875178037599104:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 18us (3508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309707.707750:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 15 00000100:00080000:2.0:1788309707.709237:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788309707.709245:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788309707.709249:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788309707.709252:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788309707.757231:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309707.882194:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30f03d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875178048184576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788309707.882266:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309707.882386:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048184576 00000100:00100000:3.0:1788309707.882393:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048184576 00000100:00100000:3.0:1788309707.882437:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788309707.882447:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875178048184576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788309707.882479:0:22732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788309707.882523:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875178048184576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309707.882529:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788309707.882567:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30ff4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875178048184704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788309707.882594:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309707.882622:0:23468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048184704 00000100:00100000:3.0:1788309707.882626:0:23468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048184704 00000100:00100000:3.0:1788309707.882649:0:23468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788309707.882656:0:23468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875178048184704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788309707.882673:0:23468:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788309707.882822:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30f03d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048184832:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788309707.882881:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309707.882911:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048184832 00000100:00100000:0.0:1788309707.882915:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048184832 00000100:00100000:0.0:1788309707.882952:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788309707.882959:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f03d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048184832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788309707.882977:0:24237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788309707.883014:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f03d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875178048184832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309707.883027:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788309707.883044:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788309707.883078:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30f03d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875178048184832:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788309707.883129:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30f03d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875178048184576:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788309707.883874:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875178048185344:0@lo:400:kworker.0 00000100:00100000:2.0:1788309707.883914:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309707.883940:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875178048185856:0@lo:400:kworker.0 00000100:00100000:2.0:1788309707.883978:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309707.883999:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788309707.884005:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875178048185216:0@lo:400:kworker.0 00000100:00100000:2.0:1788309707.884028:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309707.884044:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875178048185728:0@lo:400:kworker.0 00000100:00100000:2.0:1788309707.884064:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309707.884091:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048185344 00000100:00100000:2.0:1788309707.884096:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048185344 00000100:00100000:2.0:1788309707.884141:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048185856 00000100:00100000:2.0:1788309707.884144:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048185856 00000100:00100000:2.0:1788309707.884164:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048185728 00000100:00100000:2.0:1788309707.884166:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048185728 00000100:00100000:2.0:1788309707.884181:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788309707.884188:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875178048185344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309707.884230:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875178048185344:12345-0@lo:400:kworker.0 Request processed in 42us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309707.884236:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788309707.884250:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788309707.884256:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875178048185856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309707.884282:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875178048185856:12345-0@lo:400:kworker.0 Request processed in 27us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309707.884288:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788309707.884299:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788309707.884305:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc2a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875178048185728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309707.884331:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc2a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875178048185728:12345-0@lo:400:kworker.0 Request processed in 27us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309707.884336:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788309707.884365:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048185216 00000100:00100000:2.0:1788309707.884369:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048185216 00000100:00100000:0.0:1788309707.884707:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875178048185088:0@lo:400:kworker.0 00000100:00100000:0.0:1788309707.884739:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309707.884759:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875178048185600:0@lo:400:kworker.0 00000100:00100000:0.0:1788309707.884781:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309707.884796:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1875178048186112:0@lo:400:kworker.0 00000100:00100000:0.0:1788309707.884818:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309707.884867:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788309707.884873:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3618:1875178048184960:0@lo:400:kworker.0 00000100:00100000:0.0:1788309707.884899:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309707.884924:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30d3b05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875178048185472:0@lo:400:kworker.0 00000100:00100000:0.0:1788309707.884962:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309707.884980:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1875178048185984:0@lo:400:kworker.0 00000100:00100000:0.0:1788309707.885001:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309707.885021:0:25402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048185088 00000100:00100000:0.0:1788309707.885025:0:25402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048185088 00000100:00100000:0.0:1788309707.885055:0:25402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048185472 00000100:00100000:0.0:1788309707.885058:0:25402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048185472 00000100:00100000:0.0:1788309707.885071:0:25402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788309707.885078:0:25402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f03d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875178048185088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309707.885258:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788309707.885265:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f03d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875178048185472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309707.885322:0:25402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f03d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875178048185088:12345-0@lo:400:kworker.0 Request processed in 244us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309707.885336:0:25402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788309707.885349:0:25402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788309707.885356:0:25402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875178048185216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309707.885400:0:25402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875178048185216:12345-0@lo:400:kworker.0 Request processed in 45us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309707.885407:0:25402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788309707.885423:0:25009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048185600 00000100:00100000:0.0:1788309707.885426:0:25009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048185600 00000100:00100000:0.0:1788309707.885440:0:25009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048186112 00000100:00100000:0.0:1788309707.885443:0:25009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048186112 00000100:00100000:0.0:1788309707.885454:0:25009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048185984 00000100:00100000:0.0:1788309707.885457:0:25009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048185984 00000100:00100000:0.0:1788309707.885469:0:25009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788309707.885474:0:25009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f03d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875178048185600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309707.885604:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc3436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048186240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788309707.885631:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309707.885661:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048186240 00000100:00100000:1.0:1788309707.885665:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048186240 00000100:00100000:1.0:1788309707.885701:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788309707.885709:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048186240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788309707.885732:0:24237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788309707.885766:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048186240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309707.885772:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788309707.885803:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1788309707.885822:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc3436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048186240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788309707.886096:0:23468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875178048184704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3439us (3500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309707.886118:0:23468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788309707.886143:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048184960 00000100:00100000:3.0:1788309707.886147:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048184960 00000100:00100000:3.0:1788309707.886213:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788309707.886220:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:3618:x1875178048184960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309707.888974:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f03d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875178048185472:12345-0@lo:400:kworker.0 Request processed in 3702us (4005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309707.888987:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788309707.889034:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788309707.889048:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f03d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875178048186112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309707.890304:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f03d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875178048186112:12345-0@lo:400:kworker.0 Request processed in 63us (4285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309707.890320:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788309707.890349:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788309707.890361:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f03d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875178048185984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788309707.890474:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f03d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875178048185984:12345-0@lo:400:kworker.0 Request processed in 117us (5471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309707.890481:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1788309707.890508:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788309707.890513:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788309707.890517:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788309707.890519:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788309707.890558:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875178048185216:0@lo:400:kworker.0 00000100:00100000:2.0:1788309707.890570:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875178048185728:0@lo:400:kworker.0 00000100:00100000:2.0:1788309707.890581:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875178048185344:0@lo:400:kworker.0 00010000:00080000:2.0:1788309707.890593:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c30fba9c380 x1875178048185856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788309707.890625:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875178048185856:0@lo:400:kworker.0 00000100:00100000:2.0:1788309707.890755:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30ff4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875178048184704:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788309707.890871:0:25009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f03d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875178048185600:12345-0@lo:400:kworker.0 Request processed in 5394us (6087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309707.890879:0:25009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788309707.891254:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:3618:x1875178048184960:12345-0@lo:400:kworker.0 Request processed in 5032us (6352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309707.891264:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788309707.893237:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875178048185472:0@lo:400:kworker.0 00000100:00100000:1.0:1788309707.893260:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1875178048185984:0@lo:400:kworker.0 00000100:00100000:1.0:1788309707.893271:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875178048185088:0@lo:400:kworker.0 00000100:00100000:1.0:1788309707.893283:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875178048185600:0@lo:400:kworker.0 00010000:00080000:1.0:1788309707.893300:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c30fba9ea00 x1875178048186112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309707.893311:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1875178048186112:0@lo:400:kworker.0 00000100:00100000:1.0:1788309707.893352:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30d3b04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3618:1875178048184960:0@lo:400:kworker.0 00000020:00000080:2.0:1788309708.583279:0:25753:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffebd4fea0 20000000:00000080:2.0:1788309708.583294:0:25753:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c3101e26800 uarg=0000000000000000 20000000:01000000:2.0:1788309708.583348:0:25753:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788309708.583353:0:25753:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788309708.583359:0:25753:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788309708.584070:0:25754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1788309708.584219:0:25753:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788309708.591944:0:25753:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788309708.592118:0:25753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c30d12db600/0x98c38120c44af9d5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309708.592138:0:25753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c30c83daa00/0x98c38120c44af632 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af62b expref: 23 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309708.592147:0:25753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c30c83da600/0x98c38120c44af640 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af639 expref: 23 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309708.592154:0:25753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c30c83dbe00/0x98c38120c44af67f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af678 expref: 23 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309708.592178:0:25753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c30fba6b400/0x98c38120c44af800 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44af7f9 expref: 23 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309708.592188:0:25753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44af965 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193a70 expref: 12 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309708.592195:0:25753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c30d3d90400/0x98c38120c44af9a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193ae0 expref: 12 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309708.592202:0:25753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c30d12db600/0x98c38120c44af9d5 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309708.592242:0:25753:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c30d3d90400/0x98c38120c44af9a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193ae0 expref: 12 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309708.592254:0:25753:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c30d3d90400/0x98c38120c44af9a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193ae0 expref: 12 pid: 22720 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309708.592315:0:25753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30ff4e2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25753:1875178048186368:192.168.206.32@tcp:104: 00010000:00010000:3.0:1788309708.592448:0:25753:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44af965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193a70 expref: 12 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309708.592458:0:25753:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44af965 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193a70 expref: 12 pid: 22719 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309708.592467:0:25753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30ff4e2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25753:1875178048186496:192.168.206.32@tcp:104: 00010000:00010000:3.0:1788309708.592501:0:25753:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c30fba6b400/0x98c38120c44af800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x98c38120c44af7f9 expref: 23 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309708.592520:0:25753:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c30fba6b400/0x98c38120c44af800 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x98c38120c44af7f9 expref: 23 pid: 22722 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309708.592530:0:25753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30ff4e3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25753:1875178048186624:0@lo:104: 00000100:00100000:3.0:1788309708.592570:0:25753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788309708.592657:0:25753:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c30c83dbe00/0x98c38120c44af67f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x98c38120c44af678 expref: 23 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309708.592665:0:25753:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c30c83dbe00/0x98c38120c44af67f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x98c38120c44af678 expref: 23 pid: 22720 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309708.592674:0:25753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30ff4e1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25753:1875178048186752:0@lo:104: 00000100:00100000:3.0:1788309708.592707:0:25753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788309708.592914:0:25753:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c30c83da600/0x98c38120c44af640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x98c38120c44af639 expref: 23 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309708.592923:0:25753:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c30c83da600/0x98c38120c44af640 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x98c38120c44af639 expref: 23 pid: 22720 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309708.592932:0:25753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30ff4e1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25753:1875178048186880:0@lo:104: 00000100:00100000:3.0:1788309708.592954:0:25753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309708.593588:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048186624 00000100:00100000:1.0:1788309708.593595:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048186624 00000100:00100000:1.0:1788309708.593635:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048186752 00000100:00100000:1.0:1788309708.593638:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048186752 00000100:00100000:1.0:1788309708.593651:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788309708.593659:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+4:25753:x1875178048186624:12345-0@lo:104: 00010000:00010000:1.0:1788309708.593671:0:22711:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff8c30d12daa00/0x98c38120c44af7f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af800 expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309708.593754:0:22711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788309708.593760:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+4:25753:x1875178048186624:12345-0@lo:104: Request processed in 102us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309708.593775:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788309708.593792:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788309708.593798:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+3:25753:x1875178048186752:12345-0@lo:104: 00010000:00010000:1.0:1788309708.593805:0:22711:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af678 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af67f expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309708.594008:0:22711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788309708.594014:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+3:25753:x1875178048186752:12345-0@lo:104: Request processed in 217us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309708.594021:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788309708.594173:0:25753:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c30c83daa00/0x98c38120c44af632 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x98c38120c44af62b expref: 23 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309708.594185:0:25753:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c30c83daa00/0x98c38120c44af632 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x98c38120c44af62b expref: 23 pid: 22720 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309708.594196:0:25753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30ff4e1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25753:1875178048187008:0@lo:104: 00000100:00100000:3.0:1788309708.594230:0:25753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309708.594242:0:25753:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c2fc23e5840 going to sleep for 11 seconds 00000100:00100000:3.0:1788309708.594261:0:25753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30ff4e3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25753:1875178048186624:0@lo:104: 00000100:00100000:3.0:1788309708.594275:0:25753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30ff4e1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25753:1875178048186752:0@lo:104: 00000100:00100000:2.0:1788309708.594641:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048186880 00000100:00100000:2.0:1788309708.594647:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048186880 00000100:00100000:2.0:1788309708.594672:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048187008 00000100:00100000:2.0:1788309708.594675:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048187008 00000100:00100000:2.0:1788309708.594698:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788309708.594706:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+4:25753:x1875178048186880:12345-0@lo:104: 00010000:00010000:2.0:1788309708.594715:0:22710:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff8c30c83da200/0x98c38120c44af639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af640 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309708.594898:0:25753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30ff4e1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25753:1875178048186880:0@lo:104: 00010000:00010000:0.0:1788309708.595040:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788309708.595047:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c30d12daa00/0x98c38120c44af7f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af800 expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309708.595055:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d12daa00 already unused, calling callback (ffffffffc1507c20) 10000000:00010000:0.0:1788309708.595059:0:23881:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c30d12daa00/0x98c38120c44af7f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x98c38120c44af800 expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309708.595069:0:23881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c30d12daa00/0x98c38120c44af7f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x98c38120c44af800 expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788309708.595090:0:23881:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c30d12daa00/0x98c38120c44af7f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x98c38120c44af800 expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309708.595096:0:23881:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788309708.595135:0:23881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff8c30d12daa00/0x98c38120c44af7f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af800 expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309708.595143:0:23881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788309708.595162:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c30d12daa00/0x98c38120c44af7f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af800 expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309708.595169:0:23881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c30d12daa00/0x98c38120c44af7f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af800 expref: -99 pid: 25048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309708.595179:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788309708.595182:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af678 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af67f expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309708.595187:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30c1512600 already unused, calling callback (ffffffffc1507c20) 10000000:00010000:0.0:1788309708.595190:0:23881:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af678 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x98c38120c44af67f expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309708.595196:0:23881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af678 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x98c38120c44af67f expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788309708.595202:0:23881:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af678 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x98c38120c44af67f expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309708.595207:0:23881:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788309708.595227:0:23881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af678 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af67f expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309708.595233:0:23881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788309708.595248:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af678 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af67f expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309708.595254:0:23881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c30c1512600/0x98c38120c44af678 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af67f expref: -99 pid: 24229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309708.595263:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309708.595266:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c30c83da200/0x98c38120c44af639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af640 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309708.595272:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30c83da200 already unused, calling callback (ffffffffc1507c20) 10000000:00010000:0.0:1788309708.595274:0:23881:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c30c83da200/0x98c38120c44af639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x98c38120c44af640 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309708.595281:0:23881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c30c83da200/0x98c38120c44af639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x98c38120c44af640 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788309708.595287:0:23881:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c30c83da200/0x98c38120c44af639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x98c38120c44af640 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309708.595292:0:23881:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788309708.595303:0:23881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff8c30c83da200/0x98c38120c44af639 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af640 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309708.595309:0:23881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788309708.595314:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c30c83da200/0x98c38120c44af639 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af640 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309708.595330:0:23881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c30c83da200/0x98c38120c44af639 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af640 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309708.595339:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309708.595341:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309708.595342:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309708.595445:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309708.595459:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30f03d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3617:1875178048187264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309708.595497:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309708.595537:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788309708.595543:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30f03d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3617:1875178048187392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309708.595563:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309708.595593:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048187264 00000100:00100000:1.0:1788309708.595597:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048187264 00010000:00010000:1.0:1788309708.595617:0:22712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c30c83dbe00/0x98c38120c44af67f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af678 expref: 24 pid: 22720 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309708.595636:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048187392 00000100:00100000:1.0:1788309708.595638:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048187392 00010000:00010000:1.0:1788309708.595649:0:22712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c30c83da600/0x98c38120c44af640 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af639 expref: 25 pid: 22720 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309708.595676:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788309708.595684:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+25:3617:x1875178048187264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788309708.595705:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309708.595711:0:22712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c30c83dbe00/0x98c38120c44af67f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af678 expref: 25 pid: 22720 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309708.595720:0:22712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c30c83dbe00/0x98c38120c44af67f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x98c38120c44af678 expref: 25 pid: 22720 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309708.595734:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30c83dbe00/0x98c38120c44af67f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x98c38120c44af678 expref: 25 pid: 22720 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309708.595746:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309708.595917:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:3617:x1875178048187264:12345-0@lo:103:ldlm_bl.0 Request processed in 233us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309708.595925:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788309708.595941:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788309708.595948:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3434e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+23:3617:x1875178048187392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788309708.595956:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309708.595960:0:22712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c30c83da600/0x98c38120c44af640 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af639 expref: 23 pid: 22720 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309708.595968:0:22712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c30c83da600/0x98c38120c44af640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x98c38120c44af639 expref: 23 pid: 22720 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309708.595978:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30c83da600/0x98c38120c44af640 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x98c38120c44af639 expref: 23 pid: 22720 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309708.595998:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309708.596023:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3434e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+22:3617:x1875178048187392:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309708.596029:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788309708.596063:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30f03d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3617:1875178048187392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309708.596072:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30f03d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3617:1875178048187264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309708.596111:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788309708.596119:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30f03d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3619:1875178048187136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309708.596142:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309708.596174:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048187136 00000100:00100000:1.0:1788309708.596178:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048187136 00010000:00010000:1.0:1788309708.596192:0:22712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c30fba6b400/0x98c38120c44af800 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af7f9 expref: 22 pid: 22722 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309708.596209:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788309708.596216:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3435880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+22:3619:x1875178048187136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788309708.596224:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309708.596228:0:22712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c30fba6b400/0x98c38120c44af800 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af7f9 expref: 22 pid: 22722 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309708.596236:0:22712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c30fba6b400/0x98c38120c44af800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x98c38120c44af7f9 expref: 22 pid: 22722 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309708.596246:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30fba6b400/0x98c38120c44af800 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x98c38120c44af7f9 expref: 22 pid: 22722 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309708.596255:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309708.596288:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3435880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:3619:x1875178048187136:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309708.596294:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788309708.596319:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30f03d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3619:1875178048187136:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788309708.596573:0:22710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788309708.596582:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+4:25753:x1875178048186880:12345-0@lo:104: Request processed in 1876us (3626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309708.596590:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788309708.596608:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788309708.596616:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+3:25753:x1875178048187008:12345-0@lo:104: 00010000:00010000:2.0:1788309708.596626:0:22710:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff8c30c1513200/0x98c38120c44af62b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af632 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309708.596737:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788309708.596929:0:22710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788309708.596936:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+3:25753:x1875178048187008:12345-0@lo:104: Request processed in 321us (2705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309708.596942:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788309708.597040:0:23881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788309708.597046:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff8c30c1513200/0x98c38120c44af62b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x98c38120c44af632 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309708.597054:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30c1513200 already unused, calling callback (ffffffffc1507c20) 10000000:00010000:0.0:1788309708.597057:0:23881:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff8c30c1513200/0x98c38120c44af62b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x98c38120c44af632 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309708.597065:0:23881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff8c30c1513200/0x98c38120c44af62b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x98c38120c44af632 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788309708.597072:0:23881:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff8c30c1513200/0x98c38120c44af62b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x98c38120c44af632 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309708.597077:0:23881:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788309708.597110:0:23881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff8c30c1513200/0x98c38120c44af62b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af632 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309708.597117:0:23881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788309708.597138:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff8c30c1513200/0x98c38120c44af62b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af632 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309708.597146:0:23881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff8c30c1513200/0x98c38120c44af62b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x98c38120c44af632 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309708.597167:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309708.597169:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788309708.597171:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309708.597208:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30f03d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3619:1875178048187520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788309708.597240:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309708.597319:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048187520 00000100:00100000:0.0:1788309708.597323:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048187520 00010000:00010000:0.0:1788309708.597342:0:22714:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c30c83daa00/0x98c38120c44af632 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af62b expref: 21 pid: 22720 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309708.597371:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788309708.597379:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3435c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:3619:x1875178048187520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788309708.597388:0:22714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309708.597392:0:22714:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c30c83daa00/0x98c38120c44af632 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x98c38120c44af62b expref: 21 pid: 22720 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309708.597401:0:22714:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c30c83daa00/0x98c38120c44af632 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x98c38120c44af62b expref: 21 pid: 22720 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309708.597414:0:22714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309708.597443:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3435c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:3619:x1875178048187520:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309708.597449:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788309708.597506:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30f03d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3619:1875178048187520:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788309708.597607:0:25753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30c83daa00/0x98c38120c44af632 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x98c38120c44af62b expref: 20 pid: 22720 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309708.597617:0:25753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30ff4e1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25753:1875178048187008:0@lo:104: 00000100:00100000:1.0:1788309708.598224:0:25753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30ff4e2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25753:1875178048186368:192.168.206.32@tcp:104: 00000100:00100000:1.0:1788309708.598234:0:25753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30ff4e2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25753:1875178048186496:192.168.206.32@tcp:104: 00010000:00010000:1.0:1788309708.598258:0:25753:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c30d12db600/0x98c38120c44af9d5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309708.598547:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309708.598624:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309708.598723:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037599232 00000100:00100000:1.0:1788309708.598730:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037599232 00010000:00010000:1.0:1788309708.598757:0:24259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c30d3d90400/0x98c38120c44af9a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193ae0 expref: 13 pid: 22720 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309708.598796:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037599360 00000100:00100000:1.0:1788309708.598800:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037599360 00010000:00010000:1.0:1788309708.598812:0:24259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44af965 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193a70 expref: 14 pid: 22719 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309708.598834:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 13 00000100:00100000:1.0:1788309708.598869:0:24259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8194450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8262932-b44d-4278-93be-21ab2fbade5b+14:2390:x1875178037599232:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788309708.598881:0:24259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309708.598886:0:24259:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c30d3d90400/0x98c38120c44af9a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193ae0 expref: 14 pid: 22720 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309708.598909:0:24259:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c30d3d90400/0x98c38120c44af9a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193ae0 expref: 14 pid: 22720 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309708.598922:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 14 00010000:00010000:1.0:1788309708.598925:0:24259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30d3d90400/0x98c38120c44af9a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193ae0 expref: 14 pid: 22720 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309708.598937:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8262932-b44d-4278-93be-21ab2fbade5b+13:2391:x1875178037599360:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788309708.598940:0:24259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788309708.598948:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309708.598956:0:22712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44af965 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193a70 expref: 13 pid: 22719 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309708.598974:0:22712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44af965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193a70 expref: 13 pid: 22719 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309708.598985:0:24259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8194450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8262932-b44d-4278-93be-21ab2fbade5b+13:2390:x1875178037599232:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 117us (438us total) trans 0 rc 0/0 00010000:00010000:3.0:1788309708.598989:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30edf5ae00/0x98c38120c44af965 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193a70 expref: 13 pid: 22719 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309708.598997:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 13 00010000:00010000:3.0:1788309708.599007:0:22712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c30d12db600/0x98c38120c44af9d5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309708.599018:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30d12db600/0x98c38120c44af9d5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309708.599044:0:22712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c30d12db600/0x98c38120c44af9d5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309708.599051:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c30d12db600/0x98c38120c44af9d5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309708.599058:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c30d12db600/0x98c38120c44af9d5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309708.599066:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c30d12db600/0x98c38120c44af9d5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309708.599073:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d12db600 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:3.0:1788309708.599077:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c30d12db600/0x98c38120c44af9d5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309708.599085:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c30d12db600/0x98c38120c44af9d5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309708.599105:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c30d12db600/0x98c38120c44af9d5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309708.599114:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788309708.599137:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8262932-b44d-4278-93be-21ab2fbade5b+11:2391:x1875178037599360:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 205us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309708.599145:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 14 00010000:00010000:1.0:1788309708.599180:0:25753:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c30d12db600/0x98c38120c44af9d5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309708.599189:0:25753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c30d12db600/0x98c38120c44af9d5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309708.599195:0:25753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c30d12db600/0x98c38120c44af9d5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309708.778241:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788309708.908579:0:23480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788309709.804215:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309709.910340:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309709.910458:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037599488 00000100:00100000:2.0:1788309709.910467:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037599488 00000100:00100000:2.0:1788309709.910575:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 23 00000100:00100000:2.0:1788309709.910586:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f03d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:18686:x1875178037599488:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788309709.910608:0:22728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309709.910629:0:22728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44af9dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193b18 expref: -99 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788309709.910743:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788309709.910959:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ae00/0x98c38120c44af9e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.910974:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ae00/0x98c38120c44af9e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.910986:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ae00/0x98c38120c44af9e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.911000:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b200/0x98c38120c44af9ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.911008:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b200/0x98c38120c44af9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.911015:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b200/0x98c38120c44af9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.911105:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6aa00/0x98c38120c44af9f1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.911113:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6aa00/0x98c38120c44af9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.911120:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6aa00/0x98c38120c44af9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309709.911150:0:22728:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788309709.911154:0:22728:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788309709.911191:0:22728:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6aa00/0x98c38120c44af9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.911200:0:22728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ae00/0x98c38120c44af9e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.911206:0:22728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ae00/0x98c38120c44af9e3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.911212:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ae00/0x98c38120c44af9e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.911217:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30fba6ae00 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:2.0:1788309709.911221:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ae00/0x98c38120c44af9e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.911228:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ae00/0x98c38120c44af9e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.911239:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c2fc3256b00) 00010000:00010000:2.0:1788309709.911247:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309709.911252:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ae00/0x98c38120c44af9e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.911259:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ae00/0x98c38120c44af9e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.911272:0:22728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b200/0x98c38120c44af9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.911278:0:22728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b200/0x98c38120c44af9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.911283:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b200/0x98c38120c44af9ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.911287:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30fba6b200 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:2.0:1788309709.911290:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b200/0x98c38120c44af9ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.911296:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b200/0x98c38120c44af9ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.911302:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8c2fc194be00) 00010000:00010000:2.0:1788309709.911305:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309709.911308:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b200/0x98c38120c44af9ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.911313:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b200/0x98c38120c44af9ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.911342:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44af9dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b18 expref: 8 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.911371:0:22728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6aa00/0x98c38120c44af9f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b18 expref: 7 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.911378:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c2fc194ba00) 00010000:00010000:2.0:1788309709.911380:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788309709.911381:0:22728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30fba6aa00, rc 0) 00000100:00100000:2.0:1788309709.911441:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f03d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+7:18686:x1875178037599488:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 857us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309709.911449:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 23 00000100:00100000:3.0:1788309709.920046:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309709.920112:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037599616 00000100:00100000:1.0:1788309709.920121:0:22739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037599616 00000100:00100000:1.0:1788309709.920181:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 5 00000100:00100000:1.0:1788309709.920192:0:22739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+7:18686:x1875178037599616:12345-192.168.206.32@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788309709.920281:0:22739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+7:18686:x1875178037599616:12345-192.168.206.32@tcp:900:lhsmtool_posix.0 Request processed in 91us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309709.920289:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 5 00000100:00100000:0.0:1788309709.935090:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309709.935189:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037599872 00000100:00100000:2.0:1788309709.935198:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037599872 00000100:00100000:2.0:1788309709.935256:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 24 00000100:00100000:2.0:1788309709.935267:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f03d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+7:18686:x1875178037599872:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788309709.935285:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309709.935305:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44af9f8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193b1f expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.935376:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b200/0x98c38120c44af9ff lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.935389:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b200/0x98c38120c44af9ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.935401:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b200/0x98c38120c44af9ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.935414:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ae00/0x98c38120c44afa06 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.935433:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ae00/0x98c38120c44afa06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.935440:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ae00/0x98c38120c44afa06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.935535:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b800/0x98c38120c44afa0d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.935543:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b800/0x98c38120c44afa0d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.935550:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b800/0x98c38120c44afa0d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309709.935559:0:22727:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788309709.935707:0:22727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b200/0x98c38120c44af9ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.935716:0:22727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b200/0x98c38120c44af9ff lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.935723:0:22727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b200/0x98c38120c44af9ff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.935729:0:22727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30fba6b200 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:2.0:1788309709.935733:0:22727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b200/0x98c38120c44af9ff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.935740:0:22727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b200/0x98c38120c44af9ff lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.935763:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c2fc194ba00) 00010000:00010000:2.0:1788309709.935766:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309709.935771:0:22727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b200/0x98c38120c44af9ff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.935777:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b200/0x98c38120c44af9ff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.935790:0:22727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ae00/0x98c38120c44afa06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.935796:0:22727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ae00/0x98c38120c44afa06 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.935801:0:22727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ae00/0x98c38120c44afa06 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.935806:0:22727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30fba6ae00 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:2.0:1788309709.935809:0:22727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ae00/0x98c38120c44afa06 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.935815:0:22727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ae00/0x98c38120c44afa06 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.935822:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8c2fc194be00) 00010000:00010000:2.0:1788309709.935824:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309709.935826:0:22727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ae00/0x98c38120c44afa06 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.935831:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ae00/0x98c38120c44afa06 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.937135:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44af9f8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b1f expref: 10 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.937153:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b800/0x98c38120c44afa0d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b1f expref: 9 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.937161:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c2fc194bb00) 00010000:00010000:2.0:1788309709.937163:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309709.937166:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30fba6b800, rc 0) 00000100:00100000:2.0:1788309709.937268:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f03d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+9:18686:x1875178037599872:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 2001us (2186us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788309709.937275:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 24 00000100:00100000:0.0:1788309709.948531:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309709.948931:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037600000 00000100:00100000:3.0:1788309709.948941:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037600000 00000100:00100000:3.0:1788309709.948995:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 25 00000100:00100000:3.0:1788309709.949076:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f03d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+9:18686:x1875178037600000:12345-192.168.206.32@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788309709.949177:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f03d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+9:18686:x1875178037600000:12345-192.168.206.32@tcp:59:lhsmtool_posix.0 Request processed in 160us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309709.949185:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 25 00000100:00100000:0.0:1788309709.954608:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309709.954721:0:25009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037600128 00000100:00100000:2.0:1788309709.954731:0:25009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037600128 00000100:00100000:2.0:1788309709.954800:0:25009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 26 00000100:00100000:2.0:1788309709.954811:0:25009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f03d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+5:18686:x1875178037600128:12345-192.168.206.32@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1788309709.955705:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788309709.956948:0:25009:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1967us 00000100:00100000:2.0:1788309709.982094:0:25009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f03d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+5:18686:x1875178037600128:12345-192.168.206.32@tcp:59:lhsmtool_posix.0 Request processed in 27276us (27486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309709.982108:0:25009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 26 10000000:01000000:2.0:1788309709.994548:0:22724:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788309709.994555:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c30fbbcb800 from 13 10000000:01000000:2.0:1788309709.994561:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788309709.994606:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30fba6ae00/0x98c38120c44afa1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.994618:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c30fba6ae00/0x98c38120c44afa1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.994642:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c30fba6ae00/0x98c38120c44afa1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309709.994666:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc2a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048187648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788309709.994743:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309709.994782:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c690fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788309709.995699:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048187648 00000100:00100000:3.0:1788309709.995708:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048187648 00000100:00100000:3.0:1788309709.995772:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788309709.995782:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+20:22724:x1875178048187648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309709.995795:0:22720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309709.995810:0:22720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30d12db200/0x98c38120c44afa22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44afa1b expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309709.995833:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30d12db200/0x98c38120c44afa22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44afa1b expref: 21 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309709.995863:0:22720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30d12db200/0x98c38120c44afa22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44afa1b expref: 21 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309709.995882:0:22720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30d12db200, rc 0) 00000100:00100000:3.0:1788309709.995949:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:22724:x1875178048187648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309709.995957:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788309709.996309:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc2a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048187648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788309709.996326:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c30fba6ae00/0x98c38120c44afa1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44afa22 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309709.996335:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c30fba6ae00/0x98c38120c44afa1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44afa22 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309709.996412:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30f03d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048187776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788309709.996454:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309709.996487:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c5948b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788309709.996651:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048187776 00000100:00100000:3.0:1788309709.996657:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048187776 00000100:00100000:3.0:1788309709.996699:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788309709.996706:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:22724:x1875178048187776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309709.996828:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:22724:x1875178048187776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309709.996889:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30f03d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048187776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788309709.996926:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc2a35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048187904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788309709.996967:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309709.996990:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c690f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788309709.997030:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788309709.997051:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048187904 00000100:00100000:3.0:1788309709.997054:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048187904 00000100:00100000:3.0:1788309709.997068:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788309709.997074:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:22724:x1875178048187904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788309709.997158:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:22724:x1875178048187904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309709.997164:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788309709.997205:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc2a35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048187904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788309709.998272:0:25767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788309709.998412:0:22724:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788309709.998428:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788309709.998436:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30fba6ae00/0x98c38120c44afa1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44afa22 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.998447:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30fba6ae00/0x98c38120c44afa1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44afa22 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309709.998456:0:22724:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788309709.998458:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c30f9a31000 from 13 10000000:01000000:2.0:1788309709.998461:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788309709.998485:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30fba6b200/0x98c38120c44afa29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.998492:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c30fba6b200/0x98c38120c44afa29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309709.998507:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c30fba6b200/0x98c38120c44afa29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309709.998523:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc2a35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048188032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788309709.998560:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309709.998594:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c690f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788309709.998647:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048188032 00000100:00100000:3.0:1788309709.998652:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048188032 00000100:00100000:3.0:1788309709.998700:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788309709.998707:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+21:22724:x1875178048188032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788309709.998716:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309709.998731:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30d12dba00/0x98c38120c44afa30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44afa29 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309709.998749:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30d12dba00/0x98c38120c44afa30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44afa29 expref: 22 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309709.998759:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30d12dba00/0x98c38120c44afa30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44afa29 expref: 22 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309709.998767:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30d12dba00, rc 0) 00000100:00100000:3.0:1788309709.998810:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+22:22724:x1875178048188032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309709.998816:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788309709.998920:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc2a35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048188032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788309709.998932:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c30fba6b200/0x98c38120c44afa29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44afa30 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309709.998940:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c30fba6b200/0x98c38120c44afa29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44afa30 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309709.998990:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30f03d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048188160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788309709.999017:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309709.999042:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c59486c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788309709.999088:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048188160 00000100:00100000:3.0:1788309709.999098:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048188160 00000100:00100000:3.0:1788309709.999129:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788309709.999136:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+22:22724:x1875178048188160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309709.999227:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b0d6b2e-d97d-4371-bf12-107712db0d6d+22:22724:x1875178048188160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309709.999233:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788309709.999331:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30f03d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048188160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788309709.999356:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30f03d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048188288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788309709.999395:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309709.999424:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c59486c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788309709.999468:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048188288 00000100:00100000:2.0:1788309709.999472:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048188288 00000100:00100000:2.0:1788309709.999536:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788309709.999544:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+22:22724:x1875178048188288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788309709.999655:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+22:22724:x1875178048188288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309709.999662:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788309709.999732:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30f03d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048188288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788309710.000622:0:25768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788309710.001464:0:22724:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788309710.001487:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788309710.001496:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30fba6b200/0x98c38120c44afa29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44afa30 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.001507:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30fba6b200/0x98c38120c44afa29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44afa30 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788309710.001516:0:22724:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788309710.001518:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c2fc33d3000 from 13 10000000:01000000:2.0:1788309710.001521:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788309710.001552:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30fba6a200/0x98c38120c44afa37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.001558:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c30fba6a200/0x98c38120c44afa37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.001577:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c30fba6a200/0x98c38120c44afa37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309710.001596:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc2a36a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048188416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788309710.001643:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309710.001695:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c690f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309710.001743:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048188416 00000100:00100000:1.0:1788309710.001750:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048188416 00000100:00100000:1.0:1788309710.001864:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788309710.001874:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+22:22724:x1875178048188416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788309710.001885:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309710.001897:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30d3d90400/0x98c38120c44afa3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44afa37 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.001919:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30d3d90400/0x98c38120c44afa3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44afa37 expref: 23 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.001929:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30d3d90400/0x98c38120c44afa3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44afa37 expref: 23 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.001937:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30d3d90400, rc 0) 00000100:00100000:1.0:1788309710.002139:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+23:22724:x1875178048188416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 267us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309710.002146:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788309710.002219:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc2a36a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048188416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788309710.002233:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c30fba6a200/0x98c38120c44afa37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44afa3e expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.002242:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c30fba6a200/0x98c38120c44afa37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44afa3e expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309710.002296:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc2a36a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048188544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788309710.002327:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788309710.002352:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c690f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788309710.003091:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048188544 00000100:00100000:3.0:1788309710.003097:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048188544 00000100:00100000:3.0:1788309710.003173:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788309710.003183:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+23:22724:x1875178048188544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788309710.003346:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+23:22724:x1875178048188544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309710.003353:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788309710.003358:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc2a36a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048188544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788309710.003399:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30f03d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048188672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788309710.003450:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309710.003481:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c5948cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309710.003614:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048188672 00000100:00100000:1.0:1788309710.003619:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048188672 00000100:00100000:1.0:1788309710.003646:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788309710.003654:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+23:22724:x1875178048188672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788309710.003761:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+23:22724:x1875178048188672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309710.003769:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788309710.003787:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30f03d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048188672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788309710.006345:0:25769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788309710.006835:0:22724:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788309710.006896:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788309710.006908:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30fba6a200/0x98c38120c44afa37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44afa3e expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.006918:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30fba6a200/0x98c38120c44afa37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44afa3e expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788309710.006928:0:22724:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788309710.006930:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c30c83d6000 from 13 10000000:01000000:0.0:1788309710.006932:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788309710.008188:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91e00/0x98c38120c44afa45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.008201:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91e00/0x98c38120c44afa45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.008222:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91e00/0x98c38120c44afa45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309710.008245:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30f03d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048188800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788309710.008302:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309710.008341:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c7553780 going to sleep for 11 seconds 00000100:00100000:2.0:1788309710.008510:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048188800 00000100:00100000:2.0:1788309710.008518:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048188800 00000100:00100000:2.0:1788309710.008577:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788309710.008587:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+23:22724:x1875178048188800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788309710.008599:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309710.008611:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30fba6ba00/0x98c38120c44afa4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x98c38120c44afa45 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.008640:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30fba6ba00/0x98c38120c44afa4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x98c38120c44afa45 expref: 24 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.008651:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30fba6ba00/0x98c38120c44afa4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x98c38120c44afa45 expref: 24 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.008659:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30fba6ba00, rc 0) 00000100:00100000:2.0:1788309710.008715:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:22724:x1875178048188800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309710.008722:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788309710.009520:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30f03d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048188800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788309710.009537:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91e00/0x98c38120c44afa45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44afa4c expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.009547:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91e00/0x98c38120c44afa45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x98c38120c44afa4c expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309710.009629:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc3436d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048188928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788309710.009666:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309710.009752:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c7553780 going to sleep for 11 seconds 00000100:00100000:3.0:1788309710.010283:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048188928 00000100:00100000:3.0:1788309710.010290:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048188928 00000100:00100000:3.0:1788309710.010360:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788309710.010369:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:22724:x1875178048188928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309710.010494:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:22724:x1875178048188928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309710.010500:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788309710.010558:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc3436d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048188928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788309710.010600:0:22724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc3436d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048189056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788309710.010643:0:22724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309710.010883:0:22724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c7553780 going to sleep for 11 seconds 00000100:00100000:2.0:1788309710.011096:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048189056 00000100:00100000:2.0:1788309710.011102:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048189056 00000100:00100000:2.0:1788309710.011129:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788309710.011136:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:22724:x1875178048189056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788309710.011226:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:22724:x1875178048189056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309710.011233:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788309710.011304:0:22724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc3436d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b0d6b2e-d97d-4371-bf12-107712db0d6d:22724:1875178048189056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788309710.012983:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309710.013016:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037600256 00000100:00100000:1.0:1788309710.013023:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037600256 00000100:00100000:1.0:1788309710.013074:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 27 00000100:00100000:1.0:1788309710.013083:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+9:18692:x1875178037600256:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:1.0:1788309710.013098:0:22729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309710.013115:0:22729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91c00/0x98c38120c44afa53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193b26 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.013171:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90c00/0x98c38120c44afa5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.013184:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90c00/0x98c38120c44afa5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.013194:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90c00/0x98c38120c44afa5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.013249:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afa61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.013256:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afa61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.013263:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afa61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.013304:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90c00/0x98c38120c44afa5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.013310:0:22729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90c00/0x98c38120c44afa5a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.013317:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90c00/0x98c38120c44afa5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.013332:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d3d90c00 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:1.0:1788309710.013337:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90c00/0x98c38120c44afa5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.013344:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90c00/0x98c38120c44afa5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.013356:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c2fc3256b00) 00010000:00010000:1.0:1788309710.013359:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309710.013363:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90c00/0x98c38120c44afa5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.013369:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90c00/0x98c38120c44afa5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.013382:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afa61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.013387:0:22729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afa61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.013405:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afa61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.013410:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d3d91800 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:1.0:1788309710.013412:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afa61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.013418:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afa61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.013436:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8c2fc2343d00) 00010000:00010000:1.0:1788309710.013439:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309710.013442:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afa61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.013447:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afa61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.013478:0:22729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91c00/0x98c38120c44afa53 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b26 expref: 10 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.013487:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c2fc3256b00) 00010000:00010000:1.0:1788309710.013489:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309710.013493:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91c00/0x98c38120c44afa53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b26 expref: 10 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.013501:0:22729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30d3d91c00, rc 0) 00000100:00100000:1.0:1788309710.013550:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+9:18692:x1875178037600256:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 469us (574us total) trans 0 rc 301/301 00000100:00100000:1.0:1788309710.013556:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 27 00000040:00080000:2.0:1788309710.016297:0:25770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788309710.016513:0:22724:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788309710.016536:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788309710.016547:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91e00/0x98c38120c44afa45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44afa4c expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.016558:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff8c30d3d91e00/0x98c38120c44afa45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x98c38120c44afa4c expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309710.023406:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309710.023549:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037600384 00000100:00100000:1.0:1788309710.023559:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037600384 00000100:00100000:1.0:1788309710.023614:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 0 00000100:00100000:1.0:1788309710.023624:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc2a34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+9:18692:x1875178037600384:12345-192.168.206.32@tcp:700:lfs.0 00000100:00100000:1.0:1788309710.023716:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc2a34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+9:18692:x1875178037600384:12345-192.168.206.32@tcp:700:lfs.0 Request processed in 93us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309710.023724:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 0 00000100:00100000:1.0:1788309710.028914:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309710.029123:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037600640 00000100:00100000:3.0:1788309710.029132:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037600640 00000100:00100000:3.0:1788309710.029184:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 28 00000100:00100000:3.0:1788309710.029194:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+9:18692:x1875178037600640:12345-192.168.206.32@tcp:36:lfs.0 00010000:00010000:3.0:1788309710.029243:0:22727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788309710.029268:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da800/0x98c38120c44af98f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193aa1 expref: 9 pid: 25009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.029285:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c2fc3256b00) 00010000:00010000:3.0:1788309710.029301:0:22727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788309710.029358:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afa68 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.029372:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91400/0x98c38120c44af9ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b11 expref: 5 pid: 25009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.029381:0:22727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afa68 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.029535:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91400/0x98c38120c44af9ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b11 expref: 5 pid: 25009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.029550:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91400/0x98c38120c44af9ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b11 expref: 5 pid: 25009 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309710.029564:0:22727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30ff4e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22727:1875178048189184:192.168.206.32@tcp:104: 00000100:00100000:3.0:1788309710.029699:0:22727:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c7d43a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788309710.041945:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309710.042035:0:22727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30ff4e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22727:1875178048189184:192.168.206.32@tcp:104: 00010000:00010000:3.0:1788309710.042061:0:22727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afa68 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309710.042137:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037600768 00000100:00100000:1.0:1788309710.042145:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037600768 00010000:00010000:1.0:1788309710.042198:0:24259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91400/0x98c38120c44af9ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b11 expref: 6 pid: 25009 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309710.042236:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 15 00000100:00100000:1.0:1788309710.042245:0:24259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f03d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5df0760e-86a4-46ba-b845-119bf6d92cdd+6:2391:x1875178037600768:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788309710.042258:0:24259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309710.042264:0:24259:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91400/0x98c38120c44af9ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b11 expref: 6 pid: 25009 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.042274:0:24259:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91400/0x98c38120c44af9ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b11 expref: 6 pid: 25009 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.042293:0:24259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91400/0x98c38120c44af9ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b11 expref: 6 pid: 25009 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.042323:0:24259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c2fc3256b00) 00010000:00010000:1.0:1788309710.042327:0:24259:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afa68 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.042334:0:24259:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afa68 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.042340:0:24259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afa68 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.042362:0:24259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788309710.042405:0:24259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f03d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5df0760e-86a4-46ba-b845-119bf6d92cdd+5:2391:x1875178037600768:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 161us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309710.042411:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 15 00000100:00080000:0.0:1788309710.042549:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788309710.042597:0:22727:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afa68 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.042605:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afa68 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.042629:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da800/0x98c38120c44afa6f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.042648:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da800/0x98c38120c44afa6f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.042668:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da800/0x98c38120c44afa6f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.045095:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da400/0x98c38120c44afa76 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.045117:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da400/0x98c38120c44afa76 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.045127:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da400/0x98c38120c44afa76 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788309710.045144:0:22727:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c4ef2e1 reply state 000000001574f3a7 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da400/0x98c38120c44afa76 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.045155:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da400/0x98c38120c44afa76 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.045162:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8c2fc322c300) 00010000:00010000:3.0:1788309710.045165:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788309710.045169:0:22727:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788309710.045173:0:22727:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788309710.045181:0:22727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afa68 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.045187:0:22727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afa68 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.045194:0:22727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afa68 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.045207:0:22727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d12da000 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:3.0:1788309710.045211:0:22727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afa68 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.045218:0:22727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afa68 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.045229:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c2fc3256b00) 00010000:00010000:3.0:1788309710.045231:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309710.045234:0:22727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afa68 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.045240:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afa68 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788309710.045256:0:22727:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c4ef2e1 reply state 000000001574f3a7 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da800/0x98c38120c44afa6f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.045264:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da800/0x98c38120c44afa6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.045270:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8c2fc322c500) 00010000:00010000:3.0:1788309710.045272:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788309710.045274:0:22727:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788309710.045363:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+10:18692:x1875178037600640:12345-192.168.206.32@tcp:36:lfs.0 Request processed in 16168us (16455us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788309710.045371:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 28 00000100:00100000:0.0:1788309710.128568:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309710.129195:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037600896 00000100:00100000:1.0:1788309710.129221:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037600896 00000100:00100000:1.0:1788309710.129309:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 29 00000100:00100000:1.0:1788309710.129323:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+10:18700:x1875178037600896:12345-192.168.206.32@tcp:101:lctl.0 00010000:00010000:1.0:1788309710.129359:0:22729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309710.129404:0:22729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91400/0x98c38120c44afa7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193b2d expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.129491:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91000/0x98c38120c44afa84 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.129506:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91000/0x98c38120c44afa84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.129817:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91000/0x98c38120c44afa84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309710.129931:0:22729:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788309710.129936:0:22729:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788309710.129989:0:22729:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91000/0x98c38120c44afa84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.130023:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91400/0x98c38120c44afa7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b2d expref: 12 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.130046:0:22729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91000/0x98c38120c44afa84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b2d expref: 11 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.130056:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c2fc2343d00) 00010000:00010000:1.0:1788309710.130059:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788309710.130063:0:22729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30d3d91000, rc 0) 00000100:00100000:1.0:1788309710.130335:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+11:18700:x1875178037600896:12345-192.168.206.32@tcp:101:lctl.0 Request processed in 1012us (1779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309710.130344:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 29 00000100:00100000:1.0:1788309710.155254:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309710.155440:0:25009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037601024 00000100:00100000:2.0:1788309710.155452:0:25009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037601024 00000100:00100000:2.0:1788309710.155536:0:25009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 30 00000100:00100000:2.0:1788309710.155549:0:25009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5df0760e-86a4-46ba-b845-119bf6d92cdd+5:18701:x1875178037601024:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:2.0:1788309710.155575:0:25009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309710.155601:0:25009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b600/0x98c38120c44afa8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193b34 expref: -99 pid: 25009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.156392:0:25009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a800/0x98c38120c44afa92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.156413:0:25009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a800/0x98c38120c44afa92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.156429:0:25009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a800/0x98c38120c44afa92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309710.156486:0:25009:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788309710.156491:0:25009:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788309710.156518:0:25009:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a800/0x98c38120c44afa92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.156732:0:25009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b600/0x98c38120c44afa8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b34 expref: 7 pid: 25009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.156761:0:25009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a800/0x98c38120c44afa92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b34 expref: 6 pid: 25009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.156771:0:25009:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c2fc2343d00) 00010000:00010000:2.0:1788309710.156774:0:25009:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788309710.156779:0:25009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30fba6a800, rc 0) 00000100:00100000:2.0:1788309710.156925:0:25009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5df0760e-86a4-46ba-b845-119bf6d92cdd+6:18701:x1875178037601024:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 1378us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309710.156935:0:25009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 30 00000100:00100000:2.0:1788309710.160386:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309710.160514:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037601152 00000100:00100000:1.0:1788309710.160527:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037601152 00000100:00100000:1.0:1788309710.160734:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 31 00000100:00100000:1.0:1788309710.160747:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc2a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5df0760e-86a4-46ba-b845-119bf6d92cdd+6:18701:x1875178037601152:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:1.0:1788309710.160775:0:22728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309710.160802:0:22728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91400/0x98c38120c44afa99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193b3b expref: -99 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.160956:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90c00/0x98c38120c44afaa0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.160974:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90c00/0x98c38120c44afaa0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.160990:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90c00/0x98c38120c44afaa0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.161004:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afaa7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.161011:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afaa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.161017:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afaa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.161115:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91c00/0x98c38120c44afaae lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.161124:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91c00/0x98c38120c44afaae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.161131:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91c00/0x98c38120c44afaae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309710.161178:0:22728:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788309710.161183:0:22728:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788309710.161222:0:22728:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91c00/0x98c38120c44afaae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.161255:0:22728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90c00/0x98c38120c44afaa0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.161261:0:22728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90c00/0x98c38120c44afaa0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.161269:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90c00/0x98c38120c44afaa0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.161274:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d3d90c00 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:1.0:1788309710.161279:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90c00/0x98c38120c44afaa0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.161287:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90c00/0x98c38120c44afaa0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.161302:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c2fc2343d00) 00010000:00010000:1.0:1788309710.161305:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309710.161315:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90c00/0x98c38120c44afaa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.161321:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90c00/0x98c38120c44afaa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.161336:0:22728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afaa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.161342:0:22728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afaa7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.161348:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afaa7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.161364:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d3d91800 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:1.0:1788309710.161368:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afaa7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.161374:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afaa7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.161383:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8c2fc322c500) 00010000:00010000:1.0:1788309710.161386:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309710.161389:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afaa7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.161395:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afaa7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.161428:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91400/0x98c38120c44afa99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b3b expref: 8 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.161442:0:22728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91c00/0x98c38120c44afaae lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b3b expref: 7 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.161450:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8c2fc322c300) 00010000:00010000:1.0:1788309710.161452:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788309710.161455:0:22728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30d3d91c00, rc 0) 00000100:00100000:1.0:1788309710.161532:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc2a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5df0760e-86a4-46ba-b845-119bf6d92cdd+7:18701:x1875178037601152:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 787us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309710.161541:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 31 00000100:00100000:3.0:1788309710.167029:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309710.167294:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037601280 00000100:00100000:1.0:1788309710.167327:0:22739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037601280 00000100:00100000:1.0:1788309710.167487:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 6 00000100:00100000:1.0:1788309710.167500:0:22739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5df0760e-86a4-46ba-b845-119bf6d92cdd+5:18701:x1875178037601280:12345-192.168.206.32@tcp:900:lfs.0 00000100:00080000:0.0:1788309710.167560:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788309710.167610:0:22739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5df0760e-86a4-46ba-b845-119bf6d92cdd+5:18701:x1875178037601280:12345-192.168.206.32@tcp:900:lfs.0 Request processed in 113us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309710.167619:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 6 00000100:00100000:2.0:1788309710.170812:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309710.171088:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037601536 00000100:00100000:3.0:1788309710.171101:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037601536 00000100:00100000:3.0:1788309710.171230:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 32 00000100:00100000:3.0:1788309710.171242:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc2a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5df0760e-86a4-46ba-b845-119bf6d92cdd+7:18701:x1875178037601536:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:3.0:1788309710.171268:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309710.171296:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afab5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193b42 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309710.171426:0:22727:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788309710.171556:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afab5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b42 expref: 9 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.171574:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c2fc2343d00) 00010000:00010000:3.0:1788309710.171577:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788309710.171582:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afab5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b42 expref: 9 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.171597:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30d12da000, rc 0) 00000100:00100000:3.0:1788309710.171691:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc2a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5df0760e-86a4-46ba-b845-119bf6d92cdd+8:18701:x1875178037601536:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 441us (882us total) trans 12884901891 rc 301/301 00000100:00100000:3.0:1788309710.171700:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 32 00000100:00100000:3.0:1788309710.175297:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309710.175548:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037601792 00000100:00100000:0.0:1788309710.175562:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037601792 00000100:00100000:0.0:1788309710.175695:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 33 00000100:00100000:0.0:1788309710.175709:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5df0760e-86a4-46ba-b845-119bf6d92cdd+8:18701:x1875178037601792:12345-192.168.206.32@tcp:36:lfs.0 00010000:00010000:0.0:1788309710.175802:0:22729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309710.175884:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91c00/0x98c38120c44afaae lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b3b expref: 8 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.175910:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8c2fc322c300) 00010000:00010000:0.0:1788309710.175916:0:22729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788309710.175945:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5ae00/0x98c38120c44afac3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.175960:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5ae00/0x98c38120c44afac3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.175971:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5ae00/0x98c38120c44afac3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788309710.176299:0:22729:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053aedffc reply state 00000000fa0326a8 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5ae00/0x98c38120c44afac3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.176315:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5ae00/0x98c38120c44afac3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.176322:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8c2fc322c300) 00010000:00010000:0.0:1788309710.176324:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788309710.176328:0:22729:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788309710.176338:0:22729:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788309710.176432:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5df0760e-86a4-46ba-b845-119bf6d92cdd+9:18701:x1875178037601792:12345-192.168.206.32@tcp:36:lfs.0 Request processed in 727us (1148us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788309710.176441:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 33 00000100:00100000:1.0:1788309710.180286:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309710.180403:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037602048 00000100:00100000:0.0:1788309710.180415:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037602048 00000100:00100000:0.0:1788309710.180546:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 2 00000100:00100000:0.0:1788309710.180558:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5df0760e-86a4-46ba-b845-119bf6d92cdd+9:18701:x1875178037602048:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:0.0:1788309710.180907:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5df0760e-86a4-46ba-b845-119bf6d92cdd+10:18701:x1875178037602048:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 350us (703us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788309710.180917:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 2 00000100:00100000:2.0:1788309710.184326:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309710.184464:0:25009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037602304 00000100:00100000:0.0:1788309710.184477:0:25009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037602304 00000100:00100000:0.0:1788309710.184550:0:25009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 34 00000100:00100000:0.0:1788309710.184562:0:25009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc2a36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5df0760e-86a4-46ba-b845-119bf6d92cdd+10:18701:x1875178037602304:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:0.0:1788309710.184595:0:25009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309710.184622:0:25009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5a600/0x98c38120c44afaca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193b49 expref: -99 pid: 25009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.185211:0:25009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5b400/0x98c38120c44afad1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.185235:0:25009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5b400/0x98c38120c44afad1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.185250:0:25009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5b400/0x98c38120c44afad1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.185270:0:25009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1c00/0x98c38120c44afad8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.185277:0:25009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1c00/0x98c38120c44afad8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.185284:0:25009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1c00/0x98c38120c44afad8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788309710.185460:0:25009:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788309710.185552:0:25009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5b400/0x98c38120c44afad1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.185561:0:25009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5b400/0x98c38120c44afad1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.185568:0:25009:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5b400/0x98c38120c44afad1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.185575:0:25009:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30edf5b400 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:0.0:1788309710.185579:0:25009:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5b400/0x98c38120c44afad1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.185587:0:25009:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5b400/0x98c38120c44afad1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.185602:0:25009:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c2fc2343d00) 00010000:00010000:0.0:1788309710.185606:0:25009:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309710.185611:0:25009:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5b400/0x98c38120c44afad1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.185617:0:25009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5b400/0x98c38120c44afad1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.185633:0:25009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1c00/0x98c38120c44afad8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.185761:0:25009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1c00/0x98c38120c44afad8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.185782:0:25009:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1c00/0x98c38120c44afad8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.185788:0:25009:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc35f1c00 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:0.0:1788309710.185791:0:25009:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1c00/0x98c38120c44afad8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.186512:0:25009:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1c00/0x98c38120c44afad8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.186529:0:25009:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8c2fc322c500) 00010000:00010000:0.0:1788309710.186532:0:25009:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309710.186537:0:25009:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1c00/0x98c38120c44afad8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.186543:0:25009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1c00/0x98c38120c44afad8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.186604:0:25009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5a600/0x98c38120c44afaca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b49 expref: 12 pid: 25009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.186616:0:25009:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c2fc2343d00) 00010000:00010000:0.0:1788309710.186619:0:25009:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788309710.186623:0:25009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5a600/0x98c38120c44afaca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b49 expref: 12 pid: 25009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.186634:0:25009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30edf5a600, rc 0) 00000100:00100000:0.0:1788309710.187670:0:25009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc2a36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5df0760e-86a4-46ba-b845-119bf6d92cdd+11:18701:x1875178037602304:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 3098us (3346us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1788309710.187712:0:25009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 34 00000040:00080000:2.0:1788309710.188185:0:22764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788309710.190300:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309710.190455:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037602432 00000100:00100000:1.0:1788309710.190469:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037602432 00000100:00100000:1.0:1788309710.190551:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 35 00000100:00100000:1.0:1788309710.190562:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc2a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5df0760e-86a4-46ba-b845-119bf6d92cdd+11:18701:x1875178037602432:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:1.0:1788309710.190592:0:22728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788309710.190619:0:22728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90c00/0x98c38120c44afae6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193b50 expref: -99 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.190983:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44afaed lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.191001:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44afaed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.191014:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44afaed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309710.191043:0:22728:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788309710.191048:0:22728:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788309710.191073:0:22728:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44afaed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.191107:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90c00/0x98c38120c44afae6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b50 expref: 13 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.191148:0:22728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44afaed lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b50 expref: 12 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.191159:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8c2fc322c300) 00010000:00010000:1.0:1788309710.191162:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788309710.191166:0:22728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30d3d90600, rc 0) 00000100:00100000:1.0:1788309710.191246:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc2a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5df0760e-86a4-46ba-b845-119bf6d92cdd+12:18701:x1875178037602432:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 685us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309710.191254:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 35 00000100:00100000:1.0:1788309710.197999:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309710.198318:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037602560 00000100:00100000:3.0:1788309710.198333:0:22731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037602560 00000100:00100000:3.0:1788309710.198410:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 3 00000100:00100000:3.0:1788309710.198424:0:22731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5df0760e-86a4-46ba-b845-119bf6d92cdd+12:18701:x1875178037602560:12345-192.168.206.32@tcp:37:lfs.0 00000100:00100000:3.0:1788309710.207076:0:22731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5df0760e-86a4-46ba-b845-119bf6d92cdd+12:18701:x1875178037602560:12345-192.168.206.32@tcp:37:lfs.0 Request processed in 8637us (9075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309710.207094:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 3 00000100:00100000:2.0:1788309710.213066:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309710.213360:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037602816 00000100:00100000:0.0:1788309710.213374:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037602816 00000100:00100000:0.0:1788309710.213500:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 4 00000100:00100000:0.0:1788309710.213513:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc236a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5df0760e-86a4-46ba-b845-119bf6d92cdd+12:18701:x1875178037602816:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:0.0:1788309710.217012:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc236a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5df0760e-86a4-46ba-b845-119bf6d92cdd+13:18701:x1875178037602816:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 327us (785us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788309710.217033:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 4 00000100:00100000:1.0:1788309710.267491:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309710.268087:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037602944 00000100:00100000:3.0:1788309710.268101:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037602944 00000100:00100000:3.0:1788309710.268179:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 36 00000100:00100000:3.0:1788309710.268191:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+11:18707:x1875178037602944:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:3.0:1788309710.268226:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788309710.268253:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afaf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193b57 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.268332:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dac00/0x98c38120c44afafb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.268349:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dac00/0x98c38120c44afafb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.268362:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dac00/0x98c38120c44afafb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.268374:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db000/0x98c38120c44afb02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.268382:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db000/0x98c38120c44afb02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.268504:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db000/0x98c38120c44afb02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.268607:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbe00/0x98c38120c44afb09 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.268617:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbe00/0x98c38120c44afb09 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.268646:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbe00/0x98c38120c44afb09 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788309710.268702:0:22727:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788309710.268706:0:22727:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788309710.268754:0:22727:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbe00/0x98c38120c44afb09 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.268768:0:22727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dac00/0x98c38120c44afafb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.268775:0:22727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dac00/0x98c38120c44afafb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.268783:0:22727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dac00/0x98c38120c44afafb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.268789:0:22727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d12dac00 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:3.0:1788309710.268794:0:22727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dac00/0x98c38120c44afafb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.268803:0:22727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dac00/0x98c38120c44afafb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.268817:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c2fc2343d00) 00010000:00010000:3.0:1788309710.268821:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309710.268826:0:22727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dac00/0x98c38120c44afafb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.268832:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dac00/0x98c38120c44afafb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.268897:0:22727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db000/0x98c38120c44afb02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.268903:0:22727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db000/0x98c38120c44afb02 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.268909:0:22727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db000/0x98c38120c44afb02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.268914:0:22727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d12db000 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:3.0:1788309710.268917:0:22727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db000/0x98c38120c44afb02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.268923:0:22727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db000/0x98c38120c44afb02 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.268929:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8c2fc322c500) 00010000:00010000:3.0:1788309710.268932:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309710.268935:0:22727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db000/0x98c38120c44afb02 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.268941:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db000/0x98c38120c44afb02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.268972:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afaf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b57 expref: 13 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.268987:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbe00/0x98c38120c44afb09 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b57 expref: 12 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.269007:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8c2fc322c300) 00010000:00010000:3.0:1788309710.269009:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788309710.269012:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30d12dbe00, rc 0) 00000100:00100000:3.0:1788309710.269098:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+12:18707:x1875178037602944:12345-192.168.206.32@tcp:101:bash.0 Request processed in 907us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309710.269108:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 36 00000100:00100000:2.0:1788309710.275582:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309710.279106:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037603072 00000100:00100000:0.0:1788309710.279129:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037603072 00000100:00100000:1.0:1788309710.279462:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:1.0:1788309710.279477:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc2a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+5:18707:x1875178037603072:12345-192.168.206.32@tcp:900:bash.0 00000100:00100000:1.0:1788309710.279607:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc2a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+5:18707:x1875178037603072:12345-192.168.206.32@tcp:900:bash.0 Request processed in 134us (4040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309710.279616:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:3.0:1788309710.282326:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309710.282496:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037603328 00000100:00100000:0.0:1788309710.282510:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037603328 00000100:00100000:0.0:1788309710.282588:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 37 00000100:00100000:0.0:1788309710.282600:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+12:18707:x1875178037603328:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:0.0:1788309710.282627:0:22729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309710.282654:0:22729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1c00/0x98c38120c44afb10 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193b5e expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.282820:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afb17 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.282943:0:22729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44afaed lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b50 expref: 12 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.282954:0:22729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afb17 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.283016:0:22729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44afaed lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b50 expref: 12 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.283031:0:22729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44afaed lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b50 expref: 12 pid: 22728 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309710.283046:0:22729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc4186300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22729:1875178048189312:192.168.206.32@tcp:104: 00000100:00100000:0.0:1788309710.283148:0:22729:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c5948c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788309710.285810:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309710.285965:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037603456 00000100:00100000:1.0:1788309710.285975:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037603456 00000100:00100000:0.0:1788309710.285991:0:22729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc4186300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22729:1875178048189312:192.168.206.32@tcp:104: 00010000:00010000:0.0:1788309710.286023:0:22729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afb17 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.286024:0:22712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44afaed lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b50 expref: 13 pid: 22728 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309710.286057:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 16 00000100:00100000:1.0:1788309710.286191:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5df0760e-86a4-46ba-b845-119bf6d92cdd+13:2391:x1875178037603456:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788309710.286278:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788309710.286305:0:22712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44afaed lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b50 expref: 13 pid: 22728 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.286319:0:22712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44afaed lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b50 expref: 13 pid: 22728 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.286347:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44afaed lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b50 expref: 13 pid: 22728 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.286368:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8c2fc322c300) 00010000:00010000:1.0:1788309710.286373:0:22712:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afb17 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.286386:0:22712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afb17 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.286623:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afb17 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.286663:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788309710.286826:0:22729:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afb17 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.286834:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afb17 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309710.286893:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5df0760e-86a4-46ba-b845-119bf6d92cdd+12:2391:x1875178037603456:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 775us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309710.286903:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 16 00010000:00010000:1.0:1788309710.290961:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afb1e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.290991:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afb1e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.291008:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afb1e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.292351:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44afb25 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.292377:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44afb25 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.292387:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44afb25 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788309710.292402:0:22729:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788309710.292435:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afb17 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.292442:0:22729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afb17 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.292450:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afb17 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.292456:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc35f0800 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:1.0:1788309710.292461:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afb17 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.292469:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afb17 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.292483:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8c2fc322c300) 00010000:00010000:1.0:1788309710.292486:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788309710.292491:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afb17 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.292514:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afb17 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788309710.292530:0:22729:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c6b2d0a reply state 00000000826f6cc1 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afb1e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.292542:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afb1e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.292547:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8c2fc2343500) 00010000:00010000:1.0:1788309710.292550:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788309710.292554:0:22729:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788309710.292599:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1c00/0x98c38120c44afb10 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b5e expref: 15 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.292616:0:22729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44afb25 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b5e expref: 14 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309710.292721:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c2fc2343100) 00010000:00010000:1.0:1788309710.292724:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788309710.292726:0:22729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30d3d90600, rc 0) 00000100:00100000:1.0:1788309710.293122:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+15:18707:x1875178037603328:12345-192.168.206.32@tcp:101:bash.0 Request processed in 10521us (10809us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1788309710.293132:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 37 00000100:00100000:3.0:1788309710.308620:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309710.309370:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037603584 00000100:00100000:2.0:1788309710.309380:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037603584 00000100:00100000:2.0:1788309710.309451:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 38 00000100:00100000:2.0:1788309710.309462:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+15:18707:x1875178037603584:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:2.0:1788309710.309484:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309710.309503:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6bc00/0x98c38120c44afb33 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193b65 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.309566:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afb3a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.309579:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afb3a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.309590:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afb3a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309710.309650:0:22727:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788309710.309654:0:22727:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788309710.309695:0:22727:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afb3a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.309706:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afb3a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.309731:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6bc00/0x98c38120c44afb33 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b65 expref: 17 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.309764:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afb3a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b65 expref: 16 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.309784:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c2fc2343100) 00010000:00010000:2.0:1788309710.309788:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788309710.309792:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30fba6ac00, rc 0) 00000100:00100000:2.0:1788309710.309910:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+16:18707:x1875178037603584:12345-192.168.206.32@tcp:101:bash.0 Request processed in 451us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309710.309918:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 38 00000100:00100000:2.0:1788309710.312388:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309710.312830:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037603840 00000100:00100000:3.0:1788309710.312863:0:22731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037603840 00000100:00100000:3.0:1788309710.313058:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 5 00000100:00100000:3.0:1788309710.313070:0:22731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc2a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+16:18707:x1875178037603840:12345-192.168.206.32@tcp:35:bash.0 00000100:00100000:3.0:1788309710.313365:0:22731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc2a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+17:18707:x1875178037603840:12345-192.168.206.32@tcp:35:bash.0 Request processed in 296us (983us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1788309710.313373:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 5 00000100:00100000:1.0:1788309710.421299:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309710.421381:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037604096 00000100:00100000:2.0:1788309710.421390:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037604096 00000100:00100000:2.0:1788309710.421450:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 39 00000100:00100000:2.0:1788309710.421460:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+17:18718:x1875178037604096:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:2.0:1788309710.421483:0:22728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309710.421502:0:22728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6bc00/0x98c38120c44afb41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193b6c expref: -99 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309710.421593:0:22728:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788309710.421690:0:22728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6bc00/0x98c38120c44afb41 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b6c expref: 19 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.421705:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c2fc2343d00) 00010000:00010000:2.0:1788309710.421709:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788309710.421714:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6bc00/0x98c38120c44afb41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b6c expref: 19 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.421744:0:22728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30fba6bc00, rc 0) 00000100:00100000:2.0:1788309710.422001:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+18:18718:x1875178037604096:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 541us (708us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1788309710.422010:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 39 00000100:00100000:1.0:1788309710.429057:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309710.431364:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037604352 00000100:00100000:0.0:1788309710.431378:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037604352 00000100:00100000:0.0:1788309710.431510:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 6 00000100:00100000:0.0:1788309710.431522:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+18:18718:x1875178037604352:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:0.0:1788309710.431777:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+19:18718:x1875178037604352:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 257us (2729us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1788309710.431784:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 6 00000100:00100000:0.0:1788309710.468303:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309710.468589:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037604608 00000100:00100000:2.0:1788309710.468598:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037604608 00000100:00100000:2.0:1788309710.468652:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 40 00000100:00100000:2.0:1788309710.468663:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+19:18721:x1875178037604608:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:2.0:1788309710.468723:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309710.468743:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6bc00/0x98c38120c44afb4f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193b73 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.468872:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6be00/0x98c38120c44afb56 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.468887:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6be00/0x98c38120c44afb56 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.468899:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6be00/0x98c38120c44afb56 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309710.468910:0:22727:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788309710.469016:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6bc00/0x98c38120c44afb4f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b73 expref: 22 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.469039:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6be00/0x98c38120c44afb56 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b73 expref: 21 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.469060:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c2fc2343100) 00010000:00010000:2.0:1788309710.469063:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788309710.469067:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30fba6be00, rc 0) 00000100:00100000:2.0:1788309710.469194:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+21:18721:x1875178037604608:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 532us (898us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1788309710.469201:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 40 00000100:00100000:1.0:1788309710.472124:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309710.472203:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037604736 00000100:00100000:3.0:1788309710.472213:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037604736 00000100:00100000:3.0:1788309710.472299:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 41 00000100:00100000:3.0:1788309710.472311:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+21:18721:x1875178037604736:12345-192.168.206.32@tcp:54:lfs.0 00010000:00010000:3.0:1788309710.472374:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbc00/0x98c38120c44afb64 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.472388:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbc00/0x98c38120c44afb64 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.472415:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbc00/0x98c38120c44afb64 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.472450:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbc00/0x98c38120c44afb64 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.472456:0:22729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbc00/0x98c38120c44afb64 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.472462:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbc00/0x98c38120c44afb64 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.472468:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d12dbc00 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:3.0:1788309710.472473:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbc00/0x98c38120c44afb64 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.472479:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbc00/0x98c38120c44afb64 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.472490:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c2fc2343100) 00010000:00010000:3.0:1788309710.472494:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788309710.472498:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbc00/0x98c38120c44afb64 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.472504:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbc00/0x98c38120c44afb64 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309710.472577:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+21:18721:x1875178037604736:12345-192.168.206.32@tcp:54:lfs.0 Request processed in 269us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309710.472584:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 41 00000100:00100000:1.0:1788309710.474605:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309710.475001:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037604864 00000100:00100000:2.0:1788309710.475010:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037604864 00000100:00100000:2.0:1788309710.475104:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 0 00000100:00100000:2.0:1788309710.475114:0:24259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3437800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+21:2391:x1875178037604864:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309710.475128:0:24259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309710.475149:0:24259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6be00/0x98c38120c44afb56 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b73 expref: 21 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.475164:0:24259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c2fc2343100) 00010000:00010000:2.0:1788309710.475169:0:24259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309710.475220:0:24259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3437800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+20:2391:x1875178037604864:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 107us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309710.475227:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 0 00000100:00100000:0.0:1788309710.476459:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309710.477258:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037605120 00000100:00100000:3.0:1788309710.477267:0:22731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037605120 00000100:00100000:3.0:1788309710.477365:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:3.0:1788309710.477376:0:22731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+20:18721:x1875178037605120:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:3.0:1788309710.477575:0:22731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+21:18721:x1875178037605120:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 200us (1118us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1788309710.477582:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:1.0:1788309710.578908:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309710.579047:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037605248 00000100:00100000:2.0:1788309710.579058:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037605248 00000100:00100000:2.0:1788309710.579114:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 158 00000100:00100000:2.0:1788309710.579125:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8262932-b44d-4278-93be-21ab2fbade5b+11:18070:x1875178037605248:12345-192.168.206.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788309710.579140:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309710.579167:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30fba6be00/0x98c38120c44afb6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193b7a expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.579193:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30fba6be00/0x98c38120c44afb6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b7a expref: 12 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.579204:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30fba6be00/0x98c38120c44afb6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b7a expref: 12 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.579213:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30fba6be00, rc 0) 00000100:00100000:2.0:1788309710.579273:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8262932-b44d-4278-93be-21ab2fbade5b+12:18070:x1875178037605248:12345-192.168.206.32@tcp:101:ll_cfg_requeue.0 Request processed in 149us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309710.579281:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 158 00000100:00100000:1.0:1788309710.582829:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309710.583118:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037605376 00000100:00100000:0.0:1788309710.583128:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037605376 00000100:00100000:0.0:1788309710.583188:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 159 00000100:00100000:0.0:1788309710.583197:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f5c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8262932-b44d-4278-93be-21ab2fbade5b+12:18070:x1875178037605376:12345-192.168.206.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788309710.583343:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f5c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8262932-b44d-4278-93be-21ab2fbade5b+12:18070:x1875178037605376:12345-192.168.206.32@tcp:501:ll_cfg_requeue.0 Request processed in 146us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309710.583351:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 159 00000100:00100000:0.0:1788309710.586108:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309710.586319:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037605504 00000100:00100000:3.0:1788309710.586328:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037605504 00000100:00100000:3.0:1788309710.586448:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 160 00000100:00100000:3.0:1788309710.586462:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+12:18070:x1875178037605504:12345-192.168.206.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788309710.586600:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+12:18070:x1875178037605504:12345-192.168.206.32@tcp:503:ll_cfg_requeue.0 Request processed in 140us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309710.586609:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 160 00000100:00100000:1.0:1788309710.591256:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309710.591501:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037605632 00000100:00100000:2.0:1788309710.591521:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037605632 00000100:00100000:2.0:1788309710.591576:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 161 00000100:00100000:2.0:1788309710.591586:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8262932-b44d-4278-93be-21ab2fbade5b+12:18070:x1875178037605632:12345-192.168.206.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788309710.591603:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309710.591625:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c30fba6bc00/0x98c38120c44afb72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193b81 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.591653:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c30fba6bc00/0x98c38120c44afb72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b81 expref: 13 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.591666:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c30fba6bc00/0x98c38120c44afb72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b81 expref: 13 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.591675:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30fba6bc00, rc 0) 00000100:00100000:2.0:1788309710.591743:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8262932-b44d-4278-93be-21ab2fbade5b+13:18070:x1875178037605632:12345-192.168.206.32@tcp:101:ll_cfg_requeue.0 Request processed in 159us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309710.591764:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 161 00000100:00100000:1.0:1788309710.593796:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309710.593988:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037605760 00000100:00100000:3.0:1788309710.593997:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037605760 00000100:00100000:3.0:1788309710.594093:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 162 00000100:00100000:3.0:1788309710.594105:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+13:18070:x1875178037605760:12345-192.168.206.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788309710.594247:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+13:18070:x1875178037605760:12345-192.168.206.32@tcp:501:ll_cfg_requeue.0 Request processed in 145us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309710.594255:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 162 00000100:00100000:0.0:1788309710.596365:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309710.596449:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037605888 00000100:00100000:2.0:1788309710.596456:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037605888 00000100:00100000:2.0:1788309710.596539:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 163 00000100:00100000:2.0:1788309710.596549:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8262932-b44d-4278-93be-21ab2fbade5b+13:18070:x1875178037605888:12345-192.168.206.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788309710.596664:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8262932-b44d-4278-93be-21ab2fbade5b+13:18070:x1875178037605888:12345-192.168.206.32@tcp:503:ll_cfg_requeue.0 Request processed in 116us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309710.596672:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 163 00000100:00100000:1.0:1788309710.797349:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309710.799283:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037606144 00000100:00100000:2.0:1788309710.799298:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037606144 00000100:00100000:2.0:1788309710.799374:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 42 00000100:00100000:2.0:1788309710.799384:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+21:18754:x1875178037606144:12345-192.168.206.32@tcp:101:cat.0 00010000:00010000:2.0:1788309710.799415:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309710.799434:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b000/0x98c38120c44afb79 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193b88 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.799533:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a600/0x98c38120c44afb80 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.799547:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a600/0x98c38120c44afb80 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.799557:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a600/0x98c38120c44afb80 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309710.799567:0:22727:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788309710.799694:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b000/0x98c38120c44afb79 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b88 expref: 24 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.799730:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a600/0x98c38120c44afb80 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b88 expref: 23 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.799738:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c2fc2343100) 00010000:00010000:2.0:1788309710.799741:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788309710.799745:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30fba6a600, rc 0) 00000100:00100000:2.0:1788309710.800038:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+23:18754:x1875178037606144:12345-192.168.206.32@tcp:101:cat.0 Request processed in 653us (2696us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1788309710.800046:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 42 00000100:00100000:1.0:1788309710.807950:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309710.807991:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309710.808084:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037606272 00000100:00100000:0.0:1788309710.808096:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037606272 00000100:00100000:0.0:1788309710.808162:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 1 00000100:00100000:0.0:1788309710.808174:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3435c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+23:2391:x1875178037606272:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309710.808190:0:22713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309710.808215:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a600/0x98c38120c44afb80 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b88 expref: 23 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.808235:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c2fc2343100) 00010000:00010000:0.0:1788309710.808241:0:22713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309710.808301:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3435c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+22:2391:x1875178037606272:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 129us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309710.808309:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 1 00000100:00100000:2.0:1788309710.808402:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037606528 00000100:00100000:2.0:1788309710.808407:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037606528 00000100:00100000:2.0:1788309710.808446:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 8 00000100:00100000:2.0:1788309710.808454:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+22:18754:x1875178037606528:12345-192.168.206.32@tcp:35:cat.0 00000100:00100000:2.0:1788309710.808722:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+23:18754:x1875178037606528:12345-192.168.206.32@tcp:35:cat.0 Request processed in 268us (730us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1788309710.808730:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 8 00010000:00010000:0.0:1788309710.826011:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788309710.894087:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309710.894258:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037606784 00000100:00100000:2.0:1788309710.894269:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037606784 00000100:00100000:2.0:1788309710.894329:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 43 00000100:00100000:2.0:1788309710.894340:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+23:18760:x1875178037606784:12345-192.168.206.32@tcp:101:dd.0 00010000:00010000:2.0:1788309710.894364:0:22728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309710.894382:0:22728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b000/0x98c38120c44afb8e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193b8f expref: -99 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.894625:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a400/0x98c38120c44afb95 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.894652:0:22728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44afb25 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b5e expref: 24 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.894661:0:22728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afb3a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b65 expref: 24 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.894669:0:22728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a400/0x98c38120c44afb95 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.894712:0:22728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afb3a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b65 expref: 24 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.894725:0:22728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afb3a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b65 expref: 24 pid: 22727 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309710.894738:0:22728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc2a34000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22728:1875178048189440:192.168.206.32@tcp:104: 00010000:00010000:2.0:1788309710.894826:0:22728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44afb25 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b5e expref: 24 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.894836:0:22728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44afb25 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b5e expref: 24 pid: 22729 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309710.894875:0:22728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc2a35500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22728:1875178048189568:192.168.206.32@tcp:104: 00000100:00100000:2.0:1788309710.894904:0:22728:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c60d8180 going to sleep for 11 seconds 00000100:00100000:3.0:1788309710.901275:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309710.901426:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037606912 00000100:00100000:0.0:1788309710.901434:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037606912 00010000:00010000:0.0:1788309710.901472:0:22714:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afb3a lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b65 expref: 25 pid: 22727 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309710.901539:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 17 00000100:00100000:0.0:1788309710.901550:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+25:2391:x1875178037606912:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309710.901566:0:22714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309710.901574:0:22714:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afb3a lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b65 expref: 25 pid: 22727 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.901586:0:22714:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afb3a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b65 expref: 25 pid: 22727 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.901606:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c2fc2343100) 00010000:00010000:0.0:1788309710.901611:0:22714:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a400/0x98c38120c44afb95 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.901618:0:22714:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a400/0x98c38120c44afb95 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.901624:0:22714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309710.901878:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+25:2391:x1875178037606912:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 328us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309710.901886:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 17 00010000:00010000:2.0:1788309710.902604:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afb3a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b65 expref: 24 pid: 22727 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309710.902635:0:22728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc2a34000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22728:1875178048189440:192.168.206.32@tcp:104: 00000100:00100000:2.0:1788309710.902648:0:22728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc2a35500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22728:1875178048189568:192.168.206.32@tcp:104: 00000100:00100000:1.0:1788309710.902969:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00010000:00010000:2.0:1788309710.903062:0:22728:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a400/0x98c38120c44afb95 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309710.903355:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037607040 00000100:00100000:0.0:1788309710.903362:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037607040 00010000:00010000:0.0:1788309710.903387:0:22713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44afb25 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b5e expref: 24 pid: 22729 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309710.903489:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 18 00000100:00100000:0.0:1788309710.903497:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c8197450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+24:2391:x1875178037607040:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309710.903518:0:22713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309710.903525:0:22713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44afb25 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b5e expref: 24 pid: 22729 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.903536:0:22713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44afb25 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b5e expref: 24 pid: 22729 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.903556:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d90600/0x98c38120c44afb25 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b5e expref: 24 pid: 22729 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.903570:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c2fc2343100) 00010000:00010000:0.0:1788309710.903574:0:22713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a400/0x98c38120c44afb95 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.903583:0:22713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a400/0x98c38120c44afb95 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.903591:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a400/0x98c38120c44afb95 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309710.903617:0:22713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309710.903665:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c8197450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+23:2391:x1875178037607040:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 168us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309710.904360:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 18 00010000:00010000:2.0:1788309710.904490:0:22728:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a400/0x98c38120c44afb95 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.904500:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a400/0x98c38120c44afb95 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309710.904519:0:22728:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788309710.904660:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b000/0x98c38120c44afb8e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b8f expref: 24 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.904797:0:22728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a400/0x98c38120c44afb95 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b8f expref: 23 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.904805:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c2fc2343100) 00010000:00010000:2.0:1788309710.904808:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788309710.904811:0:22728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30fba6a400, rc 0) 00000100:00100000:2.0:1788309710.909760:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+23:18760:x1875178037606784:12345-192.168.206.32@tcp:101:dd.0 Request processed in 15410us (15670us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1788309710.909772:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 43 00000100:00100000:1.0:1788309710.918572:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309710.918684:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037607168 00000100:00100000:2.0:1788309710.918695:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037607168 00000100:00100000:2.0:1788309710.918762:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 44 00000100:00100000:2.0:1788309710.918772:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+23:18760:x1875178037607168:12345-192.168.206.32@tcp:101:dd.0 00010000:00010000:2.0:1788309710.918795:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309710.918812:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b000/0x98c38120c44afba3 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193b96 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.918887:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afbaa lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.918900:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afbaa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.918910:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afbaa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.919005:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b000/0x98c38120c44afba3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b96 expref: 25 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.919021:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afbaa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b96 expref: 24 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.919029:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c2fc2343100) 00010000:00010000:2.0:1788309710.919032:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788309710.919035:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30fba6ac00, rc 0) 00000100:00100000:2.0:1788309710.919092:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+24:18760:x1875178037607168:12345-192.168.206.32@tcp:101:dd.0 Request processed in 321us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309710.919100:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 44 00000100:00100000:1.0:1788309710.923082:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309710.923127:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037607424 00000100:00100000:3.0:1788309710.923137:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037607424 00000100:00100000:3.0:1788309710.923190:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 45 00000100:00100000:3.0:1788309710.923200:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc3435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+24:18760:x1875178037607424:12345-192.168.206.32@tcp:36:dd.0 00010000:00010000:3.0:1788309710.923432:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afbb1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.923447:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afbb1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.923458:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afbb1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788309710.923498:0:22729:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1788309710.923521:0:22729:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000797b6a41 reply state 000000001db938bc transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afbb1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.923532:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afbb1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.923539:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c2fc2343100) 00010000:00010000:3.0:1788309710.923542:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788309710.923545:0:22729:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788309710.923645:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc3435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+27:18760:x1875178037607424:12345-192.168.206.32@tcp:36:dd.0 Request processed in 446us (571us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1788309710.923653:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 45 00000020:00080000:3.0:1788309710.923657:0:22729:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788309710.927435:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309710.928298:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037607552 00000100:00100000:2.0:1788309710.928309:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037607552 00000100:00100000:2.0:1788309710.928371:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 46 00000100:00100000:2.0:1788309710.928380:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+27:18760:x1875178037607552:12345-192.168.206.32@tcp:101:dd.0 00010000:00010000:2.0:1788309710.928415:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309710.928434:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b000/0x98c38120c44afbb8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193b9d expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.928492:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b000/0x98c38120c44afbb8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b9d expref: 28 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.928505:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b000/0x98c38120c44afbb8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b9d expref: 28 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.928522:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c2fc2343100) 00010000:00010000:2.0:1788309710.928525:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788309710.928528:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30fba6b000, rc 0) 00000100:00100000:2.0:1788309710.928587:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+28:18760:x1875178037607552:12345-192.168.206.32@tcp:101:dd.0 Request processed in 208us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309710.928593:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 46 00000100:00100000:1.0:1788309710.948760:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309710.948923:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037607808 00000100:00100000:2.0:1788309710.948932:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037607808 00000100:00100000:2.0:1788309710.948995:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 2 00000100:00100000:2.0:1788309710.949004:0:24259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4372300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+28:18760:x1875178037607808:12345-192.168.206.32@tcp:103:dd.0 00010000:00010000:2.0:1788309710.949017:0:24259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309710.949040:0:24259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b000/0x98c38120c44afbb8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b9d expref: 28 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.949057:0:24259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c2fc2343100) 00010000:00010000:2.0:1788309710.949072:0:24259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309710.949127:0:24259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4372300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+27:18760:x1875178037607808:12345-192.168.206.32@tcp:103:dd.0 Request processed in 123us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309710.949134:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 2 00000040:00080000:0.0:1788309710.954512:0:23480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788309710.955074:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788309710.955092:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30ff4e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048189696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788309710.955155:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309710.955321:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048189696 00000100:00100000:1.0:1788309710.955328:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048189696 00000100:00100000:1.0:1788309710.955386:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788309710.955396:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048189696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788309710.955423:0:24237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788309710.955468:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048189696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309710.955474:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788309710.955600:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788309710.956020:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30ff4e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048189696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788309710.957778:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309710.958622:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037607936 00000100:00100000:3.0:1788309710.958631:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037607936 00000100:00100000:3.0:1788309710.958710:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 47 00000100:00100000:3.0:1788309710.958720:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+27:18760:x1875178037607936:12345-192.168.206.32@tcp:58:dd.0 00010000:00010000:3.0:1788309710.958817:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbc00/0x98c38120c44afbbf lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.958834:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbc00/0x98c38120c44afbbf lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309710.958879:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbc00/0x98c38120c44afbbf lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788309710.961082:0:22729:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788309710.961116:0:22729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1788309710.961264:0:22729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1788309710.961547:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+27:18760:x1875178037607936:12345-192.168.206.32@tcp:58:dd.0 Request processed in 2821us (3768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309710.961558:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 47 00000100:00100000:3.0:1788309710.970355:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309710.970457:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037608064 00000100:00100000:2.0:1788309710.970467:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037608064 00000100:00100000:2.0:1788309710.970526:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 48 00000100:00100000:2.0:1788309710.970538:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+27:18760:x1875178037608064:12345-192.168.206.32@tcp:101:dd.0 00010000:00010000:2.0:1788309710.970556:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309710.970576:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b000/0x98c38120c44afbc6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193ba4 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.970630:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbc00/0x98c38120c44afbbf lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.970642:0:22727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b000/0x98c38120c44afbc6 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193ba4 expref: 28 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.970662:0:22727:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbc00/0x98c38120c44afbbf lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.970694:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b000/0x98c38120c44afbc6 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193ba4 expref: 28 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.970707:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c2fc2343100) 00010000:00010000:2.0:1788309710.970711:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788309710.970714:0:22727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b000/0x98c38120c44afbc6 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193ba4 expref: 28 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309710.970741:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30fba6b000, rc 0) 00000100:00100000:2.0:1788309710.970814:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+28:18760:x1875178037608064:12345-192.168.206.32@tcp:101:dd.0 Request processed in 277us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309710.970821:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 48 00000040:00080000:2.0:1788309711.210119:0:22764:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788309711.210138:0:22764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788309711.210164:0:22764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788309711.210172:0:22764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788309711.210293:0:22764:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc2a35500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22764:1875178048189824:192.168.206.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788309711.210424:0:22764:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c60d8540 going to sleep for 11 seconds 00000100:00100000:1.0:1788309711.226464:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309711.226669:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037608192 00000100:00100000:3.0:1788309711.226688:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037608192 00000100:00100000:3.0:1788309711.226769:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 49 00000100:00100000:3.0:1788309711.226781:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+29:18762:x1875178037608192:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788309711.226818:0:22728:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788309711.226974:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+29:18762:x1875178037608192:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 Request processed in 195us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309711.226982:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 49 00000100:00080000:0.0:1788309711.227299:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788309711.229192:0:22764:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc2a35500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22764:1875178048189824:192.168.206.32@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788309711.233221:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309711.233301:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037608320 00000100:00100000:2.0:1788309711.233311:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037608320 00000100:00100000:2.0:1788309711.233372:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 50 00000100:00100000:2.0:1788309711.233383:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+28:18762:x1875178037608320:12345-192.168.206.32@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788309711.233446:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b400/0x98c38120c44afbcd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.233462:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b400/0x98c38120c44afbcd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.233472:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b400/0x98c38120c44afbcd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.233530:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b600/0x98c38120c44afbd4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.233559:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b600/0x98c38120c44afbd4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.233567:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b600/0x98c38120c44afbd4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.233591:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44afbdb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.233601:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44afbdb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.233608:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44afbdb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309711.233665:0:22727:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788309711.233669:0:22727:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788309711.233690:0:22727:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44afbdb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.233701:0:22727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b400/0x98c38120c44afbcd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.233708:0:22727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b400/0x98c38120c44afbcd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.233715:0:22727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b400/0x98c38120c44afbcd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.233721:0:22727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30fba6b400 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:2.0:1788309711.233725:0:22727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b400/0x98c38120c44afbcd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.233738:0:22727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b400/0x98c38120c44afbcd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.233750:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c2fc194bb00) 00010000:00010000:2.0:1788309711.233753:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309711.233759:0:22727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b400/0x98c38120c44afbcd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.233765:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b400/0x98c38120c44afbcd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.233776:0:22727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b600/0x98c38120c44afbd4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.233783:0:22727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b600/0x98c38120c44afbd4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.233788:0:22727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b600/0x98c38120c44afbd4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.233804:0:22727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30fba6b600 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:2.0:1788309711.233807:0:22727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b600/0x98c38120c44afbd4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.233813:0:22727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b600/0x98c38120c44afbd4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.233819:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff8c2fc194b200) 00010000:00010000:2.0:1788309711.233821:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309711.233824:0:22727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b600/0x98c38120c44afbd4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.233996:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b600/0x98c38120c44afbd4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.234012:0:22727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44afbdb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.234017:0:22727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44afbdb lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.234023:0:22727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44afbdb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.234028:0:22727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30fba6a000 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:2.0:1788309711.234031:0:22727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44afbdb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.234037:0:22727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44afbdb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.234045:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c2fc2343100) 00010000:00010000:2.0:1788309711.234047:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788309711.234050:0:22727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44afbdb lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.234055:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44afbdb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309711.234128:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+28:18762:x1875178037608320:12345-192.168.206.32@tcp:34:lhsmtool_posix.0 Request processed in 746us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309711.234136:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 50 00000100:00100000:3.0:1788309711.241571:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309711.241657:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037608576 00000100:00100000:2.0:1788309711.241667:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037608576 00000100:00100000:2.0:1788309711.241741:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 51 00000100:00100000:2.0:1788309711.241752:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+28:18762:x1875178037608576:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788309711.241772:0:22728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309711.241800:0:22728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44afbe2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193bab expref: -99 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.242098:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b600/0x98c38120c44afbe9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.242114:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b600/0x98c38120c44afbe9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.242125:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b600/0x98c38120c44afbe9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788309711.242137:0:22728:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788309711.242212:0:22728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b600/0x98c38120c44afbe9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.242220:0:22728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b600/0x98c38120c44afbe9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.242226:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b600/0x98c38120c44afbe9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.242231:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30fba6b600 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:2.0:1788309711.242235:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b600/0x98c38120c44afbe9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.242241:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b600/0x98c38120c44afbe9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.242266:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c2fc2343100) 00010000:00010000:2.0:1788309711.242269:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788309711.242275:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b600/0x98c38120c44afbe9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.242280:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b600/0x98c38120c44afbe9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.242320:0:22728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44afbe2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bab expref: 30 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.242329:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c2fc194bb00) 00010000:00010000:2.0:1788309711.242332:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788309711.242335:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44afbe2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bab expref: 30 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.242343:0:22728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30fba6a000, rc 0) 00000100:00100000:2.0:1788309711.242408:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+29:18762:x1875178037608576:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 656us (844us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1788309711.242415:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 51 00000100:00100000:1.0:1788309711.249647:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309711.250178:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037608704 00000100:00100000:2.0:1788309711.250187:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037608704 00000100:00100000:2.0:1788309711.250282:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 52 00000100:00100000:2.0:1788309711.250293:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+29:18762:x1875178037608704:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788309711.250330:0:22727:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788309711.250470:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+29:18762:x1875178037608704:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 Request processed in 178us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309711.250487:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 52 00000100:00100000:3.0:1788309711.256463:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309711.256636:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037608960 00000100:00100000:2.0:1788309711.256646:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037608960 00000100:00100000:2.0:1788309711.256713:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 53 00000100:00100000:2.0:1788309711.256724:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30ff4e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+29:18762:x1875178037608960:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788309711.256744:0:22728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309711.256762:0:22728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b400/0x98c38120c44afbf7 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193bb2 expref: -99 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788309711.257154:0:22728:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:2.0:1788309711.257160:0:22728:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:2.0:1788309711.257178:0:22728:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:2.0:1788309711.257321:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a600/0x98c38120c44afbfe lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.257334:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a600/0x98c38120c44afbfe lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.257344:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a600/0x98c38120c44afbfe lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.257394:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b400/0x98c38120c44afbf7 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bb2 expref: 32 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.257410:0:22728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a600/0x98c38120c44afbfe lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bb2 expref: 31 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.257417:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8c2fc194b200) 00010000:00010000:2.0:1788309711.257431:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788309711.257435:0:22728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30fba6a600, rc 0) 00000100:00100000:2.0:1788309711.257493:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30ff4e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+31:18762:x1875178037608960:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 771us (1039us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1788309711.257500:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 53 00000100:00100000:3.0:1788309711.265536:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309711.265650:0:25009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037609216 00000100:00100000:0.0:1788309711.265661:0:25009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037609216 00000100:00100000:0.0:1788309711.265723:0:25009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 54 00000100:00100000:0.0:1788309711.265741:0:25009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+31:18762:x1875178037609216:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788309711.265814:0:25009:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309711.265880:0:25009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a600/0x98c38120c44afbfe lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bb2 expref: 31 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.265898:0:25009:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8c2fc194b200) 00010000:00010000:0.0:1788309711.265909:0:25009:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788309711.265931:0:25009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1c00/0x98c38120c44afc0c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.265944:0:25009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1c00/0x98c38120c44afc0c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.265954:0:25009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1c00/0x98c38120c44afc0c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.265968:0:25009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afc13 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xae564e4d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.265974:0:25009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afc13 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xae564e4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.265980:0:25009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afc13 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xae564e4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.266022:0:25009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1c00/0x98c38120c44afc0c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.266028:0:25009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1c00/0x98c38120c44afc0c lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.266043:0:25009:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1c00/0x98c38120c44afc0c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.266049:0:25009:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc35f1c00 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:0.0:1788309711.266053:0:25009:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1c00/0x98c38120c44afc0c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.266060:0:25009:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1c00/0x98c38120c44afc0c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.266069:0:25009:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8c2fc322c300) 00010000:00010000:0.0:1788309711.266073:0:25009:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309711.266077:0:25009:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1c00/0x98c38120c44afc0c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.266083:0:25009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1c00/0x98c38120c44afc0c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.266093:0:25009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afc13 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xae564e4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.266099:0:25009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afc13 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xae564e4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.266105:0:25009:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afc13 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xae564e4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.266110:0:25009:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c2fc35f0800 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:0.0:1788309711.266112:0:25009:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afc13 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xae564e4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.266129:0:25009:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afc13 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xae564e4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.266138:0:25009:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xae564e4d (ffff8c30c54dd200) 00010000:00010000:0.0:1788309711.266140:0:25009:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309711.266143:0:25009:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afc13 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xae564e4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.266148:0:25009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afc13 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xae564e4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309711.266224:0:25009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+30:18762:x1875178037609216:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 Request processed in 485us (696us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788309711.266232:0:25009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 54 00000100:00100000:3.0:1788309711.268984:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309711.269094:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037609344 00000100:00100000:0.0:1788309711.269105:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037609344 00000100:00100000:0.0:1788309711.269155:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 55 00000100:00100000:0.0:1788309711.269171:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+30:18762:x1875178037609344:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788309711.269191:0:22728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309711.269215:0:22728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0200/0x98c38120c44afc1a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193bb9 expref: -99 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.269251:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1800/0x98c38120c44afc21 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.269264:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1800/0x98c38120c44afc21 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.269275:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1800/0x98c38120c44afc21 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.269400:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0200/0x98c38120c44afc1a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bb9 expref: 32 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.269420:0:22728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f1800/0x98c38120c44afc21 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bb9 expref: 31 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.269429:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8c30c54dda00) 00010000:00010000:0.0:1788309711.269432:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788309711.269435:0:22728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c2fc35f1800, rc 0) 00000100:00100000:0.0:1788309711.269497:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+31:18762:x1875178037609344:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 333us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309711.269504:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 55 00000100:00100000:3.0:1788309711.273236:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309711.273473:0:25009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037609600 00000100:00100000:0.0:1788309711.273483:0:25009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037609600 00000100:00100000:0.0:1788309711.273536:0:25009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 56 00000100:00100000:0.0:1788309711.273546:0:25009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbbf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+31:18762:x1875178037609600:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788309711.273627:0:25009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5a600/0x98c38120c44afc28 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.273655:0:25009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5a600/0x98c38120c44afc28 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.273667:0:25009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5a600/0x98c38120c44afc28 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788309711.274058:0:25009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:0.0:1788309711.274070:0:25009:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 621343230168ns, next at 622343227648ns, rc = 0 00000004:00010000:0.0:1788309711.274132:0:25009:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000439ebbd5 reply state 000000002b2e9283 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5a600/0x98c38120c44afc28 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.274147:0:25009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5a600/0x98c38120c44afc28 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.274155:0:25009:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8c30c54dda00) 00010000:00010000:0.0:1788309711.274158:0:25009:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788309711.274162:0:25009:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788309711.274307:0:25009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbbf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+33:18762:x1875178037609600:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 Request processed in 761us (1078us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1788309711.274316:0:25009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 56 00000100:00100000:3.0:1788309711.277567:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309711.277649:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037609728 00000100:00100000:0.0:1788309711.277658:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037609728 00000100:00100000:0.0:1788309711.277725:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 57 00000100:00100000:0.0:1788309711.277736:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+33:18762:x1875178037609728:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788309711.277757:0:22728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309711.277777:0:22728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5b400/0x98c38120c44afc2f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193bc0 expref: -99 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.277884:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5b400/0x98c38120c44afc2f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bc0 expref: 34 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.277897:0:22728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5b400/0x98c38120c44afc2f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bc0 expref: 34 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.277916:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8c30c54dda00) 00010000:00010000:0.0:1788309711.277919:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788309711.277938:0:22728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30edf5b400, rc 0) 00000100:00100000:0.0:1788309711.277993:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+34:18762:x1875178037609728:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 259us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309711.278000:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 57 00000100:00100000:1.0:1788309711.282697:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309711.282798:0:25402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037609856 00000100:00100000:0.0:1788309711.282808:0:25402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037609856 00000100:00100000:0.0:1788309711.282908:0:25402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 25 00000100:00100000:0.0:1788309711.282919:0:25402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+5:2390:x1875178037609856:12345-192.168.206.32@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788309711.283142:0:25402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:2390:x1875178037609856:12345-192.168.206.32@tcp:2:lhsmtool_posix.0 Request processed in 224us (453us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1788309711.283151:0:25402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 25 00000100:00080000:2.0:1788309711.283577:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788309711.285812:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309711.285950:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037610112 00000100:00100000:2.0:1788309711.285960:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037610112 00000100:00100000:2.0:1788309711.286008:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 9 00000100:00100000:2.0:1788309711.286019:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+34:18762:x1875178037610112:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788309711.286232:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+35:18762:x1875178037610112:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 Request processed in 213us (427us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1788309711.286240:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 9 00000100:00100000:3.0:1788309711.289009:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309711.289103:0:25009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037610368 00000100:00100000:0.0:1788309711.289111:0:25009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037610368 00000100:00100000:0.0:1788309711.289165:0:25009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 58 00000100:00100000:0.0:1788309711.289175:0:25009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+35:18762:x1875178037610368:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788309711.289282:0:25009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+35:18762:x1875178037610368:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 Request processed in 109us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309711.289290:0:25009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 58 00000100:00100000:1.0:1788309711.297995:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309711.298244:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037610496 00000100:00100000:0.0:1788309711.298254:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037610496 00000100:00100000:0.0:1788309711.298310:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 59 00000100:00100000:0.0:1788309711.298320:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+35:18762:x1875178037610496:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788309711.298338:0:22728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309711.298361:0:22728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0200/0x98c38120c44afc36 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193bc7 expref: -99 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.298441:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afc3d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.298454:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afc3d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.298466:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afc3d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788309711.298510:0:22728:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788309711.298530:0:22728:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afc3d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.298555:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0200/0x98c38120c44afc36 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bc7 expref: 37 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.298573:0:22728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afc3d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bc7 expref: 36 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.298580:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8c30c54dda00) 00010000:00010000:0.0:1788309711.298582:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788309711.298585:0:22728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c2fc35f0800, rc 0) 00000100:00100000:0.0:1788309711.298653:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+36:18762:x1875178037610496:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 334us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309711.298659:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 59 00000100:00100000:1.0:1788309711.314423:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309711.314514:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037610624 00000100:00100000:2.0:1788309711.314523:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037610624 00000100:00100000:2.0:1788309711.314580:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 26 00000100:00100000:2.0:1788309711.314590:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+6:2390:x1875178037610624:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788309711.314606:0:24235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309711.314626:0:24235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ed6abab/0x98c38120c44afc44 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193bce expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788309711.314649:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9770ce, blocks: 0x0 00010000:00010000:2.0:1788309711.314667:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1788309711.314683:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309711.314693:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ed6abab/0x98c38120c44afc44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bce expref: 7 pid: 24235 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.314733:0:24235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ed6abab/0x98c38120c44afc44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bce expref: 7 pid: 24235 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.314748:0:24235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30fba6b400, rc 0) 00000100:00100000:2.0:1788309711.314814:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+7:2390:x1875178037610624:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 226us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309711.314821:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 26 00000100:00100000:3.0:1788309711.319114:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309711.319216:0:25009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037610880 00000100:00100000:0.0:1788309711.319227:0:25009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037610880 00000100:00100000:0.0:1788309711.319286:0:25009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 60 00000100:00100000:0.0:1788309711.319310:0:25009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc414ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+36:18762:x1875178037610880:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788309711.319412:0:25009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc414ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+36:18762:x1875178037610880:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 Request processed in 103us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309711.319419:0:25009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 60 00000100:00100000:1.0:1788309711.341652:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309711.341795:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037611008 00000100:00100000:0.0:1788309711.341805:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037611008 00000100:00100000:0.0:1788309711.341901:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 61 00000100:00100000:0.0:1788309711.341913:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+36:18762:x1875178037611008:12345-192.168.206.32@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788309711.343964:0:22707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:2.0:1788309711.343977:0:22707:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788309711.344023:0:22707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:3.0:1788309711.344121:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5ae00/0x98c38120c44afac3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.344134:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5ae00/0x98c38120c44afac3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.344142:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5ae00/0x98c38120c44afac3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.344148:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30edf5ae00 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:3.0:1788309711.344152:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5ae00/0x98c38120c44afac3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.344160:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5ae00/0x98c38120c44afac3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.344175:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8c2fc322c300) 00010000:00010000:3.0:1788309711.344179:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788309711.344183:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5ae00/0x98c38120c44afac3 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.344189:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5ae00/0x98c38120c44afac3 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309711.344364:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788309711.344382:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc4371f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875178048189952:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788309711.344455:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309711.344536:0:25402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048189952 00000100:00100000:1.0:1788309711.344543:0:25402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048189952 00000100:00100000:1.0:1788309711.344596:0:25402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788309711.344605:0:25402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c30c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875178048189952:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788309711.344735:0:25402:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788309711.344739:0:25402:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788309711.344741:0:25402:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788309711.344743:0:25402:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788309710 -> 1788309710 00002000:00010000:1.0:1788309711.344745:0:25402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788309711.344781:0:25402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c30c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3618:x1875178048189952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 178us (326us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788309711.344788:0:25402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788309711.345192:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da800/0x98c38120c44afa6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345202:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da800/0x98c38120c44afa6f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345209:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da800/0x98c38120c44afa6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345215:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d12da800 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:0.0:1788309711.345219:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da800/0x98c38120c44afa6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345225:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da800/0x98c38120c44afa6f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345235:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8c2fc322c500) 00010000:00010000:0.0:1788309711.345238:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309711.345242:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da800/0x98c38120c44afa6f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345332:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da800/0x98c38120c44afa6f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345352:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da400/0x98c38120c44afa76 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345357:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da400/0x98c38120c44afa76 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345363:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da400/0x98c38120c44afa76 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345367:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d12da400 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:0.0:1788309711.345370:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da400/0x98c38120c44afa76 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345375:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da400/0x98c38120c44afa76 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345383:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8c2fc322c300) 00010000:00010000:0.0:1788309711.345385:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309711.345388:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da400/0x98c38120c44afa76 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345394:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da400/0x98c38120c44afa76 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345406:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afb1e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345411:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afb1e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345422:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afb1e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345427:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d3d91800 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:0.0:1788309711.345430:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afb1e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345436:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afb1e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345444:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8c2fc2343500) 00010000:00010000:0.0:1788309711.345446:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309711.345449:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afb1e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345454:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d3d91800/0x98c38120c44afb1e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345468:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afbb1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345474:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afbb1 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345480:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afbb1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345485:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d12da000 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:0.0:1788309711.345488:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afbb1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345504:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afbb1 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345514:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c2fc2343100) 00010000:00010000:0.0:1788309711.345516:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788309711.345518:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afbb1 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345523:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12da000/0x98c38120c44afbb1 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345536:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5a600/0x98c38120c44afc28 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345542:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5a600/0x98c38120c44afc28 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345547:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5a600/0x98c38120c44afc28 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345552:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30edf5a600 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:0.0:1788309711.345554:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5a600/0x98c38120c44afc28 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345560:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5a600/0x98c38120c44afc28 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345566:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8c30c54dda00) 00010000:00010000:0.0:1788309711.345568:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788309711.345571:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5a600/0x98c38120c44afc28 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.345585:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5a600/0x98c38120c44afc28 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309711.345706:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+15:18762:x1875178037611008:12345-192.168.206.32@tcp:44:lhsmtool_posix.0 Request processed in 3793us (4061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309711.345714:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 61 00000100:00080000:3.0:1788309711.345817:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788309711.345876:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c2fc4371f80/2, rc 0, transno 12884901892 00000100:00100000:3.0:1788309711.345885:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc4371f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875178048189952:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788309711.350723:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309711.350825:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037611136 00000100:00100000:2.0:1788309711.350869:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037611136 00000100:00100000:2.0:1788309711.350919:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 28 00000100:00100000:2.0:1788309711.350929:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+7:2389:x1875178037611136:12345-192.168.206.32@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788309711.351041:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+7:2389:x1875178037611136:12345-192.168.206.32@tcp:16:lhsmtool_posix.0 Request processed in 113us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309711.351049:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 28 00000100:00100000:1.0:1788309711.354246:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309711.354335:0:25009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037611392 00000100:00100000:0.0:1788309711.354345:0:25009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037611392 00000100:00100000:0.0:1788309711.354401:0:25009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 62 00000100:00100000:0.0:1788309711.354412:0:25009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+15:18762:x1875178037611392:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788309711.354461:0:25009:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309711.354489:0:25009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0800/0x98c38120c44afc3d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bc7 expref: 15 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.354508:0:25009:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8c30c54dda00) 00010000:00010000:0.0:1788309711.354513:0:25009:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788309711.354540:0:25009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0200/0x98c38120c44afc4b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.354553:0:25009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0200/0x98c38120c44afc4b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.354563:0:25009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0200/0x98c38120c44afc4b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788309711.355272:0:25009:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000440e047b reply state 00000000c898d920 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0200/0x98c38120c44afc4b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.355309:0:25009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c2fc35f0200/0x98c38120c44afc4b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.355315:0:25009:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8c30c54dda00) 00010000:00010000:0.0:1788309711.355318:0:25009:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788309711.355321:0:25009:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788309711.355416:0:25009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+16:18762:x1875178037611392:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 Request processed in 1004us (1176us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1788309711.355424:0:25009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 62 00000100:00100000:1.0:1788309711.364719:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1788309711.364810:0:25402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037611520 00000100:00100000:0.0:1788309711.364820:0:25402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037611520 00000100:00100000:0.0:1788309711.364907:0:25402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 29 00000100:00100000:0.0:1788309711.364916:0:25402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+7:18762:x1875178037611520:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788309711.364931:0:25402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788309711.364946:0:25402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2792b78/0x98c38120c44afc52 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193bd5 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.364975:0:25402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ed6abab/0x98c38120c44afc44 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bce expref: 8 pid: 24235 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.364983:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788309711.364986:0:25402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788309711.364992:0:25402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2792b78/0x98c38120c44afc52 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bd5 expref: 8 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.365021:0:25402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ed6abab/0x98c38120c44afc44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bce expref: 8 pid: 24235 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.365046:0:25402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ed6abab/0x98c38120c44afc44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bce expref: 8 pid: 24235 timeout: 721 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309711.365059:0:25402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc4185880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:25402:1875178048190080:192.168.206.32@tcp:104: 00000100:00100000:0.0:1788309711.365135:0:25402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c59486c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788309711.367989:0:25402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc4185880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:25402:1875178048190080:192.168.206.32@tcp:104: 00010000:00010000:0.0:1788309711.368021:0:25402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2792b78/0x98c38120c44afc52 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bd5 expref: 8 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.368040:0:25402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c2fc35f0800, rc 0) 00000100:00100000:0.0:1788309711.368137:0:25402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+8:18762:x1875178037611520:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 3221us (3426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309711.368146:0:25402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 29 00000100:00100000:1.0:1788309711.370785:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309711.374590:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037611648 00000100:00100000:2.0:1788309711.374604:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037611648 00010000:00010000:2.0:1788309711.374648:0:22712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ed6abab/0x98c38120c44afc44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bce expref: 8 pid: 24235 timeout: 721 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309711.374731:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 19 00000100:00100000:2.0:1788309711.374742:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4371180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+8:2391:x1875178037611648:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309711.374774:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309711.375968:0:22712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ed6abab/0x98c38120c44afc44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bce expref: 8 pid: 24235 timeout: 721 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.375986:0:22712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ed6abab/0x98c38120c44afc44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bce expref: 8 pid: 24235 timeout: 721 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.376009:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ed6abab/0x98c38120c44afc44 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bce expref: 8 pid: 24235 timeout: 721 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.376025:0:22712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309711.376029:0:22712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309711.376035:0:22712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2792b78/0x98c38120c44afc52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bd5 expref: 7 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.376046:0:22712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2792b78/0x98c38120c44afc52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bd5 expref: 7 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.376088:0:22712:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e2792b78/0x98c38120c44afc52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bd5 expref: 7 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309711.376103:0:22712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc2a35500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22712:1875178048190208:192.168.206.32@tcp:105: 00000100:00100000:2.0:1788309711.376181:0:22712:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f5364a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788309711.380585:0:22712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc2a35500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22712:1875178048190208:192.168.206.32@tcp:105: 00010000:00010000:2.0:1788309711.380611:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309711.380670:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4371180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+7:2391:x1875178037611648:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 5928us (9893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309711.380692:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 19 00000100:00100000:1.0:1788309711.389521:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309711.389610:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037611776 00000100:00100000:2.0:1788309711.389620:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037611776 00000100:00100000:2.0:1788309711.389685:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 30 00000100:00100000:2.0:1788309711.389694:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+7:2390:x1875178037611776:12345-192.168.206.32@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788309711.389885:0:24235:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788309711.389889:0:24235:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788309710 00002000:00010000:2.0:1788309711.389892:0:24235:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788309709 00002000:00010000:2.0:1788309711.389894:0:24235:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788309710 -> 1788309710 00002000:00010000:2.0:1788309711.389897:0:24235:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788309711.389956:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+8:2390:x1875178037611776:12345-192.168.206.32@tcp:2:lhsmtool_posix.0 Request processed in 262us (443us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1788309711.389964:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 30 00000100:00100000:1.0:1788309711.394938:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309711.395156:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037611904 00000100:00100000:2.0:1788309711.395166:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037611904 00000100:00100000:2.0:1788309711.395223:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 31 00000100:00100000:2.0:1788309711.395234:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+8:2391:x1875178037611904:12345-192.168.206.32@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788309711.395274:0:24236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003ed6abab/0x98c38120c44afc59 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.395294:0:24236:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2792b78/0x98c38120c44afc52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bd5 expref: 8 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.395303:0:24236:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309711.395320:0:24236:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788309711.395325:0:24236:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ed6abab/0x98c38120c44afc59 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.395360:0:24236:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2792b78/0x98c38120c44afc52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bd5 expref: 8 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.395373:0:24236:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2792b78/0x98c38120c44afc52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bd5 expref: 8 pid: 25402 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309711.395388:0:24236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc2a35500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:24236:1875178048190336:192.168.206.32@tcp:104: 00000100:00100000:2.0:1788309711.395468:0:24236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30f5364a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788309711.399774:0:24236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc2a35500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:24236:1875178048190336:192.168.206.32@tcp:104: 00010000:00010000:2.0:1788309711.399816:0:24236:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003ed6abab/0x98c38120c44afc59 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788309711.406609:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309711.406759:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037612032 00000100:00100000:2.0:1788309711.406769:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037612032 00010000:00010000:2.0:1788309711.406950:0:24259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2792b78/0x98c38120c44afc52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bd5 expref: 9 pid: 25402 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788309711.406991:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 20 00000100:00100000:2.0:1788309711.407003:0:24259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+9:2391:x1875178037612032:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788309711.407016:0:24259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788309711.407037:0:24259:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2792b78/0x98c38120c44afc52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bd5 expref: 9 pid: 25402 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.407064:0:24259:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2792b78/0x98c38120c44afc52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bd5 expref: 9 pid: 25402 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.407088:0:24259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2792b78/0x98c38120c44afc52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bd5 expref: 9 pid: 25402 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.407105:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788309711.407110:0:24259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788309711.407115:0:24259:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ed6abab/0x98c38120c44afc59 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.407125:0:24259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ed6abab/0x98c38120c44afc59 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.407275:0:24259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788309711.407328:0:24259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+8:2391:x1875178037612032:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 328us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309711.407336:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 20 00010000:00010000:3.0:1788309711.409335:0:24236:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003ed6abab/0x98c38120c44afc59 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.409354:0:24236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ed6abab/0x98c38120c44afc59 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.409385:0:24236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003ed6abab/0x98c38120c44afc59 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.409395:0:24236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ed6abab/0x98c38120c44afc59 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.409404:0:24236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ed6abab/0x98c38120c44afc59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.409412:0:24236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30fba6b400 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:3.0:1788309711.409416:0:24236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ed6abab/0x98c38120c44afc59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.409425:0:24236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ed6abab/0x98c38120c44afc59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.409469:0:24236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ed6abab/0x98c38120c44afc59 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.409477:0:24236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ed6abab/0x98c38120c44afc59 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309711.409654:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+7:2391:x1875178037611904:12345-192.168.206.32@tcp:1:lhsmtool_posix.0 Request processed in 14408us (14710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309711.409664:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 31 00000100:00100000:1.0:1788309711.414437:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309711.414651:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037612288 00000100:00100000:3.0:1788309711.414661:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037612288 00000100:00100000:3.0:1788309711.414774:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 63 00000100:00100000:3.0:1788309711.414784:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+16:18762:x1875178037612288:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788309711.414894:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db000/0x98c38120c44afc60 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.414913:0:22729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afbaa lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b96 expref: 16 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.414922:0:22729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db000/0x98c38120c44afc60 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.414955:0:22729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afbaa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b96 expref: 16 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.414968:0:22729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afbaa lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b96 expref: 16 pid: 22727 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309711.414995:0:22729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22729:1875178048190464:192.168.206.32@tcp:104: 00000100:00100000:3.0:1788309711.415059:0:22729:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c7d43b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788309711.419464:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309711.419795:0:22729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22729:1875178048190464:192.168.206.32@tcp:104: 00010000:00010000:3.0:1788309711.419822:0:22729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db000/0x98c38120c44afc60 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309711.424513:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037612416 00000100:00100000:0.0:1788309711.424528:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037612416 00010000:00010000:0.0:1788309711.424579:0:22713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afbaa lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b96 expref: 17 pid: 22727 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309711.424627:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 21 00000100:00100000:0.0:1788309711.424636:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3101f37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+17:2391:x1875178037612416:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309711.424648:0:22713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309711.424655:0:22713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afbaa lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b96 expref: 17 pid: 22727 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.424700:0:22713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afbaa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b96 expref: 17 pid: 22727 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.424722:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afbaa lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193b96 expref: 17 pid: 22727 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.424738:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c2fc2343100) 00010000:00010000:0.0:1788309711.424743:0:22713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b000/0x98c38120c44afbc6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193ba4 expref: 16 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.424752:0:22713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db000/0x98c38120c44afc60 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.424760:0:22713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db000/0x98c38120c44afc60 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.424766:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db000/0x98c38120c44afc60 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.425010:0:22713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788309711.425074:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3101f37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+16:2391:x1875178037612416:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 438us (5618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309711.425083:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 21 00010000:00010000:3.0:1788309711.425240:0:22729:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db000/0x98c38120c44afc60 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.425248:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db000/0x98c38120c44afc60 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.425433:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dac00/0x98c38120c44afc67 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.425446:0:22729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5b400/0x98c38120c44afc2f lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bc0 expref: 16 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.425454:0:22729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dac00/0x98c38120c44afc67 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.425485:0:22729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5b400/0x98c38120c44afc2f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bc0 expref: 16 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.425498:0:22729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5b400/0x98c38120c44afc2f lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bc0 expref: 16 pid: 22728 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309711.425511:0:22729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22729:1875178048190592:192.168.206.32@tcp:104: 00000100:00100000:3.0:1788309711.425566:0:22729:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c7d436c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788309711.434326:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309711.434433:0:22729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22729:1875178048190592:192.168.206.32@tcp:104: 00010000:00010000:3.0:1788309711.434459:0:22729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dac00/0x98c38120c44afc67 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309711.438500:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037612544 00000100:00100000:0.0:1788309711.438515:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037612544 00010000:00010000:0.0:1788309711.438564:0:22714:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5b400/0x98c38120c44afc2f lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bc0 expref: 17 pid: 22728 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309711.438696:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 22 00000100:00100000:0.0:1788309711.438708:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3101f35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+17:2390:x1875178037612544:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788309711.438722:0:22714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788309711.438729:0:22714:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5b400/0x98c38120c44afc2f lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bc0 expref: 17 pid: 22728 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.438742:0:22714:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5b400/0x98c38120c44afc2f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bc0 expref: 17 pid: 22728 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.438761:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30edf5b400/0x98c38120c44afc2f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bc0 expref: 17 pid: 22728 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.438776:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8c30c54dda00) 00010000:00010000:0.0:1788309711.438781:0:22714:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dac00/0x98c38120c44afc67 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.438790:0:22714:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dac00/0x98c38120c44afc67 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.438797:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dac00/0x98c38120c44afc67 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.438826:0:22714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788309711.438929:0:22729:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dac00/0x98c38120c44afc67 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.438938:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dac00/0x98c38120c44afc67 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309711.438938:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3101f35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+16:2390:x1875178037612544:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 233us (4620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309711.438946:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 22 00000001:00080000:3.0:1788309711.439040:0:22729:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:3.0:1788309711.439143:0:22729:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:3.0:1788309711.439177:0:22729:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:3.0:1788309711.439252:0:22729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22729:1875178048190720:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788309711.439310:0:22729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309711.439346:0:22729:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c690fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788309711.439545:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048190720 00000100:00100000:1.0:1788309711.439550:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048190720 00000100:00100000:1.0:1788309711.439591:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788309711.439599:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c30cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22729:x1875178048190720:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788309711.439692:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c30cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22729:x1875178048190720:12345-0@lo:1000:mdt00_002.0 Request processed in 94us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309711.439705:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788309711.440008:0:22729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22729:1875178048190720:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788309711.440816:0:22729:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:3.0:1788309711.441237:0:22729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22729:1875178048190848:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788309711.441290:0:22729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309711.441331:0:22729:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c7d43780 going to sleep for 11 seconds 00000100:00100000:1.0:1788309711.441589:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048190848 00000100:00100000:1.0:1788309711.441595:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048190848 00000100:00100000:1.0:1788309711.441652:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788309711.441662:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c30c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22729:x1875178048190848:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788309711.441803:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c30c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22729:x1875178048190848:12345-0@lo:1000:mdt00_002.0 Request processed in 143us (513us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1788309711.441811:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788309711.442124:0:22729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22729:1875178048190848:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788309711.442163:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dac00/0x98c38120c44afc67 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.442173:0:22729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dac00/0x98c38120c44afc67 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.442197:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dac00/0x98c38120c44afc67 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.442203:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d12dac00 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:3.0:1788309711.442207:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dac00/0x98c38120c44afc67 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.442215:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dac00/0x98c38120c44afc67 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.442230:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8c30c54dda00) 00010000:00010000:3.0:1788309711.442233:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788309711.442238:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dac00/0x98c38120c44afc67 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.442243:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dac00/0x98c38120c44afc67 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.442272:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbc00/0x98c38120c44afbbf lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.442279:0:22729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbc00/0x98c38120c44afbbf lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.442284:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbc00/0x98c38120c44afbbf lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.442289:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d12dbc00 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:3.0:1788309711.442292:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbc00/0x98c38120c44afbbf lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.442308:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbc00/0x98c38120c44afbbf lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.442317:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c2fc2343100) 00010000:00010000:3.0:1788309711.442320:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788309711.442326:0:22729:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b000/0x98c38120c44afbc6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193ba4 expref: 19 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.442337:0:22729:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b000/0x98c38120c44afbc6 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193ba4 expref: 19 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.442346:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b000/0x98c38120c44afbc6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193ba4 expref: 19 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.442399:0:22729:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b000/0x98c38120c44afbc6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193ba4 expref: 19 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309711.442410:0:22729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30c30cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22729:1875178048190976:192.168.206.32@tcp:105: 00000100:00100000:3.0:1788309711.442465:0:22729:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c30c4d73a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788309711.447689:0:22729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30c30cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22729:1875178048190976:192.168.206.32@tcp:105: 00010000:00010000:3.0:1788309711.447717:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbc00/0x98c38120c44afbbf lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.447727:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12dbc00/0x98c38120c44afbbf lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.447755:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db800/0x98c38120c44afc6e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.447779:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db800/0x98c38120c44afc6e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.447800:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db800/0x98c38120c44afc6e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.447811:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db800/0x98c38120c44afc6e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.447816:0:22729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db800/0x98c38120c44afc6e lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.447822:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db800/0x98c38120c44afc6e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.447826:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d12db800 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:3.0:1788309711.447836:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db800/0x98c38120c44afc6e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.447877:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db800/0x98c38120c44afc6e lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.447888:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c2fc2343100) 00010000:00010000:3.0:1788309711.447890:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788309711.447894:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db800/0x98c38120c44afc6e lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.447900:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db800/0x98c38120c44afc6e lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.447910:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db000/0x98c38120c44afc60 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.447922:0:22729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db000/0x98c38120c44afc60 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.447928:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db000/0x98c38120c44afc60 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.447932:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d12db000 already unused, calling callback (ffffffffc1b174f0) 00010000:00010000:3.0:1788309711.447936:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db000/0x98c38120c44afc60 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.447941:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db000/0x98c38120c44afc60 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.447950:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c2fc2343100) 00010000:00010000:3.0:1788309711.447952:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788309711.447956:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db000/0x98c38120c44afc60 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.447961:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30d12db000/0x98c38120c44afc60 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309711.448109:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+19:18762:x1875178037612288:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 Request processed in 33325us (33679us total) trans 12884901916 rc 0/0 00000100:00100000:3.0:1788309711.448118:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 63 00000020:00080000:3.0:1788309711.448124:0:22729:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788309711.448224:0:22764:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788309711.448230:0:22764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788309711.448246:0:22764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788309711.448251:0:22764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788309711.451697:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309711.454365:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037612672 00000100:00100000:2.0:1788309711.454381:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037612672 00000100:00100000:2.0:1788309711.454442:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00100000:2.0:1788309711.454453:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc2369850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+19:18760:x1875178037612672:12345-192.168.206.32@tcp:49:dd.0 00000100:00100000:2.0:1788309711.454595:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc2369850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+19:18760:x1875178037612672:12345-192.168.206.32@tcp:49:dd.0 Request processed in 144us (2908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309711.454603:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00100000:3.0:1788309711.455158:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309711.455454:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037612928 00000100:00100000:2.0:1788309711.455461:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037612928 00000100:00100000:2.0:1788309711.455501:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 11 00000100:00100000:2.0:1788309711.455510:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c30cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+19:18762:x1875178037612928:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788309711.455761:0:22730:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788309711.455792:0:22730:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:2.0:1788309711.455823:0:22730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44afc75 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.455869:0:22730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44afc75 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.455881:0:22730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44afc75 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.455890:0:22730:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44afc75 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.455897:0:22730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44afc75 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.455903:0:22730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44afc75 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.456015:0:22730:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788309711.456087:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c30cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+21:18762:x1875178037612928:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 Request processed in 576us (931us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1788309711.456108:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 11 00000020:00080000:2.0:1788309711.456113:0:22730:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788309711.461206:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309711.463350:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037613056 00000100:00100000:2.0:1788309711.463363:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037613056 00000100:00100000:2.0:1788309711.463432:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 64 00000100:00100000:2.0:1788309711.463443:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30c30cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+21:18760:x1875178037613056:12345-192.168.206.32@tcp:101:dd.0 00010000:00010000:2.0:1788309711.463468:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788309711.463486:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b600/0x98c38120c44afc7c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2fd540dffc193bdc expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.463522:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afc83 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.463535:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afc83 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.463546:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afc83 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.463682:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6b600/0x98c38120c44afc7c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bdc expref: 23 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.463701:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6ac00/0x98c38120c44afc83 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x2fd540dffc193bdc expref: 22 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.463710:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c2fc2343100) 00010000:00010000:2.0:1788309711.463713:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788309711.463716:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c30fba6ac00, rc 0) 00000100:00100000:2.0:1788309711.463986:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30c30cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+22:18760:x1875178037613056:12345-192.168.206.32@tcp:101:dd.0 Request processed in 543us (2786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309711.463993:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 64 00010000:00010000:1.0:1788309711.464757:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788309711.464766:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44afc75 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309711.464774:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30fba6a000 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:1.0:1788309711.464778:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44afc75 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309711.464785:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44afc75 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309711.464807:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8c30c54dda00) 00010000:00010000:1.0:1788309711.464810:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788309711.464813:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44afc75 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309711.464819:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c30fba6a000/0x98c38120c44afc75 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788309711.464852:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309711.464865:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788309711.464867:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788309711.499660:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1788309711.500106:0:24239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037613184 00000100:00100000:2.0:1788309711.500117:0:24239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037613184 00000100:00100000:2.0:1788309711.500179:0:24239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 0 00000100:00100000:2.0:1788309711.500191:0:24239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+7:2391:x1875178037613184:12345-192.168.206.32@tcp:4:dd.0 00002000:00010000:2.0:1788309711.500234:0:24239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a9770ce, atime: 0x6a9770cd, ctime: 0x6a9770ce, blocks: 0x0 00010000:00010000:2.0:1788309711.500243:0:24239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a213eab/0x98c38120c44afc8a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.500257:0:24239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=621s v=(0 0) 00010000:00010000:2.0:1788309711.500261:0:24239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788309711.500267:0:24239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a213eab/0x98c38120c44afc8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788309711.500281:0:24239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a213eab/0x98c38120c44afc8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309711.503127:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1788309711.503281:0:24241:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788309711.503291:0:24241:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788309711.503602:0:24241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037613312 00000100:00100000:1.0:1788309711.503612:0:24241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037613312 00000100:00100000:3.0:1788309711.504222:0:25771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 1 00000100:00100000:3.0:1788309711.504237:0:25771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+8:2390:x1875178037613312:12345-192.168.206.32@tcp:4:dd.0 00010000:00010000:3.0:1788309711.504268:0:25771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1d5334d/0x98c38120c44afc91 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.504285:0:25771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309711.504289:0:25771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788309711.504295:0:25771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1d5334d/0x98c38120c44afc91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.504309:0:25771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1d5334d/0x98c38120c44afc91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788309711.610044:0:25049:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:0.0:1788309711.610070:0:25049:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:0.0:1788309711.610199:0:24239:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1788309711.610204:0:24239:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:0.0:1788309711.610221:0:24239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a213eab/0x98c38120c44afc8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.610234:0:24239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a213eab/0x98c38120c44afc8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.610243:0:24239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a213eab/0x98c38120c44afc8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.610250:0:24239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30fba6b600 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:0.0:1788309711.610255:0:24239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a213eab/0x98c38120c44afc8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.610264:0:24239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a213eab/0x98c38120c44afc8a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.610288:0:24239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a213eab/0x98c38120c44afc8a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788309711.610296:0:24239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a213eab/0x98c38120c44afc8a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788309711.611999:0:24239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+7:2391:x1875178037613184:12345-192.168.206.32@tcp:4:dd.0 Request processed in 111798us (112335us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788309711.612021:0:24239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 0 00000001:00080000:0.0:1788309711.629935:0:25049:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00002000:00010000:3.0:1788309711.630661:0:25771:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:3.0:1788309711.630749:0:25771:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:3.0:1788309711.630768:0:25771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1d5334d/0x98c38120c44afc91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.630782:0:25771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1d5334d/0x98c38120c44afc91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.630801:0:25771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1d5334d/0x98c38120c44afc91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.630809:0:25771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c30d12db000 already unused, calling callback (ffffffffc0f1f230) 00010000:00010000:3.0:1788309711.630814:0:25771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1d5334d/0x98c38120c44afc91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.630887:0:25771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1d5334d/0x98c38120c44afc91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.630907:0:25771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1d5334d/0x98c38120c44afc91 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788309711.630914:0:25771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1d5334d/0x98c38120c44afc91 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788309711.631012:0:25771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+5:2390:x1875178037613312:12345-192.168.206.32@tcp:4:dd.0 Request processed in 126772us (127889us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1788309711.631022:0:25771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 1 00010000:00010000:1.0:1788309711.850368:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309711.978146:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c30fba0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875178048191104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788309711.978224:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309711.979031:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048191104 00000100:00100000:1.0:1788309711.979040:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048191104 00000100:00100000:1.0:1788309711.979172:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788309711.979183:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875178048191104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788309711.979204:0:24237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788309711.979261:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875178048191104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309711.979268:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788309711.979314:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c30fba0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875178048191104:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788309711.981164:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788309712.818282:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309712.818344:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309712.818384:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309712.818416:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309712.818443:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309712.818463:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309712.818482:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309712.818504:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309712.818526:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1788309712.818560:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037613696 00000100:00100000:3.0:1788309712.818572:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037613696 00000100:00100000:3.0:1788309712.818662:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037614208 00000100:00100000:3.0:1788309712.818675:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037614208 00000100:00100000:3.0:1788309712.818715:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037613568 00000100:00100000:3.0:1788309712.818719:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037613568 00000100:00100000:3.0:1788309712.818730:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037614080 00000100:00100000:3.0:1788309712.818733:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037614080 00000100:00100000:3.0:1788309712.818751:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 52 00000100:00100000:3.0:1788309712.818761:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+5:2390:x1875178037613696:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1788309712.818894:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+5:2390:x1875178037613696:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 134us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309712.818902:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 52 00000100:00100000:3.0:1788309712.818921:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 53 00000100:00100000:3.0:1788309712.818928:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5df0760e-86a4-46ba-b845-119bf6d92cdd+5:2390:x1875178037614208:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1788309712.818954:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5df0760e-86a4-46ba-b845-119bf6d92cdd+5:2390:x1875178037614208:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 27us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309712.818960:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 53 00000100:00100000:3.0:1788309712.818971:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 54 00000100:00100000:3.0:1788309712.819036:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+22:2390:x1875178037613568:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1788309712.819063:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+22:2390:x1875178037613568:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 86us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309712.819069:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 54 00000100:00100000:3.0:1788309712.819083:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 55 00000100:00100000:3.0:1788309712.819089:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5df0760e-86a4-46ba-b845-119bf6d92cdd+6:2390:x1875178037614080:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1788309712.819117:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5df0760e-86a4-46ba-b845-119bf6d92cdd+6:2390:x1875178037614080:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 28us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309712.819123:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 55 00000100:00100000:3.0:1788309712.819140:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037613952 00000100:00100000:3.0:1788309712.819150:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037613952 00000100:00100000:3.0:1788309712.819170:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037614464 00000100:00100000:3.0:1788309712.819172:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037614464 00000100:00100000:3.0:1788309712.819184:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037613824 00000100:00100000:3.0:1788309712.819186:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037613824 00000100:00100000:3.0:1788309712.819197:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037614336 00000100:00100000:3.0:1788309712.819200:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037614336 00000100:00100000:3.0:1788309712.819212:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 19 00000100:00100000:3.0:1788309712.819217:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fba0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+5:2390:x1875178037613952:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1788309712.819246:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fba0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+5:2390:x1875178037613952:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 29us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309712.819253:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 19 00000100:00100000:3.0:1788309712.819264:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 20 00000100:00100000:3.0:1788309712.819270:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc401a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5df0760e-86a4-46ba-b845-119bf6d92cdd+5:2390:x1875178037614464:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1788309712.819294:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc401a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5df0760e-86a4-46ba-b845-119bf6d92cdd+5:2390:x1875178037614464:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 25us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309712.819300:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 20 00000100:00100000:3.0:1788309712.819311:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 21 00000100:00100000:3.0:1788309712.819317:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4019880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+5:2390:x1875178037613824:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1788309712.819347:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4019880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d9c1e3b0-2cc2-448d-b78b-db0c8de47f15+5:2390:x1875178037613824:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 30us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309712.819353:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 21 00000100:00100000:3.0:1788309712.819364:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 22 00000100:00100000:3.0:1788309712.819369:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5df0760e-86a4-46ba-b845-119bf6d92cdd+5:2390:x1875178037614336:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1788309712.819398:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5df0760e-86a4-46ba-b845-119bf6d92cdd+5:2390:x1875178037614336:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 24us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309712.819414:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 22 00000100:00080000:3.0:1788309712.819450:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788309712.819455:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788309712.819457:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788309712.819460:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788309712.819631:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178037613440 00000100:00100000:1.0:1788309712.819637:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178037613440 00000100:00100000:1.0:1788309712.819687:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 164 00000100:00100000:1.0:1788309712.819695:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+13:2390:x1875178037613440:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1788309712.820070:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8262932-b44d-4278-93be-21ab2fbade5b+13:2390:x1875178037613440:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 376us (1801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309712.820078:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 164 00010000:00010000:1.0:1788309712.877689:0:23881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788309713.002264:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788309713.002294:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc4184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875178048191232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788309713.002425:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788309713.002436:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875178048191360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788309713.002508:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788309713.002567:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048191360 00000100:00100000:3.0:1788309713.002575:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048191360 00000100:00100000:3.0:1788309713.002641:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788309713.002650:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc41d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875178048191360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788309713.002698:0:24237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3908194304 avail 3676672000 00000100:00100000:3.0:1788309713.002746:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc41d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875178048191360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788309713.002754:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788309713.002775:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788309713.002813:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875178048191360:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788309713.004226:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3101f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875178048191488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788309713.004283:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309713.004324:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc4187800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875178048192000:0@lo:400:kworker.0 00000100:00100000:1.0:1788309713.004375:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309713.004382:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc4185500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048191744:0@lo:400:kworker.0 00000100:00100000:1.0:1788309713.004402:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc4185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875178048192512:0@lo:400:kworker.0 00000100:00100000:0.0:1788309713.004423:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309713.004434:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309713.004450:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc4187b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875178048192256:0@lo:400:kworker.0 00000100:00100000:1.0:1788309713.004458:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788309713.004466:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc4185f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3617:1875178048191616:0@lo:400:kworker.0 00000100:00100000:0.0:1788309713.004480:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309713.004503:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc4186d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875178048192768:0@lo:400:kworker.0 00000100:00100000:1.0:1788309713.004508:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309713.004532:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309713.004549:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc4184700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048192128:0@lo:400:kworker.0 00000100:00100000:0.0:1788309713.004559:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788309713.004568:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc4187100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048191872:0@lo:400:kworker.0 00000100:00100000:1.0:1788309713.004578:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309713.004597:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc4185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875178048192640:0@lo:400:kworker.0 00000100:00100000:0.0:1788309713.004604:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309713.004627:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309713.004634:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc4184000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875178048192384:0@lo:400:kworker.0 00000100:00100000:0.0:1788309713.004676:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309713.004693:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc4184380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875178048192896:0@lo:400:kworker.0 00000100:00100000:1.0:1788309713.004695:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048191616 00000100:00100000:1.0:1788309713.004702:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048191616 00000100:00100000:0.0:1788309713.004735:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309713.004749:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788309713.004759:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30fbb51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:3617:x1875178048191616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309713.004771:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048191744 00000100:00100000:0.0:1788309713.004776:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048191744 00000100:00100000:1.0:1788309713.004809:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30fbb51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b0d6b2e-d97d-4371-bf12-107712db0d6d+24:3617:x1875178048191616:12345-0@lo:400:kworker.0 Request processed in 50us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309713.004811:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048192128 00000100:00100000:0.0:1788309713.004816:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048192128 00000100:00100000:1.0:1788309713.004819:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788309713.004869:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788309713.004879:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048191744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309713.004889:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788309713.004928:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc4185f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b0d6b2e-d97d-4371-bf12-107712db0d6d:3617:1875178048191616:0@lo:400:kworker.0 00000100:00100000:0.0:1788309713.004935:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048191744:12345-0@lo:400:kworker.0 Request processed in 56us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309713.004950:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788309713.004967:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048191232 00000100:00100000:0.0:1788309713.004970:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048191232 00000100:00100000:1.0:1788309713.004977:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048192000 00000100:00100000:1.0:1788309713.004981:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048192000 00000100:00100000:0.0:1788309713.004988:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788309713.004997:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3101f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048192128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309713.005007:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048192512 00000100:00100000:1.0:1788309713.005011:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048192512 00000100:00080000:2.0:1788309713.005036:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788309713.005037:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048192768 00000100:00100000:0.0:1788309713.005041:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3101f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875178048192128:12345-0@lo:400:kworker.0 Request processed in 44us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309713.005042:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048192768 00000100:00100000:0.0:1788309713.005051:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788309713.005063:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788309713.005069:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3101f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875178048191232:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788309713.005081:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048192640 00000100:00100000:1.0:1788309713.005085:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048192640 00000004:00000024:0.0:1788309713.005095:0:22732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788309713.005112:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048192384 00000100:00100000:1.0:1788309713.005116:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048192384 00000100:00100000:1.0:1788309713.005131:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048192896 00000100:00100000:1.0:1788309713.005134:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048192896 00000100:00100000:0.0:1788309713.005138:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3101f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875178048191232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309713.005146:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788309713.005154:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788309713.005161:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3101f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875178048192000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309713.005191:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc4184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875178048191232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788309713.005197:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3101f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875178048192000:12345-0@lo:400:kworker.0 Request processed in 36us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309713.005205:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788309713.005222:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc4185500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048191744:0@lo:400:kworker.0 00000100:00100000:1.0:1788309713.005225:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788309713.005237:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3101f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875178048192512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309713.005250:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc4184700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875178048192128:0@lo:400:kworker.0 00000100:00100000:0.0:1788309713.005261:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc4187800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875178048192000:0@lo:400:kworker.0 00000100:00100000:1.0:1788309713.005292:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3101f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875178048192512:12345-0@lo:400:kworker.0 Request processed in 57us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309713.005300:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788309713.005304:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc4185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875178048192512:0@lo:400:kworker.0 00000100:00100000:1.0:1788309713.005320:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788309713.005328:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875178048192768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309713.005365:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875178048192768:12345-0@lo:400:kworker.0 Request processed in 39us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309713.005372:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788309713.005383:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788309713.005389:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3101f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875178048192640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309713.005418:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3101f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875178048192640:12345-0@lo:400:kworker.0 Request processed in 30us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309713.005424:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788309713.005435:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788309713.005440:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f03d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875178048192384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788309713.005460:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc4186d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875178048192768:0@lo:400:kworker.0 00000100:00100000:1.0:1788309713.005482:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f03d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875178048192384:12345-0@lo:400:kworker.0 Request processed in 41us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309713.005488:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc4184000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875178048192384:0@lo:400:kworker.0 00000100:00100000:1.0:1788309713.005492:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788309713.005513:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1788309713.005519:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c2fc4185c00 x1875178048192640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788309713.005522:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc20e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875178048192896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309713.005555:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc20e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875178048192896:12345-0@lo:400:kworker.0 Request processed in 36us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309713.005561:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788309713.005580:0:25402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048192256 00000100:00100000:1.0:1788309713.005584:0:25402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048192256 00000100:00100000:1.0:1788309713.005609:0:25402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048191872 00000100:00100000:1.0:1788309713.005612:0:25402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048191872 00000100:00100000:1.0:1788309713.005629:0:25402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788309713.005635:0:25402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc4186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875178048192256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309713.005677:0:25402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc4186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875178048192256:12345-0@lo:400:kworker.0 Request processed in 30us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309713.005683:0:25402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788309713.005694:0:25402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788309713.005700:0:25402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c30f03d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048191872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788309713.005724:0:25402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c30f03d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875178048191872:12345-0@lo:400:kworker.0 Request processed in 25us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788309713.005730:0:25402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788309713.005991:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc4185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875178048192640:0@lo:400:kworker.0 00000100:00100000:0.0:1788309713.006023:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc4187100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875178048191872:0@lo:400:kworker.0 00010000:00080000:0.0:1788309713.006034:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c2fc4184380 x1875178048192896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788309729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788309713.006043:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc4184380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875178048192896:0@lo:400:kworker.0 00000100:00100000:0.0:1788309713.006053:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc4187b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875178048192256:0@lo:400:kworker.0 00000100:00080000:2.0:1788309713.006487:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788309713.006492:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788309713.006495:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788309713.007510:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048191488 00000100:00100000:2.0:1788309713.007523:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048191488 00000100:00100000:2.0:1788309713.007604:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788309713.007616:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3101f35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875178048191488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788309713.007644:0:24237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3908194304 avail 3676672000 00000100:00080000:0.0:1788309713.007692:0:22723:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788309713.007768:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3101f35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875178048191488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (3483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788309713.007777:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788309713.007799:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:0.0:1788309713.007806:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c2fc4371f80, transno 12884901892 00000004:00080000:0.0:1788309713.007822:0:3617:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:0.0:1788309713.007879:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3101f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875178048191488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788309713.008250:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788309713.008266:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c2fc41d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875178048193024:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788309713.008551:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788309713.008695:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875178048193024 00000100:00100000:0.0:1788309713.008701:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875178048193024 00000100:00100000:0.0:1788309713.008743:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788309713.008751:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c2fc401ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875178048193024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788309713.008782:0:22732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1788309713.008833:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c2fc401ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875178048193024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788309713.008881:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788309713.008896:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c2fc41d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875178048193024:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1788309713.086404:0:25809:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1788309713.901578:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 13874 lines, 13874 kept, 0 dropped, 0 bad.