00000040:00080000:1.0F:1790946126.823559:0:17181:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790946126.823586:0:17181:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790946126.823621:0:17181:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1790946126.823630:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0F:1790946127.138204:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946128.159896:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790946128.236676:0:17127:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:1.0:1790946128.236698:0:17127:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d3f83f7c300 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:1.0:1790946128.236704:0:17127:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d40bacccf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d3f83f7c540 00000020:00080000:1.0:1790946128.236707:0:17127:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d40baccc600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d40b55af600 00000020:00080000:1.0:1790946128.236736:0:17187:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:1.0:1790946128.236803:0:17187:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0F:1790946128.236849:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27ea35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946128.236869:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27ea35 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946128.236876:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27ea35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946128.236882:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0c00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790946128.236886:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27ea35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946128.236893:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27ea35 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946128.236910:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d40bc9af800) 00010000:00010000:3.0:1790946128.236913:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946128.236918:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27ea35 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946128.236924:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0c00/0xd9f4181e0d27ea35 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946129.183407:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946129.255715:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946129.255752:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616596736 00000100:00100000:3.0:1790946129.255763:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616596736 00000100:00100000:3.0:1790946129.255834:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:3.0:1790946129.255845:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+13:15553:x1877942616596736:12345-192.168.204.20@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1790946129.255960:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+13:15553:x1877942616596736:12345-192.168.204.20@tcp:60:lhsmtool_posix.0 Request processed in 118us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946129.255981:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00080000:3.0:1790946129.256005:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946129.259930:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946129.260558:0:20141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616596864 00000100:00100000:3.0:1790946129.260570:0:20141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616596864 00000100:00100000:3.0:1790946129.260633:0:20141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:3.0:1790946129.260643:0:20141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:15553:x1877942616596864:12345-192.168.204.20@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1790946129.260748:0:20141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:15553:x1877942616596864:12345-192.168.204.20@tcp:60:lhsmtool_posix.0 Request processed in 107us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946129.260757:0:20141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00080000:3.0:1790946129.260781:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790946129.277939:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946129.277976:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616597120 00000100:00100000:3.0:1790946129.277985:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616597120 00000100:00100000:3.0:1790946129.278036:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:3.0:1790946129.278046:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+13:15553:x1877942616597120:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790946129.278292:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+14:15553:x1877942616597120:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 246us (361us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1790946129.278300:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00010000:00010000:0.0:1790946130.207393:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946130.783550:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790946130.783574:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638686336:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790946130.783643:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0F:1790946130.786807:0:19952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638686336 00000100:00100000:2.0:1790946130.786852:0:19952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638686336 00000100:00100000:2.0:1790946130.786929:0:19952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790946130.786940:0:19952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638686336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790946130.786974:0:19952:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1790946130.787017:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790946130.787064:0:19952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638686336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (3420us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946130.787072:0:19952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790946130.787256:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638686336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790946131.014882:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946131.014932:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946131.014970:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946131.015002:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616597504 00000100:00100000:0.0:1790946131.015011:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616597504 00000100:00100000:0.0:1790946131.015084:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616597376 00000100:00100000:0.0:1790946131.015088:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616597376 00000100:00100000:0.0:1790946131.015119:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:0.0:1790946131.015129:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:2404:x1877942616597504:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790946131.015220:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:0.0:1790946131.015226:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:2404:x1877942616597504:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 96us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946131.015236:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+14:2404:x1877942616597376:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790946131.015238:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00080000:0.0:1790946131.015267:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790946131.015272:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790946131.015284:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca604fcf-845a-4ff8-977f-a1d27931fa85+14:2404:x1877942616597376:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 54us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946131.015293:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:2.0:1790946131.015376:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616597248 00000100:00100000:2.0:1790946131.015381:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616597248 00000100:00100000:2.0:1790946131.015418:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 168 00000100:00100000:2.0:1790946131.015425:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8238a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+13:2404:x1877942616597248:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790946131.015466:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8238a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65e62bd4-414e-42c8-885a-5648a45a13a4+13:2404:x1877942616597248:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 41us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946131.015473:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 168 00000100:00100000:0.0:1790946131.023729:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946131.023822:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946131.027557:0:18669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616597760 00000100:00100000:3.0:1790946131.027572:0:18669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616597760 00000100:00100000:0.0:1790946131.027852:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946131.027882:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946131.027903:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946131.027920:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946131.027942:0:19252:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616597632 00000100:00100000:0.0:1790946131.027946:0:19252:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616597632 00000100:00100000:0.0:1790946131.028004:0:19252:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616598144 00000100:00100000:0.0:1790946131.028007:0:19252:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616598144 00000100:00100000:0.0:1790946131.028020:0:19252:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616598272 00000100:00100000:0.0:1790946131.028022:0:19252:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616598272 00000100:00100000:0.0:1790946131.028038:0:19252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:0.0:1790946131.028046:0:19252:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:2400:x1877942616597632:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:0.0:1790946131.028095:0:19252:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e76b 00000100:00080000:0.0:1790946131.028109:0:19252:0:(import.c:65:import_set_state_nolock()) ffff9d40bc94e000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790946131.028156:0:19252:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1790946131.028356:0:19252:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+2:2400:x1877942616597632:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 309us (4532us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946131.028365:0:19252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:0.0:1790946131.028383:0:19252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:0.0:1790946131.028389:0:19252:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2400:x1877942616598144:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:0.0:1790946131.028402:0:19252:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e7a3 00000100:00080000:0.0:1790946131.028420:0:19252:0:(import.c:65:import_set_state_nolock()) ffff9d40baa32000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790946131.028442:0:19252:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1790946131.028492:0:19252:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+2:2400:x1877942616598144:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 103us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946131.028500:0:19252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:0.0:1790946131.028511:0:19252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:0.0:1790946131.028517:0:19252:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2400:x1877942616598272:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:0.0:1790946131.028530:0:19252:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e7aa 00000100:00080000:0.0:1790946131.028537:0:19252:0:(import.c:65:import_set_state_nolock()) ffff9d40baa35800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790946131.028560:0:19252:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1790946131.028628:0:19252:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+2:2400:x1877942616598272:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 110us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946131.028635:0:19252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 28 00010000:00010000:0.0:1790946131.028704:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946131.028710:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946131.028720:0:20141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616597888 00000100:00100000:0.0:1790946131.028730:0:20141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616597888 00000100:00100000:0.0:1790946131.028763:0:20141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616598016 00000100:00100000:0.0:1790946131.028767:0:20141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616598016 00000100:00100000:0.0:1790946131.028790:0:20141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:0.0:1790946131.028797:0:20141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:2401:x1877942616597888:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790946131.028828:0:20141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:2401:x1877942616597888:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 32us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946131.028834:0:20141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:0.0:1790946131.028845:0:20141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 72 00000100:00100000:0.0:1790946131.028851:0:20141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2401:x1877942616598016:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790946131.028876:0:20141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2401:x1877942616598016:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 26us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946131.028881:0:20141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 72 00000100:00080000:0.0:1790946131.028903:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790946131.028907:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790946131.028909:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790946131.028911:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790946131.029806:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946131.030452:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:3.0:1790946131.030463:0:18669:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:2402:x1877942616597760:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790946131.030529:0:18669:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:2402:x1877942616597760:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 69us (6813us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946131.030544:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00080000:0.0:1790946131.030858:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1790946131.104021:0:17919:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790946131.233088:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946131.297881:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790946131.297907:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b4ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638686464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790946131.298113:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790946131.298124:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638686592:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790946131.298159:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946131.298272:0:18671:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638686464 00000100:00100000:0.0:1790946131.298279:0:18671:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638686464 00000100:00100000:0.0:1790946131.298350:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790946131.298359:0:18671:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638686464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790946131.298382:0:18671:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790946131.300955:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946131.301124:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638686592 00000100:00100000:1.0:1790946131.301132:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638686592 00000100:00100000:1.0:1790946131.301205:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790946131.301227:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638686592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790946131.301264:0:17152:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790946131.301320:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638686592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946131.301328:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790946131.301357:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:87d8d138-d2ce-4761-a98a-4e847b9142bd:3647:1877942638686976:0@lo:400:kworker.0 00000100:00100000:1.0:1790946131.301391:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946131.301415:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638687488:0@lo:400:kworker.0 00000100:00100000:1.0:1790946131.301436:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946131.301451:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638688000:0@lo:400:kworker.0 00000100:00100000:1.0:1790946131.301474:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946131.301513:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638686592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790946131.301532:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1790946131.301537:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638687104:0@lo:400:kworker.0 00000100:00100000:1.0:1790946131.301559:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946131.301576:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638687616:0@lo:400:kworker.0 00000100:00100000:1.0:1790946131.301595:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946131.301612:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638688128:0@lo:400:kworker.0 00000100:00100000:1.0:1790946131.301632:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946131.301656:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638687488 00000100:00100000:1.0:1790946131.301661:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638687488 00000100:00100000:1.0:1790946131.301681:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790946131.301686:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638687488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946131.301724:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638687488:12345-0@lo:400:kworker.0 Request processed in 37us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946131.301737:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790946131.301757:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638686976 00000100:00100000:1.0:1790946131.301761:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638686976 00000100:00100000:1.0:1790946131.301785:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1790946131.301791:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8238a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:3647:x1877942638686976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946131.301820:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8238a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:3647:x1877942638686976:12345-0@lo:400:kworker.0 Request processed in 30us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946131.301827:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1790946131.301862:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:87d8d138-d2ce-4761-a98a-4e847b9142bd:3647:1877942638686976:0@lo:400:kworker.0 00000100:00100000:1.0:1790946131.301871:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638687488:0@lo:400:kworker.0 00000100:00080000:2.0:1790946131.304121:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790946131.304148:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638686848:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790946131.304228:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946131.304250:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638687360:0@lo:400:kworker.0 00000100:00100000:2.0:1790946131.304274:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946131.304311:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638687872:0@lo:400:kworker.0 00000100:00100000:2.0:1790946131.304333:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946131.304352:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638688384:0@lo:400:kworker.0 00000100:00100000:2.0:1790946131.304385:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946131.304403:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1790946131.304410:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638686720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790946131.304434:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946131.304458:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638687232:0@lo:400:kworker.0 00000100:00100000:2.0:1790946131.304481:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946131.304500:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638687744:0@lo:400:kworker.0 00000100:00100000:2.0:1790946131.304519:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946131.304533:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1877942638688256:0@lo:400:kworker.0 00000100:00100000:2.0:1790946131.304550:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946131.304574:0:18670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638686848 00000100:00100000:2.0:1790946131.304582:0:18670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638686848 00000100:00100000:2.0:1790946131.304629:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790946131.304637:0:18670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638686848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790946131.304665:0:18670:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1790946131.304709:0:18670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638686848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946131.304716:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1790946131.304734:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790946131.304769:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638686848:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790946131.304802:0:18669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638687104 00000100:00100000:2.0:1790946131.304805:0:18669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638687104 00000100:00100000:2.0:1790946131.304827:0:18669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638687616 00000100:00100000:2.0:1790946131.304831:0:18669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638687616 00000100:00100000:2.0:1790946131.304842:0:18669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638687232 00000100:00100000:2.0:1790946131.304844:0:18669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638687232 00000100:00100000:2.0:1790946131.304861:0:18669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638687744 00000100:00100000:2.0:1790946131.304870:0:18669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638687744 00000100:00100000:2.0:1790946131.304887:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790946131.304894:0:18669:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1877942638687104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946131.304933:0:18669:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1877942638687104:12345-0@lo:400:kworker.0 Request processed in 40us (3373us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946131.304940:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790946131.304952:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790946131.304957:0:18669:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638687616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946131.304984:0:18669:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638687616:12345-0@lo:400:kworker.0 Request processed in 28us (3388us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946131.304990:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790946131.305000:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790946131.305005:0:18669:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638687232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946131.305037:0:18669:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638687232:12345-0@lo:400:kworker.0 Request processed in 32us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946131.305043:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790946131.305054:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790946131.305059:0:18669:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638687744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946131.305084:0:18669:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638687744:12345-0@lo:400:kworker.0 Request processed in 25us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946131.305089:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790946131.305106:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638688000 00000100:00100000:2.0:1790946131.305109:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638688000 00000100:00100000:2.0:1790946131.305128:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638688128 00000100:00100000:2.0:1790946131.305131:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638688128 00000100:00100000:2.0:1790946131.305143:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638687360 00000100:00100000:2.0:1790946131.305145:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638687360 00000100:00100000:2.0:1790946131.305164:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638687872 00000100:00100000:2.0:1790946131.305194:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638687872 00000100:00100000:2.0:1790946131.305207:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638688384 00000100:00100000:2.0:1790946131.305210:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638688384 00000100:00100000:2.0:1790946131.305221:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638688256 00000100:00100000:2.0:1790946131.305224:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638688256 00000100:00100000:2.0:1790946131.305238:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790946131.305243:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638688000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946131.305276:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638688000:12345-0@lo:400:kworker.0 Request processed in 32us (3801us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946131.305281:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790946131.305304:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790946131.305310:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638688128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946131.305338:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638688128:12345-0@lo:400:kworker.0 Request processed in 28us (3705us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946131.305343:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790946131.305354:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790946131.305359:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638687360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946131.305387:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638687360:12345-0@lo:400:kworker.0 Request processed in 28us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946131.305393:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790946131.305404:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790946131.305410:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638687872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946131.305435:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638687872:12345-0@lo:400:kworker.0 Request processed in 26us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946131.305441:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790946131.305451:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790946131.305464:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638688384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946131.305491:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638688384:12345-0@lo:400:kworker.0 Request processed in 29us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946131.305496:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790946131.305507:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790946131.305513:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877942638688256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946131.305541:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877942638688256:12345-0@lo:400:kworker.0 Request processed in 28us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946131.305546:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1790946131.305564:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790946131.305567:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790946131.305570:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790946131.305590:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638687232:0@lo:400:kworker.0 00000100:00100000:2.0:1790946131.305600:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638687744:0@lo:400:kworker.0 00000100:00100000:2.0:1790946131.305609:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1877942638688256:0@lo:400:kworker.0 00000100:00100000:2.0:1790946131.305618:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638687360:0@lo:400:kworker.0 00000100:00100000:2.0:1790946131.305625:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638687872:0@lo:400:kworker.0 00010000:00080000:2.0:1790946131.305636:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8441ed80 x1877942638688384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946131.305646:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638688384:0@lo:400:kworker.0 00000100:00100000:2.0:1790946131.305730:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638687104:0@lo:400:kworker.0 00000100:00100000:2.0:1790946131.305742:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638687616:0@lo:400:kworker.0 00010000:00080000:2.0:1790946131.305765:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8441d880 x1877942638688128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946131.305774:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638688128:0@lo:400:kworker.0 00000100:00100000:2.0:1790946131.305784:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638688000:0@lo:400:kworker.0 00000100:00100000:2.0:1790946131.305813:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638686720 00000100:00100000:2.0:1790946131.305817:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638686720 00000100:00100000:2.0:1790946131.305843:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790946131.305849:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638686720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790946131.305874:0:17153:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1790946131.305906:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638686720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (1471us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946131.305911:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790946131.305937:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638686720:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790946131.312497:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638688512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790946131.312574:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946131.312630:0:18670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638688512 00000100:00100000:3.0:1790946131.312638:0:18670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638688512 00000100:00100000:3.0:1790946131.312688:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790946131.312697:0:18670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638688512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790946131.312722:0:18670:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1790946131.312769:0:18670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638688512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946131.312776:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790946131.312826:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638688512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946131.313258:0:18671:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638686464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 14898us (15097us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946131.313267:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790946131.316740:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b4ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638686464:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1790946131.369805:0:20537:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 09:02:10 (1790946130) 00010000:00010000:3.0:1790946132.257429:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946133.282910:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946134.304719:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790946134.386382:0:17127:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:0.0:1790946134.386402:0:17127:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:1.0:1790946134.386665:0:17187:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:1.0:1790946134.386676:0:17187:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000100:00100000:0.0:1790946135.281768:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946135.281857:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616598528 00000100:00100000:3.0:1790946135.281871:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616598528 00000100:00100000:3.0:1790946135.281950:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:3.0:1790946135.281962:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+13:16308:x1877942616598528:12345-192.168.204.20@tcp:35:umount.0 00000001:00080000:3.0:1790946135.282241:0:17151:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1790946135.282331:0:17151:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:3.0:1790946135.282457:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+16:16308:x1877942616598528:12345-192.168.204.20@tcp:35:umount.0 Request processed in 497us (700us total) trans 8589934626 rc 0/0 00000100:00100000:3.0:1790946135.282465:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000020:00080000:3.0:1790946135.282471:0:17151:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:2.0:1790946135.282746:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790946135.285625:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946135.290470:0:18669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616598656 00000100:00100000:2.0:1790946135.290554:0:18669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616598656 00000100:00100000:3.0:1790946135.291687:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:3.0:1790946135.291704:0:18669:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:2400:x1877942616598656:12345-192.168.204.20@tcp:9:umount.0 00000020:00000080:3.0:1790946135.291763:0:18669:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e764 00000100:00080000:3.0:1790946135.291773:0:18669:0:(import.c:65:import_set_state_nolock()) ffff9d40baa30800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1790946135.291795:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1790946135.291817:0:18669:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1790946135.292281:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946135.292318:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946135.292345:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946135.292369:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616598912 00000100:00100000:0.0:1790946135.292376:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616598912 00000100:00100000:1.0:1790946135.292412:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616598784 00000100:00100000:0.0:1790946135.292413:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616599040 00000100:00100000:1.0:1790946135.292416:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616598784 00000100:00100000:0.0:1790946135.292416:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616599040 00000100:00100000:0.0:1790946135.292433:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:0.0:1790946135.292440:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65e62bd4-414e-42c8-885a-5648a45a13a4+15:2401:x1877942616598912:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946135.292457:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946135.292476:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4080030400/0xd9f4181e0d27e748 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330efc expref: 15 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946135.292494:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946135.292553:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65e62bd4-414e-42c8-885a-5648a45a13a4+14:2401:x1877942616598912:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 113us (274us total) trans 0 rc 0/0 00000100:00080000:2.0:1790946135.292668:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790946135.293384:0:18669:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca604fcf-845a-4ff8-977f-a1d27931fa85+2:2400:x1877942616598656:12345-192.168.204.20@tcp:9:umount.0 Request processed in 1683us (7765us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946135.293394:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:1.0:1790946135.294730:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:1.0:1790946135.294755:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83d42050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65e62bd4-414e-42c8-885a-5648a45a13a4+14:2401:x1877942616599040:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946135.294779:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946135.294812:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef0600/0xd9f4181e0d27e7cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fb2 expref: 14 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946135.294831:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946135.294875:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83d42050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65e62bd4-414e-42c8-885a-5648a45a13a4+13:2401:x1877942616599040:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 133us (2528us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946135.294884:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:1.0:1790946135.294930:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:1.0:1790946135.294938:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65e62bd4-414e-42c8-885a-5648a45a13a4+12:2401:x1877942616598784:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946135.294946:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946135.294956:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27e741 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ecb expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946135.294966:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946135.294985:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65e62bd4-414e-42c8-885a-5648a45a13a4+11:2401:x1877942616598784:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 48us (2667us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946135.294991:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:0.0:1790946135.297394:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:3.0:1790946135.310708:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946135.310812:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616599936 00000100:00100000:2.0:1790946135.310823:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616599936 00000100:00100000:2.0:1790946135.310897:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:2.0:1790946135.310911:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+16:2400:x1877942616599936:12345-192.168.204.20@tcp:39:umount.0 00000020:00000080:2.0:1790946135.310956:0:17148:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e756 00000020:00010000:2.0:1790946135.310974:0:17148:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9d40903f9800: total 0 00000100:00080000:2.0:1790946135.310991:0:17148:0:(import.c:65:import_set_state_nolock()) ffff9d40903f9000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790946135.311281:0:17148:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:2.0:1790946135.311453:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca604fcf-845a-4ff8-977f-a1d27931fa85+15:2400:x1877942616599936:12345-192.168.204.20@tcp:39:umount.0 Request processed in 545us (752us total) trans 8589934627 rc 0/0 00000100:00100000:2.0:1790946135.311462:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 67 00000020:00010000:3.0:1790946135.311959:0:18315:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9d40903f9800: total 0 00010000:00010000:3.0:1790946135.311964:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946135.312014:0:18315:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d40903f9800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1790946135.312058:0:18315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d3f83415600) 00010000:00010000:3.0:1790946135.312062:0:18315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790946135.312070:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d6800/0xd9f4181e0d27e901 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ff8 expref: 14 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946135.312094:0:18315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:3.0:1790946135.312096:0:18315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790946135.312101:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40813ff000/0xd9f4181e0d27e9b0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331037 expref: 13 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946135.312113:0:18315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:3.0:1790946135.312116:0:18315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790946135.312119:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1200/0xd9f4181e0d27e97f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331022 expref: 12 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946135.312152:0:18315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3f83415000) 00010000:00010000:3.0:1790946135.312155:0:18315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946135.312159:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0e00/0xd9f4181e0d27e83d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fc0 expref: 11 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946135.312192:0:18315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d4096cfda00) 00010000:00010000:3.0:1790946135.312194:0:18315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790946135.312198:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0000/0xd9f4181e0d27e87c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fce expref: 10 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946135.312210:0:18315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d40bc9af800) 00010000:00010000:3.0:1790946135.312225:0:18315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790946135.312230:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27ea0b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233104c expref: 9 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946135.312246:0:18315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d4096cfd000) 00010000:00010000:3.0:1790946135.312248:0:18315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790946135.312252:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40814a2c00/0xd9f4181e0d27ea66 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331068 expref: 8 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946135.312269:0:18315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d4096cfdf00) 00010000:00010000:3.0:1790946135.312271:0:18315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790946135.312275:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40bcbe0a00/0xd9f4181e0d27e821 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fb9 expref: 7 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946135.312287:0:18315:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d40903f9800, canceled 8 locks, left on hash table 0. 00010000:00010000:3.0:1790946135.312301:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946135.312308:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946135.312310:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946135.327541:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946135.333644:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946135.333744:0:20141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616600064 00000100:00100000:2.0:1790946135.333756:0:20141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616600064 00000100:00100000:2.0:1790946135.333842:0:20141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:2.0:1790946135.333852:0:20141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+5:2400:x1877942616600064:12345-192.168.204.20@tcp:39:umount.0 00000020:00000080:2.0:1790946135.333888:0:20141:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e75d 00000100:00080000:2.0:1790946135.333906:0:20141:0:(import.c:65:import_set_state_nolock()) ffff9d3f82489800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790946135.333935:0:20141:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1790946135.334240:0:20141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca604fcf-845a-4ff8-977f-a1d27931fa85+3:2400:x1877942616600064:12345-192.168.204.20@tcp:39:umount.0 Request processed in 388us (604us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1790946135.334251:0:20141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 68 00010000:00010000:1.0:1790946135.334536:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790946135.334599:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790946135.908067:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790946135.908095:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638688640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790946135.908219:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946135.908383:0:18670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638688640 00000100:00100000:2.0:1790946135.908393:0:18670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638688640 00000100:00100000:2.0:1790946135.908447:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790946135.908455:0:18670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638688640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790946135.908482:0:18670:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790946135.908526:0:18670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638688640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946135.908532:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790946135.908611:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638688640:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790946135.908859:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1790946136.031430:0:17181:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790946136.031442:0:17181:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790946136.031465:0:17181:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1790946136.031490:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1790946136.140992:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946136.141040:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946136.141103:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946136.141221:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616600448 00000100:00100000:1.0:1790946136.141233:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616600448 00000100:00100000:1.0:1790946136.141296:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616600320 00000100:00100000:1.0:1790946136.141300:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616600320 00000100:00100000:1.0:1790946136.141333:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00100000:1.0:1790946136.141343:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2403:x1877942616600448:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790946136.141431:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2403:x1877942616600448:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 90us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946136.141439:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00100000:1.0:1790946136.141457:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00100000:1.0:1790946136.141464:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:2403:x1877942616600320:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790946136.141504:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:2403:x1877942616600320:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 41us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946136.141511:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00080000:0.0:1790946136.141857:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790946136.141862:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790946136.142053:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616600192 00000100:00100000:2.0:1790946136.142059:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616600192 00000100:00100000:2.0:1790946136.142139:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 170 00000100:00100000:2.0:1790946136.142148:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8238a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+10:2403:x1877942616600192:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790946136.142246:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8238a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+10:2403:x1877942616600192:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 99us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946136.142254:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 170 00010000:00010000:3.0:1790946136.352297:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946136.415404:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638688896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790946136.415458:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638688768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790946136.415494:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946136.415514:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790946136.415544:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638689024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790946136.415585:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946136.415604:0:18671:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638688896 00000100:00100000:3.0:1790946136.415613:0:18671:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638688896 00000100:00100000:0.0:1790946136.415623:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946136.415677:0:18671:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638688768 00000100:00100000:3.0:1790946136.415681:0:18671:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638688768 00000100:00100000:3.0:1790946136.415703:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790946136.415712:0:18671:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638688896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790946136.415735:0:18671:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1790946136.416229:0:18671:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638688896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 517us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946136.416238:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790946136.416259:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790946136.416266:0:18671:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638688768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790946136.416284:0:18671:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1790946136.420247:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638689024 00000100:00100000:2.0:1790946136.420263:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638689024 00000100:00100000:2.0:1790946136.420634:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790946136.420645:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638689024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790946136.420684:0:17153:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1790946136.420772:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638689024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (5185us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946136.420785:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790946136.420877:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638688896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790946136.420896:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790946136.420906:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638689280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790946136.420940:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946136.420977:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638689280 00000100:00100000:2.0:1790946136.420981:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638689280 00000100:00100000:2.0:1790946136.421002:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790946136.421008:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638689280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790946136.421200:0:17153:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790946136.421237:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638689280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 229us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946136.421258:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790946136.421291:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638689280:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1790946136.421325:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790946136.421331:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790946136.421343:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638689152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790946136.421372:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946136.421470:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638689024:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790946136.421493:0:19952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638689152 00000100:00100000:2.0:1790946136.421497:0:19952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638689152 00000100:00100000:2.0:1790946136.421523:0:19952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790946136.421596:0:19952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83deed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638689152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790946136.421611:0:19952:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1790946136.421648:0:19952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83deed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638689152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946136.421654:0:19952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1790946136.421669:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790946136.421692:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638689152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790946136.421805:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638689664:0@lo:400:kworker.0 00000100:00100000:2.0:1790946136.421833:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946136.421850:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638690176:0@lo:400:kworker.0 00000100:00100000:2.0:1790946136.421872:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946136.421895:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790946136.421900:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638689536:0@lo:400:kworker.0 00000100:00100000:2.0:1790946136.421919:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946136.421950:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638690048:0@lo:400:kworker.0 00000100:00100000:2.0:1790946136.421969:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946136.421991:0:19252:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638689664 00000100:00100000:2.0:1790946136.421996:0:19252:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638689664 00000100:00100000:2.0:1790946136.422141:0:19252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790946136.422149:0:19252:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638689664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946136.422219:0:19252:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638689664:12345-0@lo:400:kworker.0 Request processed in 72us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946136.422225:0:19252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790946136.422246:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87d8d138-d2ce-4761-a98a-4e847b9142bd:3650:1877942638689408:0@lo:400:kworker.0 00000100:00100000:2.0:1790946136.422273:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946136.422296:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638689920:0@lo:400:kworker.0 00000100:00100000:2.0:1790946136.422316:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946136.422332:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790946136.422338:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638689792:0@lo:400:kworker.0 00000100:00100000:2.0:1790946136.422357:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946136.422368:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638690304:0@lo:400:kworker.0 00000100:00100000:2.0:1790946136.422384:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946136.422477:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638689664:0@lo:400:kworker.0 00000100:00100000:2.0:1790946136.422503:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638690176 00000100:00100000:2.0:1790946136.422506:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638690176 00000100:00100000:2.0:1790946136.422697:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638689536 00000100:00100000:2.0:1790946136.422701:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638689536 00000100:00100000:2.0:1790946136.422859:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638690048 00000100:00100000:2.0:1790946136.422864:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638690048 00000100:00100000:2.0:1790946136.422881:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638689920 00000100:00100000:2.0:1790946136.422884:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638689920 00000100:00100000:2.0:1790946136.422914:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638689792 00000100:00100000:2.0:1790946136.422917:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638689792 00000100:00100000:2.0:1790946136.422927:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638690304 00000100:00100000:2.0:1790946136.422929:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638690304 00000100:00100000:2.0:1790946136.422942:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790946136.422948:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638690176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946136.422990:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638690176:12345-0@lo:400:kworker.0 Request processed in 42us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946136.422997:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790946136.423128:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790946136.423139:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638689536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946136.423201:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638689536:12345-0@lo:400:kworker.0 Request processed in 55us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946136.423208:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790946136.423221:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790946136.423227:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638690048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946136.423255:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638690048:12345-0@lo:400:kworker.0 Request processed in 29us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946136.423261:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790946136.423271:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790946136.423276:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877942638689920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946136.423306:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877942638689920:12345-0@lo:400:kworker.0 Request processed in 30us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946136.423312:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790946136.423324:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790946136.423329:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638689792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946136.423366:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638689792:12345-0@lo:400:kworker.0 Request processed in 36us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946136.423372:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790946136.423383:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790946136.423459:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638690304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946136.423487:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638690304:12345-0@lo:400:kworker.0 Request processed in 99us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946136.423492:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1790946136.423510:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790946136.423513:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946136.423628:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638689536:0@lo:400:kworker.0 00010000:00080000:2.0:1790946136.423642:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bff72680 x1877942638690048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946136.423652:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638690048:0@lo:400:kworker.0 00000100:00100000:2.0:1790946136.423663:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638690176:0@lo:400:kworker.0 00000100:00100000:2.0:1790946136.423693:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638689792:0@lo:400:kworker.0 00010000:00080000:2.0:1790946136.423701:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bff72d80 x1877942638690304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946136.423709:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638690304:0@lo:400:kworker.0 00000100:00100000:2.0:1790946136.423717:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638689920:0@lo:400:kworker.0 00000100:00100000:2.0:1790946136.423768:0:17142:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638689408 00000100:00100000:2.0:1790946136.423773:0:17142:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638689408 00000100:00100000:2.0:1790946136.423802:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1790946136.423815:0:17142:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8238b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:3650:x1877942638689408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946136.423851:0:17142:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8238b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:3650:x1877942638689408:12345-0@lo:400:kworker.0 Request processed in 37us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946136.423857:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1790946136.423888:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87d8d138-d2ce-4761-a98a-4e847b9142bd:3650:1877942638689408:0@lo:400:kworker.0 00000100:00100000:3.0:1790946136.432088:0:18671:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638688768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 15812us (16454us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946136.432100:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638688768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790946136.432106:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000001:00100000:2.0:1790946136.930362:0:19480:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ca604fcf-845a-4ff8-977f-a1d27931fa85 00000020:00000080:2.0:1790946136.930373:0:19480:0:(genops.c:885:class_export_put()) final put ffff9d3f8248b800/ca604fcf-845a-4ff8-977f-a1d27931fa85 00000001:00100000:2.0:1790946136.930395:0:19480:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713 00000020:00000080:2.0:1790946136.930397:0:19480:0:(genops.c:885:class_export_put()) final put ffff9d40baa34800/ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713 00000020:00000080:0.0:1790946136.930509:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f8248b800/ca604fcf-845a-4ff8-977f-a1d27931fa85 for lustre-OST0001 00000020:00000080:0.0:1790946136.930569:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40baa34800/ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713 for lustre-OST0001 00000020:00000080:0.0:1790946136.930601:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40baa30800 for lustre-OST0001 00000020:00000080:0.0:1790946136.930608:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40baa35800 for lustre-OST0001 00000001:00100000:0.0:1790946136.931222:0:18663:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713 00000020:00000080:0.0:1790946136.931227:0:18663:0:(genops.c:885:class_export_put()) final put ffff9d40baa36000/ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713 00000001:00100000:0.0:1790946136.931247:0:18663:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ca604fcf-845a-4ff8-977f-a1d27931fa85 00000020:00000080:0.0:1790946136.931250:0:18663:0:(genops.c:885:class_export_put()) final put ffff9d40bc94d000/ca604fcf-845a-4ff8-977f-a1d27931fa85 00000020:00000080:2.0:1790946136.931299:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40baa36000/ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713 for lustre-OST0000 00000020:00000080:2.0:1790946136.931347:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bc94d000/ca604fcf-845a-4ff8-977f-a1d27931fa85 for lustre-OST0000 00000020:00000080:2.0:1790946136.931362:0:15915:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40baa32000 for lustre-OST0000 00000020:00000080:2.0:1790946136.931366:0:15915:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40bc94e000 for lustre-OST0000 00000100:00100000:0.0:1790946136.977509:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946136.977559:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946136.977602:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946136.977888:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616600704 00000100:00100000:1.0:1790946136.977899:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616600704 00000100:00100000:1.0:1790946136.977964:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616600576 00000100:00100000:1.0:1790946136.977968:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616600576 00000100:00100000:2.0:1790946136.978019:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616600832 00000100:00100000:2.0:1790946136.978025:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616600832 00000100:00100000:2.0:1790946136.978056:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:2.0:1790946136.978068:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65e62bd4-414e-42c8-885a-5648a45a13a4+12:2403:x1877942616600704:12345-192.168.204.20@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790946136.978078:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00010000:00010000:2.0:1790946136.978086:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790946136.978092:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65e62bd4-414e-42c8-885a-5648a45a13a4+12:2401:x1877942616600832:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946136.978104:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946136.978111:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4080030c00/0xd9f4181e0d27e787 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f6c expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946136.978119:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef1c00/0xd9f4181e0d27e7c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fab expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946136.978135:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790946136.978136:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946136.978254:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65e62bd4-414e-42c8-885a-5648a45a13a4+10:2403:x1877942616600704:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 188us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946136.978262:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:2.0:1790946136.978280:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:2.0:1790946136.978296:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65e62bd4-414e-42c8-885a-5648a45a13a4+9:2401:x1877942616600576:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790946136.978307:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946136.978317:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4080030800/0xd9f4181e0d27e780 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330f3b expref: 9 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946136.978327:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946136.978347:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65e62bd4-414e-42c8-885a-5648a45a13a4+8:2401:x1877942616600576:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 52us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946136.978353:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:1.0:1790946136.979132:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65e62bd4-414e-42c8-885a-5648a45a13a4+7:2401:x1877942616600832:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 1041us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946136.979142:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:3.0:1790946136.985722:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946136.986023:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616601088 00000100:00100000:2.0:1790946136.986035:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616601088 00000100:00100000:2.0:1790946136.986102:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:2.0:1790946136.986113:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+6:2400:x1877942616601088:12345-192.168.204.20@tcp:39:umount.0 00000020:00000080:2.0:1790946136.986211:0:17149:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e795 00000020:00010000:2.0:1790946136.986219:0:17149:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9d40baa34000: total 0 00000100:00080000:2.0:1790946136.986224:0:17149:0:(import.c:65:import_set_state_nolock()) ffff9d40baa31800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790946136.986246:0:17149:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:2.0:1790946136.986398:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2400:x1877942616601088:12345-192.168.204.20@tcp:39:umount.0 Request processed in 285us (686us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1790946136.986407:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 69 00000020:00010000:0.0:1790946136.986580:0:17136:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9d40baa34000: total 0 00010000:00010000:0.0:1790946136.986637:0:17136:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d40baa34000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1790946136.986679:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d4096cfda00) 00010000:00010000:0.0:1790946136.986683:0:17136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790946136.986691:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40c21d7000/0xd9f4181e0d27e88a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330fd5 expref: 4 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946136.986714:0:17136:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d40baa34000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1790946136.986725:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946136.986727:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946136.986728:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946137.000498:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946137.000726:0:20141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616601216 00000100:00100000:2.0:1790946137.000738:0:20141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616601216 00000100:00100000:2.0:1790946137.000805:0:20141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:2.0:1790946137.000826:0:20141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+5:2400:x1877942616601216:12345-192.168.204.20@tcp:39:umount.0 00000020:00000080:2.0:1790946137.000869:0:20141:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e79c 00000100:00080000:2.0:1790946137.000879:0:20141:0:(import.c:65:import_set_state_nolock()) ffff9d40baa35000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790946137.000909:0:20141:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1790946137.001091:0:20141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713+3:2400:x1877942616601216:12345-192.168.204.20@tcp:39:umount.0 Request processed in 276us (604us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1790946137.001101:0:20141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 70 00010000:00010000:3.0:1790946137.008128:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946137.065484:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946137.065587:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616601472 00000100:00100000:2.0:1790946137.065597:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616601472 00000100:00100000:2.0:1790946137.065669:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 172 00000100:00100000:2.0:1790946137.065679:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f82389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+7:2400:x1877942616601472:12345-192.168.204.20@tcp:251:umount.0 00000020:00000080:2.0:1790946137.065734:0:17141:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e733 00000020:00010000:2.0:1790946137.065743:0:17141:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9d3f820bd800: total 0 00000100:00080000:2.0:1790946137.065748:0:17141:0:(import.c:65:import_set_state_nolock()) ffff9d3f820bb000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1790946137.065824:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f82389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65e62bd4-414e-42c8-885a-5648a45a13a4+3:2400:x1877942616601472:12345-192.168.204.20@tcp:251:umount.0 Request processed in 146us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946137.065831:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 172 00000020:00010000:3.0:1790946137.066845:0:18315:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9d3f820bd800: total 0 00010000:00010000:3.0:1790946137.066906:0:18315:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d3f820bd800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1790946137.066940:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef0800/0xd9f4181e0d27e73a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222330ec4 expref: 2 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946137.066976:0:18315:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d3f820bd800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1790946137.066988:0:18315:0:(genops.c:885:class_export_put()) final put ffff9d3f820bd800/65e62bd4-414e-42c8-885a-5648a45a13a4 00010000:00010000:3.0:1790946137.067016:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946137.067018:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946137.067020:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790946137.067215:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f820bd800/65e62bd4-414e-42c8-885a-5648a45a13a4 for MGS 00000020:00000080:2.0:1790946137.067545:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f820bb000 for MGS 00010000:00010000:0.0:1790946137.375990:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946138.399440:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790946138.856060:0:20732:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790946138.866026:0:20732:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1790946138.866083:0:20732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1200/0xd9f4181e0d27e2f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e2fd expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946138.866098:0:20732:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1200/0xd9f4181e0d27e2f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e2fd expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946138.866105:0:20732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1200/0xd9f4181e0d27e2f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e2fd expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946138.866112:0:20732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1200/0xd9f4181e0d27e2f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e2fd expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946138.866138:0:20732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790946138.866154:0:20732:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790946138.866200:0:20732:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790946138.866205:0:20732:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790946138.866210:0:20732:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790946138.866234:0:20732:0:(import.c:65:import_set_state_nolock()) ffff9d40bff0f000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1790946138.868387:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946138.868413:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1200/0xd9f4181e0d27e2f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e2fd expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946138.868425:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40bcbe1200 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:2.0:1790946138.868429:0:18315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1200/0xd9f4181e0d27e2f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e2fd expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946138.868440:0:18315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1200/0xd9f4181e0d27e2f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27e2fd expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946138.868448:0:18315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1200/0xd9f4181e0d27e2f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27e2fd expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946138.868478:0:18315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790946138.868480:0:18315:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790946138.868485:0:18315:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790946138.868524:0:18315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1200/0xd9f4181e0d27e2f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e2fd expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946138.868531:0:18315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946138.868556:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1200/0xd9f4181e0d27e2f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e2fd expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946138.868562:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40bcbe1200/0xd9f4181e0d27e2f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e2fd expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946138.868576:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946138.868578:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946138.868579:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946138.868597:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87d8d138-d2ce-4761-a98a-4e847b9142bd:3650:1877942638690560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790946138.868669:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946138.868858:0:20188:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638690560 00000100:00100000:3.0:1790946138.868867:0:20188:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638690560 00000100:00100000:3.0:1790946138.868925:0:20188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790946138.868940:0:20188:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:3650:x1877942638690560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946138.868954:0:20188:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946138.868968:0:20188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4092afc600/0xd9f4181e0d27e2fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27e2f6 expref: 24 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946138.868981:0:20188:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946138.869020:0:20188:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:87d8d138-d2ce-4761-a98a-4e847b9142bd+23:3650:x1877942638690560:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946138.869028:0:20188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790946138.869066:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87d8d138-d2ce-4761-a98a-4e847b9142bd:3650:1877942638690560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790946138.869452:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1877942638690432:0@lo:39:umount.0 00000100:00100000:0.0:1790946138.869497:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946138.873912:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638690432 00000100:00100000:2.0:1790946138.873930:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638690432 00000100:00100000:2.0:1790946138.874030:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790946138.874040:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1877942638690432:12345-0@lo:39:umount.0 00000020:00000080:2.0:1790946138.874070:0:17149:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e327 00000100:00080000:2.0:1790946138.874078:0:17149:0:(import.c:65:import_set_state_nolock()) ffff9d40bff0d000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1790946138.874246:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3646:x1877942638690432:12345-0@lo:39:umount.0 Request processed in 208us (4749us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946138.874256:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:2.0:1790946138.874266:0:17149:0:(genops.c:885:class_export_put()) final put ffff9d40bff0c800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:1.0:1790946138.874378:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bff0f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1790946138.874405:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1877942638690432:0@lo:39:umount.0 00010000:00010000:0.0:1790946138.874676:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790946138.874977:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bff0c800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1790946138.875038:0:15915:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40bff0d000 for lustre-MDT0000 00000100:00080000:3.0:1790946138.875054:0:20732:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790946138.875058:0:20732:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790946138.875062:0:20732:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790946138.877013:0:20732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27e247 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e24e expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946138.877032:0:20732:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27e247 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e24e expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946138.877040:0:20732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27e247 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e24e expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946138.877048:0:20732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27e247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e24e expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946138.877111:0:20732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790946138.877126:0:20732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080031600/0xd9f4181e0d27e661 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e676 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946138.877134:0:20732:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080031600/0xd9f4181e0d27e661 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e676 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946138.877141:0:20732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080031600/0xd9f4181e0d27e661 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e676 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946138.877159:0:20732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d4080031600/0xd9f4181e0d27e661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e676 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946138.877559:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790946138.877567:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27e247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e24e expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946138.877575:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65800 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:1.0:1790946138.877579:0:17135:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27e247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e24e expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946138.877596:0:17135:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27e247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27e24e expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790946138.877603:0:17135:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27e247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27e24e expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946138.877609:0:17135:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790946138.877612:0:17135:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1790946138.877645:0:17135:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27e247 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e24e expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946138.877651:0:17135:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790946138.877685:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27e247 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e24e expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946138.877692:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27e247 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e24e expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946138.877706:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946138.877709:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4080031600/0xd9f4181e0d27e661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e676 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946138.877715:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031600 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:1.0:1790946138.877719:0:17135:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4080031600/0xd9f4181e0d27e661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e676 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946138.877725:0:17135:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4080031600/0xd9f4181e0d27e661 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27e676 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790946138.877732:0:17135:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4080031600/0xd9f4181e0d27e661 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27e676 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946138.877744:0:17135:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1790946138.877746:0:17135:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1790946138.877759:0:17135:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d4080031600/0xd9f4181e0d27e661 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e676 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946138.877764:0:17135:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790946138.877770:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4080031600/0xd9f4181e0d27e661 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e676 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946138.877777:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946138.877779:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946138.877780:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946138.877835:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:87d8d138-d2ce-4761-a98a-4e847b9142bd:3647:1877942638690688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790946138.877901:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946138.877956:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790946138.877962:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:87d8d138-d2ce-4761-a98a-4e847b9142bd:3647:1877942638690816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790946138.877984:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946138.878098:0:17134:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638690688 00000100:00100000:1.0:1790946138.878106:0:17134:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638690688 00000100:00100000:1.0:1790946138.878208:0:17134:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638690816 00000100:00100000:1.0:1790946138.878212:0:17134:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638690816 00000100:00100000:1.0:1790946138.878239:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790946138.878249:0:17134:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87d8d138-d2ce-4761-a98a-4e847b9142bd+24:3647:x1877942638690688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790946138.878262:0:17134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946138.878288:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40bcbe1800/0xd9f4181e0d27e24e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27e247 expref: 24 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946138.878302:0:17134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946138.878343:0:17134:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87d8d138-d2ce-4761-a98a-4e847b9142bd+23:3647:x1877942638690688:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946138.878350:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790946138.878368:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790946138.878375:0:17134:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87d8d138-d2ce-4761-a98a-4e847b9142bd+22:3647:x1877942638690816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790946138.878403:0:17134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946138.878412:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4092afde00/0xd9f4181e0d27e676 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27e661 expref: 22 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946138.878421:0:17134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946138.878442:0:17134:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:3647:x1877942638690816:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946138.878448:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790946138.878484:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:87d8d138-d2ce-4761-a98a-4e847b9142bd:3647:1877942638690816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790946138.878493:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:87d8d138-d2ce-4761-a98a-4e847b9142bd:3647:1877942638690688:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946138.878913:0:20732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790946138.878921:0:20732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4080031600/0xd9f4181e0d27e661 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e676 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946138.878944:0:20732:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1790946138.878953:0:20732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27e7fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e805 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946138.878961:0:20732:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27e7fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e805 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946138.878967:0:20732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27e7fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e805 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946138.878973:0:20732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27e7fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e805 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946138.879039:0:20732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790946138.879053:0:20732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65400/0xd9f4181e0d27e239 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e240 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946138.879059:0:20732:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65400/0xd9f4181e0d27e239 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e240 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946138.879065:0:20732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65400/0xd9f4181e0d27e239 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e240 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946138.879071:0:20732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65400/0xd9f4181e0d27e239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e240 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946138.880687:0:17136:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790946138.880699:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27e7fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e805 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946138.880709:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1000 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790946138.880713:0:17136:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27e7fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e805 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946138.880722:0:17136:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27e7fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27e805 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946138.880729:0:17136:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27e7fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27e805 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946138.880734:0:17136:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790946138.880737:0:17136:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1790946138.880740:0:17136:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1790946138.880932:0:17136:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27e7fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e805 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946138.880940:0:17136:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790946138.880977:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27e7fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e805 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946138.880985:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40baef1000/0xd9f4181e0d27e7fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e805 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946138.880999:0:17136:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946138.881003:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65400/0xd9f4181e0d27e239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e240 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946138.881011:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65400 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:1.0:1790946138.881013:0:17136:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65400/0xd9f4181e0d27e239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e240 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946138.881040:0:17136:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65400/0xd9f4181e0d27e239 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27e240 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790946138.881046:0:17136:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65400/0xd9f4181e0d27e239 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27e240 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946138.881051:0:17136:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1790946138.881054:0:17136:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:1.0:1790946138.881068:0:17136:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65400/0xd9f4181e0d27e239 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e240 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946138.881073:0:17136:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790946138.881079:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65400/0xd9f4181e0d27e239 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e240 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946138.881086:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946138.881088:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946138.881090:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946138.881105:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87d8d138-d2ce-4761-a98a-4e847b9142bd:3650:1877942638691072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790946138.881205:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946138.881257:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790946138.881263:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87d8d138-d2ce-4761-a98a-4e847b9142bd:3650:1877942638690944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790946138.881298:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946138.881331:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638691072 00000100:00100000:1.0:1790946138.881337:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638691072 00000100:00100000:1.0:1790946138.881380:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638690944 00000100:00100000:1.0:1790946138.881383:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638690944 00000100:00100000:1.0:1790946138.881423:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790946138.881430:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83d42450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87d8d138-d2ce-4761-a98a-4e847b9142bd+22:3650:x1877942638691072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790946138.881452:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946138.881466:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4092afca00/0xd9f4181e0d27e240 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27e239 expref: 22 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946138.881479:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946138.881515:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83d42450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87d8d138-d2ce-4761-a98a-4e847b9142bd+21:3650:x1877942638691072:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946138.881522:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790946138.881565:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790946138.881570:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87d8d138-d2ce-4761-a98a-4e847b9142bd+20:3650:x1877942638690944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790946138.881576:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946138.881584:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40bcbe1000/0xd9f4181e0d27e805 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27e7fe expref: 20 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946138.881593:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946138.881611:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87d8d138-d2ce-4761-a98a-4e847b9142bd+19:3650:x1877942638690944:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946138.881616:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790946138.881651:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87d8d138-d2ce-4761-a98a-4e847b9142bd:3650:1877942638690944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790946138.881657:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87d8d138-d2ce-4761-a98a-4e847b9142bd:3650:1877942638691072:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790946138.882093:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946138.882155:0:20732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790946138.882163:0:20732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65400/0xd9f4181e0d27e239 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e240 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946138.885401:0:20732:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:3.0:1790946138.885411:0:20732:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1790946138.885413:0:20732:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1790946138.885458:0:20732:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1790946138.885463:0:20732:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1790946138.885467:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790946138.885473:0:20732:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1790946138.885481:0:20732:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9d3f83c3e000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790946138.885488:0:20732:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9d3f8224b000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790946138.885492:0:20732:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9d40871f9000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790946138.885496:0:20732:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9d40b4a28000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790946138.885503:0:20732:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9d40baa34000 ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713 192.168.204.20@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:3.0:1790946138.885508:0:20732:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9d40903f9800 ca604fcf-845a-4ff8-977f-a1d27931fa85 192.168.204.20@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:3.0:1790946138.885528:0:20732:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9d40bc9e19c0) has exports, disconnecting them 00000020:00080000:3.0:1790946138.885533:0:20732:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d3f83c3e000), last request at 1790946136 00000020:00000080:3.0:1790946138.885539:0:20732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e55e 00000100:00080000:3.0:1790946138.885559:0:20732:0:(import.c:65:import_set_state_nolock()) ffff9d3f83c39800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1790946138.885616:0:20732:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3f83c3e000): rc 0 00000020:00000080:3.0:1790946138.885619:0:20732:0:(genops.c:885:class_export_put()) final put ffff9d3f83c3e000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:1.0:1790946138.885840:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946138.885847:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1790946138.885890:0:20732:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d3f8224b000), last request at 1790946136 00000020:00000080:3.0:1790946138.885894:0:20732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e4c4 00000100:00080000:3.0:1790946138.885901:0:20732:0:(import.c:65:import_set_state_nolock()) ffff9d40baebd800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1790946138.885921:0:20732:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3f8224b000): rc 0 00000020:00000080:3.0:1790946138.885923:0:20732:0:(genops.c:885:class_export_put()) final put ffff9d3f8224b000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1790946138.885927:0:20732:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d40871f9000), last request at 1790946069 00000020:00000080:3.0:1790946138.885930:0:20732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e415 00000100:00080000:3.0:1790946138.885933:0:20732:0:(import.c:65:import_set_state_nolock()) ffff9d40871fd000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1790946138.885948:0:20732:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d40871f9000): rc 0 00000020:00000080:3.0:1790946138.885950:0:20732:0:(genops.c:885:class_export_put()) final put ffff9d40871f9000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1790946138.885954:0:20732:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d40b4a28000), last request at 1790946069 00000020:00000080:3.0:1790946138.885957:0:20732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e3b3 00000100:00080000:3.0:1790946138.885961:0:20732:0:(import.c:65:import_set_state_nolock()) ffff9d40bfee1800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790946138.885968:0:20732:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:3.0:1790946138.886053:0:20732:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d40b4a28000): rc 0 00000004:00000080:3.0:1790946138.886059:0:20732:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb827c8577ae0 00000100:00080000:3.0:1790946138.886078:0:20732:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790946138.886082:0:20732:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1790946138.886290:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946138.886296:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790946138.887097:0:20732:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1790946138.887130:0:20732:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a6800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1790946138.887233:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638691200:0@lo:39:umount.0 00000100:00100000:1.0:1790946138.887324:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790946138.887427:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790946138.887689:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f83c3e000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1790946138.887753:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f8224b000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1790946138.887775:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40871f9000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1790946138.887818:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f83c39800 for lustre-MDT0000 00000020:00000080:0.0:1790946138.887822:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40baebd800 for lustre-MDT0000 00000020:00000080:0.0:1790946138.887826:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40871fd000 for lustre-MDT0000 00000100:00080000:3.0:1790946138.888069:0:20732:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790946138.888081:0:20732:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:3.0:1790946138.888101:0:20732:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1790946138.888391:0:20732:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1790946138.888410:0:20732:0:(import.c:65:import_set_state_nolock()) ffff9d3f81b10000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1790946138.888485:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638691200 00000100:00100000:0.0:1790946138.888495:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638691200 00000100:00100000:0.0:1790946138.888546:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790946138.888556:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1877942638691200:12345-0@lo:39:umount.0 00000020:00000080:0.0:1790946138.888596:0:17153:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e43f 00000100:00080000:0.0:1790946138.888606:0:17153:0:(import.c:65:import_set_state_nolock()) ffff9d4099036800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790946138.888626:0:17153:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1790946138.888880:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638691328:0@lo:9:umount.0 00000100:00100000:1.0:1790946138.888918:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946138.888984:0:18666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638691328 00000100:00100000:2.0:1790946138.888989:0:18666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638691328 00000100:00100000:2.0:1790946138.889027:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790946138.889035:0:18666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1877942638691328:12345-0@lo:9:umount.0 00000020:00000080:2.0:1790946138.889050:0:18666:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e581 00000100:00080000:2.0:1790946138.889056:0:18666:0:(import.c:65:import_set_state_nolock()) ffff9d3f82766800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790946138.889092:0:18666:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1790946138.889245:0:18666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3646:x1877942638691328:12345-0@lo:9:umount.0 Request processed in 210us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946138.889252:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1790946138.889282:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790946138.889439:0:20732:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790946138.889443:0:20732:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:3.0:1790946138.889460:0:20732:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1790946138.889515:0:20732:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1790946138.889528:0:20732:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a7800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1790946138.889570:0:20732:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9d40bc9e19c0) has no exports 00000100:00100000:0.0:1790946138.889671:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3646:x1877942638691200:12345-0@lo:39:umount.0 Request processed in 1114us (2345us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1790946138.889678:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1790946138.889769:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a6800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1790946138.889777:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638691200:0@lo:39:umount.0 00000100:00100000:1.0:1790946138.889790:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638691456:0@lo:9:umount.0 00000100:00100000:1.0:1790946138.889818:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790946138.889852:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f81b10000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1790946138.889914:0:18669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638691456 00000100:00100000:3.0:1790946138.889919:0:18669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638691456 00000100:00100000:3.0:1790946138.889967:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790946138.889975:0:18669:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1877942638691456:12345-0@lo:9:umount.0 00000020:00000080:3.0:1790946138.889990:0:18669:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e588 00000100:00080000:3.0:1790946138.889997:0:18669:0:(import.c:65:import_set_state_nolock()) ffff9d3f820b9800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790946138.890029:0:18669:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1790946138.890129:0:18669:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3646:x1877942638691456:12345-0@lo:9:umount.0 Request processed in 156us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946138.890136:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1790946138.890289:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1790946138.890387:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00010000:00010000:3.0:1790946138.890405:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790946138.890500:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790946138.890505:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638691328:0@lo:9:umount.0 00000100:00080000:1.0:1790946138.890537:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bb1a7800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790946138.890553:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790946138.890555:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790946138.890557:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638691456:0@lo:9:umount.0 00010000:00010000:1.0:1790946138.890671:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946138.890676:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1790946138.902513:0:20732:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9d40bc9e19c0) has no exports 00000020:00000080:0.0:1790946138.951046:0:20732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e294 00000020:00000080:0.0:1790946138.951062:0:20732:0:(genops.c:885:class_export_put()) final put ffff9d40b4a2a800/lustre-QMT0000_UUID 00000020:01000000:0.0:1790946138.951129:0:20732:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1790946138.951423:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790946138.951437:0:20732:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790946138.951442:0:20732:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9d4084803380) has no exports 00000020:00000080:2.0:1790946138.951799:0:20732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e28d 00000020:00000080:2.0:1790946138.951806:0:20732:0:(genops.c:885:class_export_put()) final put ffff9d3f83e90800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790946138.951856:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40b4a2a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1790946138.952024:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f83e90800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790946138.952097:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790946138.952105:0:20732:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1790946138.952109:0:20732:0:(genops.c:885:class_export_put()) final put ffff9d3f83700000/lustre-QMT0000_UUID 00000020:00000080:2.0:1790946138.952112:0:20732:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f83700000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1790946138.952119:0:20732:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1790946139.424948:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946140.447333:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946141.024414:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638691584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790946141.024487:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946141.026141:0:19952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638691584 00000100:00100000:3.0:1790946141.026154:0:19952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638691584 00000100:00100000:3.0:1790946141.026255:0:19952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1790946141.026510:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790946141.026669:0:19952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638691584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790946141.026712:0:19952:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1790946141.026840:0:19952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638691584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 576us (2353us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946141.026848:0:19952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790946141.032747:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638691584:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1790946141.033157:0:17893:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1790946141.033188:0:17893:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1790946141.033193:0:17893:0:(genops.c:885:class_export_put()) final put ffff9d4099033800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1790946141.033216:0:17893:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713 00000001:00080000:0.0:1790946141.033224:0:17893:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1790946141.033227:0:17893:0:(genops.c:885:class_export_put()) final put ffff9d40baa36800/ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713 00000001:00100000:0.0:1790946141.033232:0:17893:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ca604fcf-845a-4ff8-977f-a1d27931fa85 00000001:00080000:0.0:1790946141.033237:0:17893:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1790946141.033239:0:17893:0:(genops.c:885:class_export_put()) final put ffff9d3f82764800/ca604fcf-845a-4ff8-977f-a1d27931fa85 00000020:00000080:1.0:1790946141.033630:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4099033800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1790946141.033689:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40baa36800/ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713 for lustre-MDT0001 00000020:00000080:1.0:1790946141.033723:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f82764800/ca604fcf-845a-4ff8-977f-a1d27931fa85 for lustre-MDT0001 00000020:00000080:1.0:1790946141.033750:0:15915:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d4099036800 for lustre-MDT0001 00000020:00000080:1.0:1790946141.033755:0:15915:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40baa35000 for lustre-MDT0001 00000020:00000080:1.0:1790946141.033759:0:15915:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f82489800 for lustre-MDT0001 00000001:00100000:2.0:1790946141.038015:0:17127:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790946141.038036:0:17127:0:(genops.c:885:class_export_put()) final put ffff9d40b4a28000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1790946141.038066:0:17127:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713 00000001:00080000:2.0:1790946141.038076:0:17127:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:2.0:1790946141.038079:0:17127:0:(genops.c:885:class_export_put()) final put ffff9d40baa34000/ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713 00000001:00100000:2.0:1790946141.038086:0:17127:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ca604fcf-845a-4ff8-977f-a1d27931fa85 00000001:00080000:2.0:1790946141.038092:0:17127:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:2.0:1790946141.038097:0:17127:0:(genops.c:885:class_export_put()) final put ffff9d40903f9800/ca604fcf-845a-4ff8-977f-a1d27931fa85 00000020:00000080:0.0:1790946141.038301:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40b4a28000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1790946141.038357:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40baa34000/ae7e6f3e-0cbf-47a7-9ca5-aa48d6770713 for lustre-MDT0000 00000020:00000080:0.0:1790946141.038383:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40903f9800/ca604fcf-845a-4ff8-977f-a1d27931fa85 for lustre-MDT0000 00000020:00000080:0.0:1790946141.038408:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40bfee1800 for lustre-MDT0000 00000020:00000080:0.0:1790946141.038413:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40baa31800 for lustre-MDT0000 00000020:00000080:0.0:1790946141.038416:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40903f9000 for lustre-MDT0000 00000040:00080000:2.0:1790946141.343877:0:17919:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790946141.471611:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946141.535578:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638691712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790946141.535676:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946141.535930:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638691840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790946141.535962:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946141.536165:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638692224:0@lo:400:kworker.0 00000100:00100000:1.0:1790946141.536230:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946141.536251:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638692736:0@lo:400:kworker.0 00000100:00100000:1.0:1790946141.536278:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946141.536312:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790946141.536318:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638692096:0@lo:400:kworker.0 00000100:00100000:1.0:1790946141.536348:0:18667:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638692224 00000100:00100000:1.0:1790946141.536355:0:18667:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638692224 00000100:00100000:1.0:1790946141.536406:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790946141.536415:0:18667:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638692224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946141.536473:0:18667:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638692224:12345-0@lo:400:kworker.0 Request processed in 59us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946141.536482:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790946141.536504:0:20141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638692736 00000100:00100000:1.0:1790946141.536507:0:20141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638692736 00000100:00100000:1.0:1790946141.536529:0:20141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790946141.536533:0:20141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1877942638692736:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1790946141.536538:0:20141:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790946141.536566:0:20141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1877942638692736:12345-0@lo:400:kworker.0 Request processed in 31us (287us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790946141.536572:0:20141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790946141.536592:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87d8d138-d2ce-4761-a98a-4e847b9142bd:3650:1877942638691968:0@lo:400:kworker.0 00000100:00100000:1.0:1790946141.536635:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946141.536665:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638692480:0@lo:400:kworker.0 00000100:00100000:1.0:1790946141.536690:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946141.536707:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790946141.536729:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638692352:0@lo:400:kworker.0 00000100:00100000:1.0:1790946141.536758:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946141.536776:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638692864:0@lo:400:kworker.0 00000100:00100000:1.0:1790946141.536801:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946141.536825:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638691968 00000100:00100000:1.0:1790946141.536829:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638691968 00000100:00100000:1.0:1790946141.536854:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1790946141.536860:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8238b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+19:3650:x1877942638691968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946141.536896:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8238b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d8d138-d2ce-4761-a98a-4e847b9142bd+19:3650:x1877942638691968:12345-0@lo:400:kworker.0 Request processed in 36us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946141.536903:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1790946141.536927:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638692480 00000100:00100000:1.0:1790946141.536931:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638692480 00000100:00100000:1.0:1790946141.536946:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638692352 00000100:00100000:1.0:1790946141.536948:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638692352 00000100:00100000:1.0:1790946141.536956:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638692864 00000100:00100000:1.0:1790946141.536959:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638692864 00000100:00100000:1.0:1790946141.536983:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790946141.536989:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638692864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946141.537019:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638692864:12345-0@lo:400:kworker.0 Request processed in 30us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946141.537024:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790946141.537036:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790946141.537039:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1877942638692480:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1790946141.537044:0:17149:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790946141.537064:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1877942638692480:12345-0@lo:400:kworker.0 Request processed in 23us (374us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790946141.537070:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790946141.537103:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790946141.537109:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1877942638692352:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1790946141.537113:0:17149:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790946141.537137:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1877942638692352:12345-0@lo:400:kworker.0 Request processed in 27us (378us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790946141.537142:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1790946141.537164:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790946141.537224:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790946141.537229:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d40871fd800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1790946141.537233:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1790946141.537908:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946141.537995:0:18671:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638691712 00000100:00100000:3.0:1790946141.538003:0:18671:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638691712 00000100:00100000:3.0:1790946141.538046:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790946141.538053:0:18671:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638691712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790946141.538082:0:18671:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1790946141.538137:0:18671:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638691712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (2461us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946141.538143:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1790946141.538193:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790946141.545795:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638692608:0@lo:400:kworker.0 00000100:00100000:2.0:1790946141.545872:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946141.545923:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638692224:0@lo:400:kworker.0 00000100:00080000:2.0:1790946141.545937:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790946141.545942:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9d3f82763800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1790946141.545946:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1790946141.545952:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9d3f82763800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790946141.545957:0:3648:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 550 00000100:00080000:2.0:1790946141.545967:0:3648:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d3f82763800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790946141.545998:0:3648:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40bff70700 x1877942638692992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790946141.546037:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638692736:0@lo:400:kworker.0 00000100:00100000:2.0:1790946141.546078:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638691712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790946141.546136:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638692608 00000100:00100000:2.0:1790946141.546142:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638692608 00000100:00100000:2.0:1790946141.546217:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790946141.546226:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638692608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946141.546300:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877942638692608:12345-0@lo:400:kworker.0 Request processed in 75us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946141.546309:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1790946141.546332:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1790946141.546352:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8450ea00 x1877942638692608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946141.546362:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1877942638692608:0@lo:400:kworker.0 00000100:00100000:2.0:1790946141.546401:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1877942638692992:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1790946141.546426:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946141.546455:0:20141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638692992 00000100:00100000:2.0:1790946141.546459:0:20141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638692992 00000100:00100000:2.0:1790946141.546478:0:20141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790946141.546483:0:20141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1877942638692992:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1790946141.546496:0:20141:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1790946141.550959:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638691840 00000100:00100000:0.0:1790946141.550979:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638691840 00000100:00100000:0.0:1790946141.551429:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638692096 00000100:00100000:0.0:1790946141.551434:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638692096 00000100:00100000:0.0:1790946141.551451:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790946141.551458:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1877942638691840:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1790946141.551466:0:17153:0:(tgt_handler.c:821:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1790946141.551791:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1877942638691840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 331us (15825us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790946141.551799:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790946141.551819:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790946141.551824:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1877942638692096:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1790946141.551830:0:17153:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1790946141.551863:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1877942638692096:12345-0@lo:400:kworker.0 Request processed in 38us (13957us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790946141.551869:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:02020000:0.0:1790946141.551913:0:3649:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1790946141.551930:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790946141.551934:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9d40914e4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790946141.551938:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1790946141.551944:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9d40914e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790946141.551948:0:3649:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 520 00000100:00080000:0.0:1790946141.551957:0:3649:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9d40914e4000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1790946141.552036:0:3649:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40812e8e00 x1877942638693120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790946141.552604:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638693120:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1790946141.552647:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790946141.552686:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1790946141.552688:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638693120 00000100:00080000:3.0:1790946141.552691:0:3648:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9d40914e4000 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:3.0:1790946141.552698:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638692096:0@lo:400:kworker.0 00000100:00100000:0.0:1790946141.552892:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638693120 00000100:00100000:0.0:1790946141.552919:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790946141.552925:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1877942638693120:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1790946141.552939:0:17153:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1790946141.552974:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1877942638693120:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 48us (327us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790946141.553037:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1790946141.553074:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40914e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790946141.553079:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790946141.553082:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638693120:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1790946141.561666:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d40871fd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790946141.561676:0:3650:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 520 00000100:00080000:1.0:1790946141.561692:0:3650:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9d40871fd800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1790946141.562586:0:3650:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f8441f800 x1877942638693248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790946141.562659:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1877942638693248:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1790946141.562742:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946141.563024:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638693248 00000100:00100000:3.0:1790946141.563033:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638693248 00000100:00100000:3.0:1790946141.563088:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790946141.563105:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1877942638693248:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1790946141.563120:0:17149:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1790946141.563402:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638692352:0@lo:400:kworker.0 00010000:00080000:1.0:1790946141.563431:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8450c700 x1877942638692864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946141.563443:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638692864:0@lo:400:kworker.0 00000100:00100000:1.0:1790946141.563454:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87d8d138-d2ce-4761-a98a-4e847b9142bd:3650:1877942638691968:0@lo:400:kworker.0 00000100:00080000:1.0:1790946141.563465:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790946141.563469:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d40bae3a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1790946141.563472:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1790946141.563490:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d40bae3a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790946141.563494:0:3650:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 534 00000100:00080000:1.0:1790946141.563502:0:3650:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d40bae3a800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1790946141.563520:0:3650:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f8441ed80 x1877942638693376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790946141.566523:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1877942638693376:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1790946141.566603:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946141.568547:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1877942638693248:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 5435us (5798us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790946141.568561:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790946141.568593:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638693376 00000100:00100000:3.0:1790946141.568602:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638693376 00000100:00100000:1.0:1790946141.571775:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638692480:0@lo:400:kworker.0 00000100:00080000:0.0:1790946141.571990:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40871fd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790946141.571998:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790946141.572001:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1877942638693248:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1790946141.572508:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790946141.572516:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1877942638693376:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1790946141.572534:0:17149:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1790946141.572620:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1877942638693376:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 102us (6016us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790946141.572628:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1790946141.572689:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bae3a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790946141.572694:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790946141.572698:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1877942638693376:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1790946141.588862:0:20141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1877942638692992:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 42369us (42427us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790946141.588878:0:20141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1790946141.589475:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f82763800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790946141.589483:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790946141.589488:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1877942638692992:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:3.0:1790946142.495399:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946143.520758:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946144.544966:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1790946144.991440:0:20732:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9d40bc90c840 - data ffff9d408f6c06c0/ffff9d40862c8800 00000020:01000000:2.0:1790946144.991610:0:20732:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9d40bc848b40 - data ffff9d3f81c86948/ffff9d40b55aa800 00000001:00000004:2.0:1790946145.003840:0:20732:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:1.0:1790946145.081701:0:20732:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790946145.081709:0:20732:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790946145.081723:0:20732:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9d3f84e25180 x1877942638691200/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790946148 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946145.081753:0:20732:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1790946145.089298:0:20732:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790946145.089307:0:20732:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1790946145.089324:0:20732:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790946145.089327:0:20732:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1790946145.092911:0:17171:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1790946145.092920:0:17171:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1790946145.092936:0:17171:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1790946145.094399:0:20732:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790946145.094407:0:20732:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:1.0:1790946145.094429:0:20732:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790946145.094432:0:20732:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1790946145.095089:0:17173:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1790946145.095096:0:17173:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:2.0:1790946145.095108:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1790946145.098728:0:20732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e25c 00000020:00000080:0.0:1790946145.098752:0:20732:0:(genops.c:885:class_export_put()) final put ffff9d40bacd4000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790946145.099336:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bacd4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790946145.099956:0:20732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e271 00000020:00000080:0.0:1790946145.099966:0:20732:0:(genops.c:885:class_export_put()) final put ffff9d4085505000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790946145.100030:0:20732:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1790946145.100037:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790946145.100045:0:20732:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790946145.100049:0:20732:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9d40bc9e0000) has no exports 00000004:01000000:0.0:1790946145.100510:0:20732:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1790946145.100520:0:20732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e2d3 00000020:00000080:0.0:1790946145.100525:0:20732:0:(genops.c:885:class_export_put()) final put ffff9d3f83d20800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790946145.101208:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4085505000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1790946145.101428:0:20732:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1790946145.101436:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790946145.101446:0:20732:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790946145.101450:0:20732:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9d40b4418000) has no exports 00000020:00000080:0.0:1790946145.101459:0:20732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e2cc 00000020:00000080:0.0:1790946145.101465:0:20732:0:(genops.c:885:class_export_put()) final put ffff9d40bb1a1000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790946145.101689:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f83d20800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1790946145.101702:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bb1a1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1790946145.101955:0:20732:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1790946145.101959:0:20732:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790946145.101964:0:20732:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:0.0:1790946145.101968:0:20732:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790946145.101971:0:20732:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790946145.102324:0:15915:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40bb1a7800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1790946145.102395:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790946145.102403:0:20732:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790946145.102407:0:20732:0:(genops.c:885:class_export_put()) final put ffff9d3f8248c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790946145.102410:0:20732:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f8248c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1790946145.102417:0:20732:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790946145.102515:0:20732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e2be 00000020:00000080:0.0:1790946145.102522:0:20732:0:(genops.c:885:class_export_put()) final put ffff9d3f82488000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790946145.102538:0:20732:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1790946145.102542:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790946145.102547:0:20732:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790946145.102550:0:20732:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9d3f836ccd40) has no exports 00000020:00000080:0.0:1790946145.102566:0:20732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e2b7 00000020:00000080:0.0:1790946145.102569:0:20732:0:(genops.c:885:class_export_put()) final put ffff9d40bacd2800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790946145.102698:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f82488000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1790946145.102705:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bacd2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1790946145.103403:0:20732:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1790946145.103408:0:20732:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790946145.103413:0:20732:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1790946145.103420:0:20732:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790946145.103422:0:20732:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790946145.103497:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790946145.103504:0:20732:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1790946145.103518:0:20732:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1790946145.103525:0:20732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e2a9 00000020:00000080:0.0:1790946145.103531:0:20732:0:(genops.c:885:class_export_put()) final put ffff9d40b4a29800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790946145.107748:0:15915:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f81b10000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1790946145.107781:0:15915:0:(genops.c:885:class_export_put()) final put ffff9d40b4a2e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790946145.107784:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40b4a2e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1790946145.107792:0:15915:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1790946145.111502:0:20732:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1790946145.111517:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790946145.111529:0:20732:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790946145.111534:0:20732:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff9d3f836c99c0) has no exports 00000020:00000080:0.0:1790946145.111543:0:20732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e2a2 00000020:00000080:0.0:1790946145.111551:0:20732:0:(genops.c:885:class_export_put()) final put ffff9d40bb1a0000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790946145.115362:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40b4a29800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1790946145.118084:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bb1a0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1790946145.120543:0:20732:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1790946145.120552:0:20732:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790946145.120557:0:20732:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790946145.120566:0:20732:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790946145.120620:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790946145.120631:0:20732:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790946145.120669:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790946145.120674:0:20732:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790946145.120679:0:20732:0:(genops.c:885:class_export_put()) final put ffff9d40bacd7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790946145.120683:0:20732:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bacd7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1790946145.120692:0:20732:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790946145.120800:0:20732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e278 00000020:00000080:1.0:1790946145.120807:0:20732:0:(genops.c:885:class_export_put()) final put ffff9d4085501000/lustre-MDD0000_UUID 00000020:01000000:1.0:1790946145.120811:0:20732:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1790946145.120815:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790946145.120819:0:20732:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790946145.120823:0:20732:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9d40b441cd40) has no exports 00000020:00000080:1.0:1790946145.120842:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790946145.120845:0:20732:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1790946145.120849:0:20732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e27f 00000020:00000080:1.0:1790946145.120852:0:20732:0:(genops.c:885:class_export_put()) final put ffff9d4085506000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1790946145.120860:0:20732:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3f81bb7000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1790946145.120863:0:20732:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d3f81bb7000 3 00000020:01000004:1.0:1790946145.120866:0:20732:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d3f81bb7000 from lustre-MDT0000 00000020:00000080:1.0:1790946145.120885:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790946145.120896:0:20732:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1790946145.120899:0:20732:0:(genops.c:885:class_export_put()) final put ffff9d40bacd6800/lustre-MDT0000_UUID 00000020:00000080:1.0:1790946145.120902:0:20732:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bacd6800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1790946145.120909:0:20732:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1790946145.120942:0:20732:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1790946145.120945:0:20732:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1790946145.120948:0:20732:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1790946145.120950:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790946145.120953:0:20732:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790946145.120960:0:20732:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9d40914a0800 87d8d138-d2ce-4761-a98a-4e847b9142bd 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790946145.120966:0:20732:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9d40bfe93380) has exports, disconnecting them 00000020:00080000:1.0:1790946145.120971:0:20732:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9d40914a0800), last request at 1790946054 00000020:00000080:1.0:1790946145.120996:0:20732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e21d 00000020:00010000:1.0:1790946145.121001:0:20732:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9d40914a0800: total 2 00000100:00080000:1.0:1790946145.121005:0:20732:0:(import.c:65:import_set_state_nolock()) ffff9d40914a5800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1790946145.121031:0:20732:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d40914a0800): rc 0 00000020:00080000:1.0:1790946145.121036:0:20732:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9d40bfe93380) has no exports 00000100:00100000:1.0:1790946145.121099:0:17140:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff9d40bc905c00:17140] 0 exiting: rc = 1 00000100:00100000:1.0:1790946145.121323:0:17142:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff9d408aba1400:17142] 2 exiting: rc = 0 00000100:00100000:2.0:1790946145.121676:0:17141:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff9d408aba0400:17141] 1 exiting: rc = 0 00000020:00000080:2.0:1790946145.121850:0:15915:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40bb1a6800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1790946145.121858:0:15915:0:(genops.c:885:class_export_put()) final put ffff9d40bacd3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790946145.121861:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bacd3800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1790946145.121866:0:15915:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790946145.121923:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4085501000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1790946145.121927:0:15915:0:(genops.c:885:class_export_put()) final put ffff9d40914a5000/lustre-MDD0000_UUID 00000020:00000080:2.0:1790946145.121929:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40914a5000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1790946145.121932:0:15915:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1790946145.121961:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4085506000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1790946145.121992:0:18315:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9d40914a0800: total 0 00010000:00010000:2.0:1790946145.121996:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946145.122016:0:18315:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d40914a0800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1790946145.122056:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3f83c64600/0xd9f4181e0d27e485 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27e47e expref: 14 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946145.122072:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40bcbe1600/0xd9f4181e0d27e343 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27e33c expref: 13 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946145.122098:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40bcbe1a00/0xd9f4181e0d27e351 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27e34a expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946145.122109:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40bcbe0e00/0xd9f4181e0d27e35f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27e358 expref: 11 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946145.122130:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40bcbe1e00/0xd9f4181e0d27e232 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27e22b expref: 10 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946145.122141:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3f83c64000/0xd9f4181e0d27e51f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27e518 expref: 9 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946145.122150:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3f83c64200/0xd9f4181e0d27e4af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27e4a8 expref: 8 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946145.122161:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40bcbe0400/0xd9f4181e0d27e7db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27e7d4 expref: 7 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946145.122194:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d4092afda00/0xd9f4181e0d27e400 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27e3f9 expref: 6 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946145.122205:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d7400/0xd9f4181e0d27e629 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27e622 expref: 5 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946145.122503:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40bcbe0600/0xd9f4181e0d27e7e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27e7e2 expref: 4 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946145.122805:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40bcbe0c00/0xd9f4181e0d27e549 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27e542 expref: 3 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946145.122834:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef0a00/0xd9f4181e0d27e7f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd9f4181e0d27e7f0 expref: 2 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946145.122844:0:18315:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d40914a0800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1790946145.122862:0:18315:0:(genops.c:885:class_export_put()) final put ffff9d40914a0800/87d8d138-d2ce-4761-a98a-4e847b9142bd 00010000:00010000:2.0:1790946145.122874:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946145.122876:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946145.122878:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790946145.122883:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40914a0800/87d8d138-d2ce-4761-a98a-4e847b9142bd for MGS 00000020:00000080:2.0:1790946145.122917:0:15915:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40914a5800 for MGS 00000100:00100000:1.0:1790946145.123724:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123733:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123740:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123762:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123769:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123775:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123781:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123787:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123793:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123799:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123805:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123810:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123816:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123831:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123837:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123843:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123848:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123853:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123859:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123864:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123870:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123875:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123881:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123886:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123891:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123897:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123902:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123907:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123913:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123919:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123925:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123932:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123937:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123943:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123948:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123953:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123960:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123966:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123972:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123977:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123983:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.123988:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.124304:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.124313:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.124319:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.124324:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.124330:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.124336:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.124352:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.124357:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.124363:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.124368:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.124373:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.124379:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.124384:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.124390:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.124395:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.124401:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.124407:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.124412:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.124417:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.124422:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.124427:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946145.124434:0:20732:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000001:00100000:2.0:1790946145.125738:0:18663:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790946145.125749:0:18663:0:(genops.c:885:class_export_put()) final put ffff9d3f82761800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790946145.126488:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f82761800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1790946145.126535:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f82766800 for lustre-OST0000 00000001:00100000:2.0:1790946145.126613:0:19480:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790946145.126627:0:19480:0:(genops.c:885:class_export_put()) final put ffff9d3f820bb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790946145.126651:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f820bb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1790946145.126682:0:15915:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f820b9800 for lustre-OST0001 00000020:01000000:2.0:1790946145.127738:0:20732:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9d3f831e18a0 - data ffff9d408f4e5ca8/ffff9d3f827abc00 00000020:01000000:2.0:1790946145.127874:0:20732:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9d4099dc30c0 - data ffff9d408f747870/ffff9d3f83f21000 00000020:00000080:2.0:1790946145.128619:0:20732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e208 00000020:00000080:2.0:1790946145.128629:0:20732:0:(genops.c:885:class_export_put()) final put ffff9d3f81bb6000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790946145.128648:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f81bb6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:2.0:1790946145.128713:0:20732:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3f81bb7000 from MGS, refs=2 00000020:01000004:2.0:1790946145.128717:0:20732:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d3f81bb7000 2 00000020:01000004:2.0:1790946145.128721:0:20732:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d3f81bb7000 from MGS 00000020:00000080:2.0:1790946145.128743:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790946145.128750:0:20732:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1790946145.128753:0:20732:0:(genops.c:885:class_export_put()) final put ffff9d3f81bb5800/MGS 00000020:00000080:2.0:1790946145.128755:0:20732:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f81bb5800/MGS for MGS 00000020:01000000:2.0:1790946145.128778:0:20732:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1790946145.128848:0:20732:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1790946145.128852:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790946145.128859:0:20732:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790946145.128867:0:20732:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9d40bff0b800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790946145.128873:0:20732:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff9d3f836c8000) has exports, disconnecting them 00000020:00080000:2.0:1790946145.128878:0:20732:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9d40bff0b800), last request at 1790946054 00000020:00000080:2.0:1790946145.128882:0:20732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e30b 00000020:00080000:2.0:1790946145.128891:0:20732:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d40bff0b800): rc 0 00000020:00000080:2.0:1790946145.128895:0:20732:0:(genops.c:885:class_export_put()) final put ffff9d40bff0b800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1790946145.128920:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bff0b800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1790946145.134224:0:20732:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1790946145.134235:0:20732:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790946145.134240:0:20732:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790946145.134247:0:20732:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790946145.134278:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40bff0f000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1790946145.134457:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790946145.134466:0:20732:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1790946145.134471:0:20732:0:(genops.c:885:class_export_put()) final put ffff9d3f81b11000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1790946145.134474:0:20732:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f81b11000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1790946145.134483:0:20732:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1790946145.134563:0:20732:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d3f81bb7000 1 00000020:00000080:1.0:1790946145.134568:0:20732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e1fa 00000020:00000080:1.0:1790946145.134575:0:20732:0:(genops.c:885:class_export_put()) final put ffff9d3f81bb4000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1790946145.134582:0:20732:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1790946145.134599:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f81bb4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790946145.134608:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790946145.134612:0:20732:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790946145.134616:0:20732:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9d40bfe90000) has no exports 00000020:00000080:1.0:1790946145.271556:0:20732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790946145.271569:0:20732:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1790946145.271575:0:20732:0:(genops.c:885:class_export_put()) final put ffff9d3f81bb1800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790946145.271580:0:20732:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f81bb1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1790946145.271593:0:20732:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1790946145.271714:0:20732:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d3f81bb0000 00000020:02000400:1.0:1790946145.272768:0:20732:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1790946145.567285:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946146.143625:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790946146.143657:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638693504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790946146.143730:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946146.143784:0:19952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638693504 00000100:00100000:0.0:1790946146.143791:0:19952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638693504 00000100:00100000:0.0:1790946146.143853:0:19952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790946146.143861:0:19952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638693504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790946146.143888:0:19952:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790946146.143939:0:19952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638693504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946146.143946:0:19952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1790946146.143968:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790946146.144370:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638693504:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1790946146.599648:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790946146.659322:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790946146.659331:0:15915:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790946146.659336:0:15915:0:(import.c:65:import_set_state_nolock()) ffff9d40914e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790946146.659345:0:15915:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 592 00000100:00080000:1.0:1790946146.659350:0:15915:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790946146.659362:0:15915:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9d40914e4000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1790946146.659389:0:15915:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f8441c380 x1877942638693760/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790946146.659412:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:87d8d138-d2ce-4761-a98a-4e847b9142bd:3647:1877942638693632:0@lo:400:kworker.0 00000100:00080000:1.0:1790946146.659440:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790946146.659444:0:15915:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790946146.659446:0:15915:0:(import.c:65:import_set_state_nolock()) ffff9d40871fd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790946146.659450:0:15915:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 592 00000100:00080000:1.0:1790946146.659453:0:15915:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790946146.659459:0:15915:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9d40871fd800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1790946146.659483:0:15915:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f8441d500 x1877942638694144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:3.0:1790946146.659484:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877942638693632 offset 0 length 224: 4 00000100:00080000:1.0:1790946146.659500:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790946146.659504:0:15915:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790946146.659506:0:15915:0:(import.c:65:import_set_state_nolock()) ffff9d40bae3a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790946146.659510:0:15915:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 592 00000100:00080000:1.0:1790946146.659513:0:15915:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790946146.659518:0:15915:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d40bae3a800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790946146.659542:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790946146.659549:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638693888:0@lo:400:kworker.0 00000100:00100000:3.0:1790946146.659582:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946146.659617:0:18669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638693888 00000100:00100000:3.0:1790946146.659624:0:18669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638693888 00000100:00100000:3.0:1790946146.659665:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790946146.659674:0:18669:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638693888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946146.659725:0:18669:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638693888:12345-0@lo:400:kworker.0 Request processed in 52us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946146.659731:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790946146.659770:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638693888:0@lo:400:kworker.0 00000100:00100000:1.0:1790946146.659880:0:15915:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f8441fb80 x1877942638694272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790946146.659899:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790946146.659902:0:15915:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790946146.659904:0:15915:0:(import.c:65:import_set_state_nolock()) ffff9d3f82763800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790946146.659918:0:15915:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 592 00000100:00080000:1.0:1790946146.659921:0:15915:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790946146.659925:0:15915:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d3f82763800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1790946146.659940:0:15915:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f8441dc00 x1877942638694528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790946146.659983:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638694016:0@lo:400:kworker.0 00000100:00100000:1.0:1790946146.660026:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946146.660036:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638694656:0@lo:400:kworker.0 00000100:00100000:1.0:1790946146.660055:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790946146.660064:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638694400:0@lo:400:kworker.0 00000100:00100000:3.0:1790946146.660072:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946146.660127:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638693760:0@lo:38:kworker.0 00000100:00100000:3.0:1790946146.660206:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638694656 00000100:00100000:3.0:1790946146.660211:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638694656 00000100:00100000:3.0:1790946146.660258:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790946146.660265:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638694656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946146.660310:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638694656:12345-0@lo:400:kworker.0 Request processed in 46us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946146.660316:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:3.0:1790946146.660342:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9d3f8441ed80 x1877942638694656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946146.660352:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638694656:0@lo:400:kworker.0 00000100:00100000:1.0:1790946146.662368:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946146.662444:0:19563:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638694016 00000100:00100000:1.0:1790946146.662454:0:19563:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638694016 00000100:00100000:1.0:1790946146.662534:0:19563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790946146.662647:0:17149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638694400 00000100:00100000:2.0:1790946146.662664:0:17149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638694400 00000100:00100000:3.0:1790946146.662848:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790946146.662862:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638694784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790946146.662894:0:19563:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638694016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946146.662917:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946146.662935:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790946146.662946:0:17149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638694400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946146.662955:0:18670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638694784 00000100:00100000:3.0:1790946146.662960:0:18670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638694784 00000100:00100000:1.0:1790946146.662975:0:19563:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3649:x1877942638694016:12345-0@lo:400:kworker.0 Request processed in 433us (2948us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946146.662984:0:19563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790946146.663007:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790946146.663016:0:18670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638694784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790946146.663042:0:18670:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1790946146.663045:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638694016:0@lo:400:kworker.0 00000100:00100000:3.0:1790946146.663082:0:18670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638694784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946146.663099:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790946146.663131:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638694784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790946146.663241:0:17149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638694400:12345-0@lo:400:kworker.0 Request processed in 298us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946146.663247:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:1.0:1790946146.663427:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9d3f8441e680 x1877942638694400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946146.663438:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638694400:0@lo:400:kworker.0 00000100:00080000:2.0:1790946146.664362:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790946146.664372:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790946146.665775:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946146.666022:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1877942638694144:0@lo:38:kworker.0 00000100:00100000:0.0:1790946146.666066:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946146.666129:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1877942638694272:0@lo:38:kworker.0 00000100:00100000:0.0:1790946146.666153:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946146.666246:0:17153:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638693760 00000100:00100000:2.0:1790946146.666256:0:17153:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638693760 00000100:00100000:2.0:1790946146.666299:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790946146.666306:0:17153:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1877942638693760:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790946146.666331:0:17153:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790946146.667155:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638694144 00000100:00100000:3.0:1790946146.667163:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638694144 00000100:00100000:3.0:1790946146.667210:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638694272 00000100:00100000:3.0:1790946146.667214:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638694272 00000100:00100000:3.0:1790946146.667307:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790946146.667314:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1877942638694144:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1790946146.667331:0:17147:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790946146.667523:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1877942638694144:12345-0@lo:38:kworker.0 Request processed in 207us (1455us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790946146.667531:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790946146.667550:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790946146.667555:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1877942638694272:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1790946146.667565:0:17147:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790946146.667591:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1877942638694272:12345-0@lo:38:kworker.0 Request processed in 34us (1436us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790946146.667596:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1790946146.667684:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bae3a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790946146.667689:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790946146.667693:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1877942638694272:0@lo:38:kworker.0 00000100:00100000:0.0:1790946146.667701:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1877942638694528:0@lo:38:kworker.0 00000100:00100000:0.0:1790946146.667728:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790946146.667819:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40871fd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790946146.667824:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790946146.667827:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1877942638694144:0@lo:38:kworker.0 00000100:00100000:3.0:1790946146.667912:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638694528 00000100:00100000:3.0:1790946146.667916:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638694528 00000100:00100000:3.0:1790946146.667972:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790946146.667976:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1877942638694528:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1790946146.667987:0:17147:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790946146.668029:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1877942638694528:12345-0@lo:38:kworker.0 Request processed in 51us (299us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790946146.668036:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1790946146.668157:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f82763800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790946146.668162:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790946146.668189:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1877942638694528:0@lo:38:kworker.0 00000100:00100000:2.0:1790946146.696076:0:17153:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1877942638693760:12345-0@lo:38:kworker.0 Request processed in 29760us (30297us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790946146.696104:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1790946146.696230:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40914e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790946146.696236:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790946146.696240:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638693760:0@lo:38:kworker.0 00010000:00010000:2.0:1790946147.616364:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946148.640310:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790946149.199377:0:20933:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790946149.218455:0:20933:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1790946149.218517:0:20933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64400/0xd9f4181e0d27e3f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e400 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.218532:0:20933:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64400/0xd9f4181e0d27e3f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e400 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.218539:0:20933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64400/0xd9f4181e0d27e3f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e400 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.218564:0:20933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64400/0xd9f4181e0d27e3f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e400 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.218659:0:20933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790946149.218665:0:20933:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790946149.218690:0:20933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790946149.218694:0:20933:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790946149.218698:0:20933:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790946149.218705:0:20933:0:(import.c:65:import_set_state_nolock()) ffff9d40871fd800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1790946149.218709:0:20933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790946149.218711:0:20933:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790946149.218714:0:20933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790946149.219591:0:17136:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946149.219601:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64400/0xd9f4181e0d27e3f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e400 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946149.219611:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64400 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:2.0:1790946149.219615:0:17136:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64400/0xd9f4181e0d27e3f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e400 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946149.219626:0:17136:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64400/0xd9f4181e0d27e3f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27e400 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946149.219635:0:17136:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64400/0xd9f4181e0d27e3f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27e400 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946149.219641:0:17136:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790946149.219644:0:17136:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790946149.219646:0:17136:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790946149.219687:0:17136:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64400/0xd9f4181e0d27e3f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e400 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946149.219694:0:17136:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946149.219725:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64400/0xd9f4181e0d27e3f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e400 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946149.219731:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64400/0xd9f4181e0d27e3f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e400 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946149.219744:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946149.219756:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946149.219758:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946149.220015:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87d8d138-d2ce-4761-a98a-4e847b9142bd:3649:1877942638694912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790946149.220093:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946149.221067:0:20188:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638694912 00000100:00100000:2.0:1790946149.221080:0:20188:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638694912 00000100:00100000:2.0:1790946149.221135:0:20188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790946149.221143:0:20188:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3649:x1877942638694912:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790946149.221150:0:20188:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790946149 with bad export cookie 15705204317896565277 00010000:00010000:3.0:1790946149.222411:0:20933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afd600/0xd9f4181e0d27e358 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e35f expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.222426:0:20933:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afd600/0xd9f4181e0d27e358 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e35f expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.222433:0:20933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afd600/0xd9f4181e0d27e358 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e35f expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.222439:0:20933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d4092afd600/0xd9f4181e0d27e358 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e35f expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.223599:0:20933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790946149.223613:0:20933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080030200/0xd9f4181e0d27e622 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e629 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.223644:0:20933:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080030200/0xd9f4181e0d27e622 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e629 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.223651:0:20933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080030200/0xd9f4181e0d27e622 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e629 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.223658:0:20933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d4080030200/0xd9f4181e0d27e622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e629 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946149.225759:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790946149.225774:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4092afd600/0xd9f4181e0d27e358 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e35f expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946149.225785:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afd600 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790946149.225789:0:18315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4092afd600/0xd9f4181e0d27e358 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e35f expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946149.225822:0:18315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4092afd600/0xd9f4181e0d27e358 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27e35f expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946149.225830:0:18315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4092afd600/0xd9f4181e0d27e358 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27e35f expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946149.225837:0:18315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790946149.225840:0:18315:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00000100:00100000:2.0:1790946149.228410:0:20188:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3649:x1877942638694912:12345-0@lo:103:ldlm_bl.0 Request processed in 7258us (8308us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790946149.228425:0:20188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1790946149.228767:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790946149.228773:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9d40914a7000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1790946149.228777:0:3649:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1790946149.229569:0:20933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790946149.229642:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946149.229652:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4080030200/0xd9f4181e0d27e622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e629 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946149.229663:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030200 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790946149.229668:0:17135:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4080030200/0xd9f4181e0d27e622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e629 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946149.229678:0:17135:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4080030200/0xd9f4181e0d27e622 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27e629 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946149.229686:0:17135:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4080030200/0xd9f4181e0d27e622 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27e629 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946149.229692:0:17135:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1790946149.229695:0:17135:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1790946149.229738:0:20933:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1790946149.229753:0:20933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27e7f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e7f7 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.229761:0:20933:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27e7f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e7f7 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.229768:0:20933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27e7f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e7f7 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.229775:0:20933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27e7f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e7f7 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.229794:0:20933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790946149.229800:0:20933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afc200/0xd9f4181e0d27e34a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e351 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.229807:0:20933:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afc200/0xd9f4181e0d27e34a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e351 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.229827:0:20933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afc200/0xd9f4181e0d27e34a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e351 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.229834:0:20933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d4092afc200/0xd9f4181e0d27e34a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e351 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.229841:0:20933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1790946149.229844:0:20933:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1790946149.229847:0:20933:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1790946149.229898:0:20933:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1790946149.229902:0:20933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1790946149.229907:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790946149.229926:0:20933:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1790946149.229931:0:20933:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9d3f820b9000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790946149.229937:0:20933:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9d40baebc800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790946149.229950:0:20933:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff9d40af6899c0) has exports, disconnecting them 00000020:00080000:3.0:1790946149.229954:0:20933:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9d3f820b9000), last request at 1790946146 00000020:00000080:3.0:1790946149.229961:0:20933:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e573 00000100:00080000:3.0:1790946149.230259:0:20933:0:(import.c:65:import_set_state_nolock()) ffff9d3f820bf800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1790946149.230307:0:20933:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3f820b9000): rc 0 00000020:00000080:3.0:1790946149.230310:0:20933:0:(genops.c:885:class_export_put()) final put ffff9d3f820b9000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1790946149.230321:0:20933:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9d40baebc800), last request at 1790946146 00000020:00000080:3.0:1790946149.230325:0:20933:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e4d9 00000100:00080000:3.0:1790946149.230332:0:20933:0:(import.c:65:import_set_state_nolock()) ffff9d40bff13000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1790946149.230343:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f820b9000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1790946149.230389:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f820bf800 for lustre-MDT0001 00000020:00080000:3.0:1790946149.230401:0:20933:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d40baebc800): rc 0 00000020:00000080:3.0:1790946149.230409:0:20933:0:(genops.c:885:class_export_put()) final put ffff9d40baebc800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1790946149.230419:0:20933:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb827c1da3ae0 00000020:00000080:3.0:1790946149.230428:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40baebc800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1790946149.230459:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40bff13000 for lustre-MDT0001 00000100:00080000:3.0:1790946149.230477:0:20933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790946149.230485:0:20933:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9d40812eb800 x1877942638691840/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790946157 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946149.230496:0:20933:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790946149.231699:0:20933:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790946149.231708:0:20933:0:(import.c:65:import_set_state_nolock()) ffff9d40914e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1790946149.231835:0:20933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790946149.231838:0:20933:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1790946149.231850:0:20933:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1790946149.231910:0:20933:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1790946149.231953:0:20933:0:(import.c:65:import_set_state_nolock()) ffff9d4099032000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1790946149.232034:0:20933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790946149.232037:0:20933:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1790946149.232046:0:20933:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1790946149.232112:0:20933:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1790946149.232122:0:20933:0:(import.c:65:import_set_state_nolock()) ffff9d40914e2800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1790946149.232157:0:20933:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9d40af6899c0) has no exports 00010000:00010000:3.0:1790946149.232218:0:17136:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790946149.235579:0:20934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946149.235594:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27e7f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e7f7 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.235605:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031400 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:3.0:1790946149.235610:0:17136:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27e7f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e7f7 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.235632:0:17136:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27e7f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27e7f7 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946149.235639:0:17136:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27e7f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27e7f7 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946149.235644:0:17136:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790946149.235647:0:17136:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1790946149.235650:0:17136:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:2.0:1790946149.236808:0:3649:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.120@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1790946149.236812:0:3649:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1790946149.236822:0:3649:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3f8441df80 x1877942638693632/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790946162 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946149.236840:0:3649:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d40bff71500 x1877942638694912/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790946165 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1790946149.236849:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1790946149.236852:0:3649:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1790946149.236854:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:0.0:1790946149.237187:0:17135:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d4080030200/0xd9f4181e0d27e622 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e629 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946149.237197:0:17135:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790946149.237218:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4080030200/0xd9f4181e0d27e622 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e629 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946149.237245:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4080030200/0xd9f4181e0d27e622 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e629 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946149.237280:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87d8d138-d2ce-4761-a98a-4e847b9142bd:0:1877942638695296:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790946149.237307:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946149.237309:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946149.237311:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946149.237558:0:18315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d4092afd600/0xd9f4181e0d27e358 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e35f expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946149.237566:0:18315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790946149.237648:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4092afd600/0xd9f4181e0d27e358 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e35f expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946149.237656:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4092afd600/0xd9f4181e0d27e358 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e35f expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946149.237668:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946149.237680:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946149.237681:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946149.237698:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638695040:0@lo:9:umount.0 00000100:00100000:1.0:1790946149.237764:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946149.237796:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638695168:0@lo:9:umount.0 00000100:00100000:1.0:1790946149.237818:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946149.238060:0:18669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638695040 00000100:00100000:1.0:1790946149.238068:0:18669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638695040 00000100:00100000:1.0:1790946149.238125:0:18669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638695168 00000100:00100000:1.0:1790946149.238128:0:18669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638695168 00000100:00100000:1.0:1790946149.238152:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790946149.238160:0:18669:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1877942638695040:12345-0@lo:9:umount.0 00000020:00000080:1.0:1790946149.238214:0:18669:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e503 00000100:00080000:1.0:1790946149.238223:0:18669:0:(import.c:65:import_set_state_nolock()) ffff9d40bae3c800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790946149.238259:0:18669:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1790946149.238403:0:18669:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3646:x1877942638695040:12345-0@lo:9:umount.0 Request processed in 243us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946149.238410:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790946149.238425:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790946149.238431:0:18669:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1877942638695168:12345-0@lo:9:umount.0 00000020:00000080:1.0:1790946149.238442:0:18669:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e58f 00000100:00100000:0.0:1790946149.238607:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790946149.238619:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:87d8d138-d2ce-4761-a98a-4e847b9142bd:0:1877942638695424:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790946149.238638:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790946149.238720:0:18669:0:(import.c:65:import_set_state_nolock()) ffff9d3f820bd000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790946149.238753:0:18669:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1790946149.238840:0:18669:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3646:x1877942638695168:12345-0@lo:9:umount.0 Request processed in 409us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946149.238847:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1790946149.239214:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d4099032000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790946149.239229:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790946149.239242:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790946149.239246:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638695040:0@lo:9:umount.0 00000100:00080000:1.0:1790946149.239262:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40914e2800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790946149.239271:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790946149.239273:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790946149.239276:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638695168:0@lo:9:umount.0 00010000:00010000:3.0:1790946149.239397:0:17136:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27e7f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e7f7 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.239407:0:17136:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790946149.239434:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27e7f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e7f7 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.239442:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4080031400/0xd9f4181e0d27e7f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd9f4181e0d27e7f7 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.239546:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946149.239549:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946149.239550:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946149.239740:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:87d8d138-d2ce-4761-a98a-4e847b9142bd:3647:1877942638693632:0@lo:400:kworker.0 00000100:00100000:3.0:1790946149.239757:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790946149.239763:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:87d8d138-d2ce-4761-a98a-4e847b9142bd:0:1877942638695552:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1790946149.240140:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790946149.240144:0:17143:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790946149.240321:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946149.240741:0:20935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946149.240743:0:20935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946149.240745:0:20935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946149.240778:0:20934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4092afc200/0xd9f4181e0d27e34a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e351 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.240800:0:20934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afc200 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:3.0:1790946149.240804:0:20934:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4092afc200/0xd9f4181e0d27e34a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e351 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.240814:0:20934:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4092afc200/0xd9f4181e0d27e34a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27e351 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946149.240821:0:20934:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4092afc200/0xd9f4181e0d27e34a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27e351 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946149.240827:0:20934:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1790946149.240830:0:20934:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1790946149.240833:0:20934:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1790946149.240848:0:20934:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d40914a7000 00010000:00010000:3.0:1790946149.240851:0:20934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4092afc200/0xd9f4181e0d27e34a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27e351 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.240858:0:20934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4092afc200/0xd9f4181e0d27e34a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27e351 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946149.240873:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946149.240874:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946149.240876:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790946149.240947:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9d40914a7000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790946149.240962:0:3649:0:(import.c:545:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 505 00000100:00080000:2.0:1790946149.241403:0:3649:0:(import.c:666:import_select_connection()) MGC192.168.204.120@tcp: import ffff9d40914a7000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790946149.241435:0:3649:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40bff70700 x1877942638695680/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790946149.241568:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:87d8d138-d2ce-4761-a98a-4e847b9142bd:3646:1877942638695680:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1790946149.241626:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877942638695680 offset 0 length 520: 4 00000100:00100000:2.0:1790946149.241739:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638691840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790946149.241771:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87d8d138-d2ce-4761-a98a-4e847b9142bd:3649:1877942638694912:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1790946149.248476:0:20933:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9d40af6899c0) has no exports 00000020:01000000:2.0:1790946149.319850:0:20933:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9d40bc90ca20 - data ffff9d408f4ba870/ffff9d40862ca000 00000020:01000000:2.0:1790946149.320374:0:20933:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9d3f82161840 - data ffff9d408f482d80/ffff9d40862b4400 00000001:00000004:2.0:1790946149.335280:0:20933:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1790946149.386779:0:20933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790946149.386788:0:20933:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790946149.386795:0:20933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1790946149.389565:0:20933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790946149.389761:0:20933:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1790946149.389792:0:20933:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790946149.389806:0:20933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790946149.390205:0:17901:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790946149.390210:0:17901:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1790946149.390221:0:17901:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1790946149.390766:0:20933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790946149.390770:0:20933:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1790946149.390791:0:20933:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790946149.390794:0:20933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1790946149.391292:0:17903:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1790946149.391297:0:17903:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1790946149.391307:0:17903:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1790946149.392696:0:20933:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e36d 00000020:00000080:0.0:1790946149.392712:0:20933:0:(genops.c:885:class_export_put()) final put ffff9d4096fa6800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1790946149.392882:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4096fa6800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1790946149.395374:0:20933:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e382 00000020:00000080:0.0:1790946149.395389:0:20933:0:(genops.c:885:class_export_put()) final put ffff9d4099030800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1790946149.395454:0:20933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1790946149.395462:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790946149.395472:0:20933:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790946149.395476:0:20933:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9d40af68cd40) has no exports 00000004:01000000:0.0:1790946149.395675:0:20933:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1790946149.395685:0:20933:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e3d6 00000020:00000080:0.0:1790946149.395690:0:20933:0:(genops.c:885:class_export_put()) final put ffff9d3f82248000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790946149.396629:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4099030800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1790946149.396778:0:20933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1790946149.396786:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790946149.396796:0:20933:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790946149.396804:0:20933:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9d40bca80000) has no exports 00000020:00000080:0.0:1790946149.396824:0:20933:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e3cf 00000020:00000080:0.0:1790946149.396832:0:20933:0:(genops.c:885:class_export_put()) final put ffff9d40914e5000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1790946149.396856:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f82248000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:0.0:1790946149.397462:0:20933:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1790946149.397467:0:20933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790946149.397471:0:20933:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1790946149.397477:0:20933:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790946149.397479:0:20933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790946149.397801:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40914e5000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1790946149.397901:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790946149.397910:0:20933:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790946149.397919:0:20933:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e3c1 00000020:00000080:0.0:1790946149.397925:0:20933:0:(genops.c:885:class_export_put()) final put ffff9d4099034800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790946149.402932:0:15915:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40914e2800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1790946149.402961:0:15915:0:(genops.c:885:class_export_put()) final put ffff9d4099033000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790946149.402964:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4099033000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1790946149.402971:0:15915:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1790946149.404230:0:20933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1790946149.404241:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790946149.404253:0:20933:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790946149.404257:0:20933:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9d40af688000) has no exports 00000020:00000080:0.0:1790946149.404266:0:20933:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e3ba 00000020:00000080:0.0:1790946149.404274:0:20933:0:(genops.c:885:class_export_put()) final put ffff9d4099030000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1790946149.408650:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4099034800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1790946149.409652:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4099030000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1790946149.409883:0:20933:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1790946149.409889:0:20933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790946149.409894:0:20933:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1790946149.409901:0:20933:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790946149.409904:0:20933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790946149.409956:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790946149.409965:0:20933:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1790946149.409979:0:20933:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1790946149.409984:0:20933:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e3a5 00000020:00000080:0.0:1790946149.409992:0:20933:0:(genops.c:885:class_export_put()) final put ffff9d4099037800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1790946149.409997:0:20933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1790946149.410006:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790946149.410011:0:20933:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790946149.410015:0:20933:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff9d40bfe919c0) has no exports 00000020:00000080:0.0:1790946149.410021:0:20933:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e39e 00000020:00000080:0.0:1790946149.410034:0:20933:0:(genops.c:885:class_export_put()) final put ffff9d40914e4800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1790946149.410288:0:15915:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d4099032000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1790946149.410296:0:15915:0:(genops.c:885:class_export_put()) final put ffff9d4099031800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790946149.410299:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4099031800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1790946149.410305:0:15915:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790946149.410403:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4099037800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1790946149.410409:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40914e4800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1790946149.417422:0:20933:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1790946149.417433:0:20933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790946149.417437:0:20933:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790946149.417445:0:20933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790946149.417505:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790946149.417518:0:20933:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790946149.417551:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790946149.417554:0:20933:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790946149.417559:0:20933:0:(genops.c:885:class_export_put()) final put ffff9d40871f8000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790946149.417563:0:20933:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40871f8000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1790946149.417649:0:15915:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40914e4000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1790946149.417657:0:15915:0:(genops.c:885:class_export_put()) final put ffff9d40914e5800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790946149.417658:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40914e5800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1790946149.417663:0:15915:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1790946149.417802:0:20933:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790946149.417904:0:20933:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e389 00000020:00000080:2.0:1790946149.417911:0:20933:0:(genops.c:885:class_export_put()) final put ffff9d4099035000/lustre-MDD0001_UUID 00000020:01000000:2.0:1790946149.417926:0:20933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1790946149.417930:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790946149.417944:0:20933:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790946149.417948:0:20933:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9d40af68b380) has no exports 00000020:00000080:2.0:1790946149.417964:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790946149.417967:0:20933:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1790946149.417971:0:20933:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e390 00000020:00000080:2.0:1790946149.417975:0:20933:0:(genops.c:885:class_export_put()) final put ffff9d4099036000/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1790946149.417983:0:20933:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d40871f9800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1790946149.417999:0:20933:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d40871f9800 2 00000020:01000004:2.0:1790946149.418003:0:20933:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d40871f9800 from lustre-MDT0001 00000020:00000080:2.0:1790946149.418025:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790946149.418028:0:20933:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1790946149.418031:0:20933:0:(genops.c:885:class_export_put()) final put ffff9d4096fa3800/lustre-MDT0001_UUID 00000020:00000080:2.0:1790946149.418033:0:20933:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4096fa3800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1790946149.418038:0:20933:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1790946149.418062:0:20933:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1790946149.418066:0:20933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1790946149.418068:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790946149.418070:0:20933:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790946149.418076:0:20933:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9d3f8224a000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790946149.418081:0:20933:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff9d40848019c0) has exports, disconnecting them 00000020:00080000:2.0:1790946149.418085:0:20933:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9d3f8224a000), last request at 1790946069 00000020:00000080:2.0:1790946149.418088:0:20933:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e40e 00000020:00080000:2.0:1790946149.418099:0:20933:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3f8224a000): rc 0 00000020:00000080:2.0:1790946149.418103:0:20933:0:(genops.c:885:class_export_put()) final put ffff9d3f8224a000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1790946149.418311:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4099035000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1790946149.418316:0:15915:0:(genops.c:885:class_export_put()) final put ffff9d4096fa1800/lustre-MDD0001_UUID 00000020:00000080:3.0:1790946149.418329:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4096fa1800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1790946149.418333:0:15915:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1790946149.418452:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4099036000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1790946149.418458:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f8224a000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1790946149.424297:0:20933:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1790946149.424308:0:20933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790946149.424312:0:20933:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790946149.424320:0:20933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790946149.424678:0:15915:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40871fd800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1790946149.424871:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790946149.424878:0:20933:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1790946149.424884:0:20933:0:(genops.c:885:class_export_put()) final put ffff9d3f8224d800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1790946149.424888:0:20933:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f8224d800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1790946149.424893:0:20933:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1790946149.424978:0:20933:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d40871f9800 1 00000020:00000080:3.0:1790946149.424984:0:20933:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e335 00000020:00000080:3.0:1790946149.424991:0:20933:0:(genops.c:885:class_export_put()) final put ffff9d3f83700800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1790946149.425000:0:20933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1790946149.425007:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f83700800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1790946149.425026:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790946149.425036:0:20933:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790946149.425043:0:20933:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff9d3f836cb380) has no exports 00000020:00000080:2.0:1790946149.523718:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790946149.523734:0:20933:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1790946149.523740:0:20933:0:(genops.c:885:class_export_put()) final put ffff9d40871fa800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1790946149.523744:0:20933:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40871fa800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1790946149.523757:0:20933:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1790946149.523899:0:20933:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d40871f8800 00000020:01000000:2.0:1790946149.523984:0:20933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1790946149.523988:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790946149.523993:0:20933:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790946149.523997:0:20933:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9d40bc9e3380) has no exports 00000100:00100000:3.0:1790946149.524164:0:17148:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff9d3f837c4800:17148] 1 exiting: rc = 0 00000100:00100000:3.0:1790946149.524272:0:17149:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff9d3f837c4e00:17149] 2 exiting: rc = 0 00000100:00100000:1.0:1790946149.524367:0:17147:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff9d3f837c5800:17147] 0 exiting: rc = 1 00000100:00100000:2.0:1790946149.524480:0:20141:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff9d4086327e00:20141] 3 exiting: rc = 0 00000100:00100000:3.0:1790946149.524612:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524619:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524624:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524630:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524635:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524639:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524660:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524665:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524671:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524676:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524681:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524685:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524691:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524697:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524703:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524708:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524714:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524719:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524726:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524731:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524737:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524742:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524749:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524754:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524759:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524765:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524771:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524776:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524781:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524787:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524815:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524822:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524827:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524833:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524839:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524845:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524850:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524855:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524860:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524865:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524870:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524881:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524886:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524891:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.524897:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.525035:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.525041:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.525046:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.525052:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.525057:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.525062:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.525067:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.525073:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.525078:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.525083:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.525088:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.525093:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.525098:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.525104:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.525109:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.525114:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.525119:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.525125:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.525131:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.528871:0:17150:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9d40bc92e400:17150] 0 exiting: rc = 1 00000100:00100000:3.0:1790946149.529089:0:17151:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9d408aba1c00:17151] 1 exiting: rc = 0 00000100:00100000:3.0:1790946149.529148:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529157:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529164:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529290:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529296:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529302:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529307:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529313:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529319:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529324:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529329:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529348:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529353:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529358:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529364:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529369:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529375:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529382:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529387:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529393:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529398:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529404:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529409:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529415:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529421:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529427:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529433:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529440:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529445:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529450:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529456:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529462:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529467:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529473:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529479:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529484:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529490:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529495:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529501:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529506:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529512:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529517:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529522:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529527:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529532:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529537:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529550:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529555:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529561:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529566:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529572:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529577:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529583:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529588:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529594:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529599:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529603:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529609:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529614:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529619:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529624:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529629:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529634:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.529639:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.530202:0:17152:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff9d408a6dfa00:17152] 0 exiting: rc = 1 00000100:00100000:2.0:1790946149.530588:0:17153:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff9d40bc93be00:17153] 1 exiting: rc = 0 00000100:00100000:3.0:1790946149.530790:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.530798:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.530805:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.530811:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.530816:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.530823:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.530829:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.530835:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.530840:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.530847:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.530853:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.530871:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.530879:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.530885:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.530891:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.530978:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531001:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531008:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531015:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531022:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531028:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531034:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531040:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531061:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531068:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531074:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531081:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531086:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531092:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531098:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531104:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531110:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531116:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531122:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531127:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531150:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531158:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531164:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531304:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531311:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531316:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531323:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531328:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531334:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531340:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531346:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531351:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531373:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531381:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531388:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531394:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531409:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531415:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531421:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531427:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531435:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531442:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531448:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531455:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531478:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531488:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531494:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531500:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946149.531507:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.543461:0:17155:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9d40af684e00:17155] 1 exiting: rc = 0 00000100:00100000:0.0:1790946149.547778:0:17154:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9d40bc93ac00:17154] 0 exiting: rc = 1 00000100:00100000:0.0:1790946149.548716:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548725:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548731:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548736:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548742:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548748:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548753:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548757:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548762:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548767:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548772:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548778:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548783:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548788:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548793:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548798:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548805:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548809:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548814:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548820:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548824:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548829:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548834:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548840:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548845:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548850:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548855:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548860:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548865:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548870:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548874:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548880:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.548885:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549153:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549159:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549164:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549186:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549192:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549196:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549202:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549206:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549211:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549216:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549222:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549227:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549232:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549236:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549241:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549247:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549251:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549255:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549260:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549265:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549270:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549274:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549278:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549284:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549288:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549293:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549297:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549303:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549307:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549312:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.549316:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.550740:0:17156:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9d408a6de800:17156] 0 exiting: rc = 1 00000100:00100000:0.0:1790946149.550881:0:17157:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9d40af685c00:17157] 1 exiting: rc = 0 00000100:00100000:0.0:1790946149.550952:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.550959:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.550979:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.550983:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.550989:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.550994:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.550999:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551003:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551008:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551013:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551019:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551024:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551030:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551035:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551041:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551046:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551051:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551056:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551060:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551065:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551069:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551074:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551078:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551083:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551089:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551094:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551099:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551103:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551109:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551114:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551120:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551125:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551130:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551135:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551140:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551145:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551149:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551163:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551192:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551200:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551205:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551211:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551218:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551225:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551234:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551241:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551249:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551256:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551263:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551268:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551274:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551278:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551285:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551295:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551303:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551313:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551323:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551334:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551342:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551349:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551357:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551365:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551371:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.551377:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946149.551843:0:17159:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff9d40baee0000:17159] 1 exiting: rc = 0 00000100:00100000:0.0:1790946149.553377:0:17158:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff9d3f835d5a00:17158] 0 exiting: rc = 1 00000100:00100000:1.0:1790946149.553580:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553588:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553594:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553599:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553605:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553612:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553617:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553623:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553628:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553633:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553639:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553644:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553650:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553655:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553660:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553666:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553690:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553696:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553701:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553706:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553712:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553717:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553723:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553728:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553733:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553738:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553744:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553750:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553755:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553759:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553764:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553769:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553774:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553779:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553785:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553791:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553796:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553801:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553808:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553813:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553819:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553824:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553831:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553836:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553841:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553847:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553853:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553859:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553864:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553869:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.553874:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.554000:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.554009:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.554014:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.554019:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.554024:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.554029:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.554034:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.554040:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.554045:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.554050:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.554055:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.554060:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946149.554065:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946149.554642:0:17160:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff9d40baeee800:17160] 0 exiting: rc = 1 00000100:00100000:0.0:1790946149.554914:0:17161:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff9d3f835d5800:17161] 1 exiting: rc = 0 00000100:00100000:2.0:1790946149.555156:0:17162:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff9d3f835d5e00:17162] 2 exiting: rc = 0 00000100:00100000:0.0:1790946149.555264:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555273:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555279:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555285:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555291:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555298:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555314:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555320:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555328:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555334:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555339:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555344:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555351:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555357:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555361:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555366:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555372:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555377:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555385:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555392:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555401:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555408:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555429:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555438:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555446:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555454:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555461:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555470:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555477:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555487:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555497:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555504:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555514:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555524:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555534:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555544:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555553:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.555562:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556409:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556419:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556424:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556441:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556447:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556452:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556457:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556463:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556487:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556494:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556500:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556505:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556511:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556516:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556523:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556528:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556535:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556540:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556546:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556551:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556557:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556563:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556568:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556586:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556592:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946149.556598:0:20933:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1790946149.569498:0:20933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790946149.569513:0:20933:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1790946149.569519:0:20933:0:(genops.c:885:class_export_put()) final put ffff9d40914a1800/MDS_uuid 00000020:00000080:1.0:1790946149.569523:0:20933:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40914a1800/MDS_uuid for MDS 00000020:01000000:1.0:1790946149.569535:0:20933:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1790946149.569705:0:20933:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1790946149.670746:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946150.690373:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946151.713342:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790946151.775343:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) 87d8d138-d2ce-4761-a98a-4e847b9142bd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790946151.775355:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) 87d8d138-d2ce-4761-a98a-4e847b9142bd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790946151.775358:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790946151.775362:0:15915:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790946151.775366:0:15915:0:(import.c:65:import_set_state_nolock()) ffff9d40bae3a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790946151.775374:0:15915:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 597 00000100:00080000:0.0:1790946151.775380:0:15915:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790946151.775395:0:15915:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d40bae3a800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1790946151.775447:0:15915:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40812e8a80 x1877942638695808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790946151.775487:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790946151.775491:0:15915:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790946151.775492:0:15915:0:(import.c:65:import_set_state_nolock()) ffff9d3f82763800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790946151.775496:0:15915:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 597 00000100:00080000:0.0:1790946151.775499:0:15915:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790946151.775504:0:15915:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d3f82763800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1790946151.775515:0:15915:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40812ead80 x1877942638696064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790946151.775552:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638695936:0@lo:400:kworker.0 00000400:00000100:0.0:1790946151.775604:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877942638695936 offset 0 length 224: 4 00000100:00100000:0.0:1790946151.775641:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790946151.775646:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638696192:0@lo:400:kworker.0 00000400:00000100:0.0:1790946151.775666:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877942638696192 offset 0 length 224: 4 00000100:00100000:1.0:1790946151.775735:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1877942638695808:0@lo:38:kworker.0 00000400:00000100:1.0:1790946151.775758:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877942638695808 offset 0 length 520: 4 00000100:00100000:1.0:1790946151.775772:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1877942638696064:0@lo:38:kworker.0 00000400:00000100:1.0:1790946151.775786:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877942638696064 offset 0 length 520: 4 00010000:00010000:1.0:1790946152.735274:0:20935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946153.761445:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790946153.982645:0:21137:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790946154.002449:0:21137:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1790946154.002509:0:21137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1e00/0xd9f4181e0d27e4a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e4af expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946154.002525:0:21137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1e00/0xd9f4181e0d27e4a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e4af expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946154.002532:0:21137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1e00/0xd9f4181e0d27e4a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e4af expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946154.002540:0:21137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d40baef1e00/0xd9f4181e0d27e4a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e4af expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946154.002562:0:21137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790946154.002567:0:21137:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790946154.002596:0:21137:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790946154.002610:0:21137:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d40812e8a80 x1877942638695808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790946171 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946154.002658:0:21137:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790946154.002664:0:21137:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790946154.002671:0:21137:0:(import.c:65:import_set_state_nolock()) ffff9d40bae3a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1790946154.002675:0:21137:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790946154.002680:0:21137:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d40812e8a80 x1877942638695808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790946171 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946154.002687:0:21137:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790946154.002690:0:21137:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00010000:00010000:2.0:1790946154.002857:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946154.002866:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40baef1e00/0xd9f4181e0d27e4a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e4af expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946154.002873:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1e00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:2.0:1790946154.002877:0:17135:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef1e00/0xd9f4181e0d27e4a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e4af expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946154.002887:0:17135:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40baef1e00/0xd9f4181e0d27e4a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27e4af expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946154.002894:0:17135:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef1e00/0xd9f4181e0d27e4a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27e4af expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946154.002900:0:17135:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790946154.002903:0:17135:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790946154.002905:0:17135:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790946154.002920:0:17135:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d40914a7000 00010000:00010000:2.0:1790946154.002924:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40baef1e00/0xd9f4181e0d27e4a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27e4af expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946154.002932:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40baef1e00/0xd9f4181e0d27e4a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27e4af expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946154.002943:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946154.002945:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946154.002946:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946154.003018:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1877942638695808:0@lo:38:kworker.0 00000100:00080000:3.0:1790946154.005139:0:21137:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790946154.005156:0:21137:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d40812e9500 x1877942638695936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946167 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946154.005207:0:21137:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790946154.005214:0:21137:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1790946154.005241:0:21137:0:(import.c:65:import_set_state_nolock()) ffff9d40bae3a000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1790946154.005325:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1877942638696320:0@lo:39:umount.0 00000400:00000100:1.0:1790946154.005376:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877942638696320 offset 0 length 224: 4 00000100:00100000:2.0:1790946154.005618:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638695936:0@lo:400:kworker.0 00000100:00080000:3.0:1790946154.783418:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) 87d8d138-d2ce-4761-a98a-4e847b9142bd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790946154.783428:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) 87d8d138-d2ce-4761-a98a-4e847b9142bd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790946154.783432:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790946154.783435:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1790946154.785739:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946154.785945:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638696448:0@lo:400:kworker.0 00000400:00000100:0.0:1790946154.786012:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877942638696448 offset 0 length 224: 4 00000001:00100000:2.0:1790946155.364352:0:18663:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790946155.364362:0:18663:0:(genops.c:885:class_export_put()) final put ffff9d40bae3e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790946155.364660:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bae3e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1790946155.369404:0:15915:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40bae3c800 for lustre-OST0000 00000001:00100000:1.0:1790946155.371304:0:19480:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790946155.371313:0:19480:0:(genops.c:885:class_export_put()) final put ffff9d3f820be800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790946155.371542:0:15915:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f820be800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1790946155.371604:0:15915:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f820bd000 for lustre-OST0001 00010000:00010000:0.0:1790946155.809794:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946156.831343:0:20935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790946156.831772:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 87d8d138-d2ce-4761-a98a-4e847b9142bd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790946156.831779:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 87d8d138-d2ce-4761-a98a-4e847b9142bd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790946156.831782:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790946156.831785:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790946156.833689:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790946156.833718:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638696576:0@lo:400:kworker.0 00000400:00000100:0.0:1790946156.833803:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877942638696576 offset 0 length 224: 4 00010000:00010000:2.0:1790946157.856446:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946158.879826:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946159.135296:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946149/real 1790946149] req@ffff9d40bff70700 x1877942638695680/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790946159 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946159.135405:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d40bff70700 x1877942638695680/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790946159 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790946159.135428:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40914a7000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790946159.135454:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1790946159.135459:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:87d8d138-d2ce-4761-a98a-4e847b9142bd:3646:1877942638695680:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:0.0:1790946159.138410:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) 87d8d138-d2ce-4761-a98a-4e847b9142bd->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790946159.138421:0:15915:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1790946159.138426:0:15915:0:(import.c:65:import_set_state_nolock()) ffff9d40914a7000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790946159.138433:0:15915:0:(import.c:545:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 600 00000100:00080000:0.0:1790946159.138440:0:15915:0:(import.c:630:import_select_connection()) MGC192.168.204.120@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790946159.138453:0:15915:0:(import.c:666:import_select_connection()) MGC192.168.204.120@tcp: import ffff9d40914a7000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1790946159.138492:0:15915:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40812e9f80 x1877942638696704/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790946159.138528:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790946159.138533:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790946159.138662:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790946159.138682:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638696832:0@lo:400:kworker.0 00000400:00000100:3.0:1790946159.138735:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877942638696832 offset 0 length 224: 4 00000100:00100000:1.0:1790946159.139115:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:87d8d138-d2ce-4761-a98a-4e847b9142bd:3646:1877942638696704:0@lo:250:kworker.0 00000400:00000100:1.0:1790946159.139142:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877942638696704 offset 0 length 520: 4 00010000:00010000:2.0:1790946159.903518:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946160.930967:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946161.951342:0:20935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946162.975788:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946163.999441:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946164.255473:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946154/real 1790946154] req@ffff9d3f84e24a80 x1877942638696320/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790946164 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946164.255506:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3f84e24a80 x1877942638696320/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790946164 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790946164.255525:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bae3a000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1790946164.255623:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1877942638696320:0@lo:39:umount.0 00000100:00080000:3.0:1790946164.258219:0:21137:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790946164.258229:0:21137:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790946164.258236:0:21137:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790946164.259436:0:21137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1a00/0xd9f4181e0d27e47e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e485 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946164.259454:0:21137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1a00/0xd9f4181e0d27e47e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e485 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946164.260068:0:21137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1a00/0xd9f4181e0d27e47e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e485 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946164.260078:0:21137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d40baef1a00/0xd9f4181e0d27e47e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e485 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946164.260108:0:21137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790946164.260117:0:21137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080031800/0xd9f4181e0d27e7e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e7e9 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946164.260125:0:21137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080031800/0xd9f4181e0d27e7e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e7e9 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946164.260131:0:21137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4080031800/0xd9f4181e0d27e7e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e7e9 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946164.260137:0:21137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d4080031800/0xd9f4181e0d27e7e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e7e9 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946164.260299:0:21137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1790946164.260306:0:21137:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1790946164.260336:0:21137:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1790946164.260340:0:21137:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1790946164.260346:0:21137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790946164.260351:0:21137:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790946164.260383:0:21137:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9d40accf3380) has no exports 00000020:00080000:3.0:1790946164.260407:0:21137:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9d40accf3380) has no exports 00010000:00010000:0.0:1790946164.260979:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790946164.260989:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40baef1a00/0xd9f4181e0d27e47e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e485 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946164.261000:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1a00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790946164.261003:0:18315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef1a00/0xd9f4181e0d27e47e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e485 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946164.261014:0:18315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40baef1a00/0xd9f4181e0d27e47e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27e485 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946164.261022:0:18315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef1a00/0xd9f4181e0d27e47e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27e485 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946164.261029:0:18315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790946164.261040:0:18315:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1790946164.261042:0:18315:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1790946164.261122:0:18315:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d40914a7000 00010000:00010000:0.0:1790946164.261127:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40baef1a00/0xd9f4181e0d27e47e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27e485 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946164.261136:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40baef1a00/0xd9f4181e0d27e47e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27e485 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946164.261610:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946164.261615:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4080031800/0xd9f4181e0d27e7e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e7e9 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946164.261623:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031800 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790946164.261626:0:18315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4080031800/0xd9f4181e0d27e7e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e7e9 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946164.261634:0:18315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4080031800/0xd9f4181e0d27e7e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27e7e9 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946164.261642:0:18315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4080031800/0xd9f4181e0d27e7e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27e7e9 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946164.261660:0:18315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790946164.261663:0:18315:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1790946164.261665:0:18315:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790946164.261672:0:18315:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d40914a7000 00010000:00010000:0.0:1790946164.261676:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4080031800/0xd9f4181e0d27e7e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27e7e9 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946164.261683:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4080031800/0xd9f4181e0d27e7e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27e7e9 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946164.261711:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946164.261713:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946164.261716:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946164.261801:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1790946164.266001:0:21137:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9d3f83ca0c60 - data ffff9d408f4aad80/ffff9d3f822c8400 00000020:01000000:3.0:1790946164.266192:0:21137:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9d3f833c4000 - data ffff9d408f4b0e58/ffff9d3f821c3c00 00100000:10000000:3.0:1790946164.284038:0:21137:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1790946164.297480:0:21137:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e493 00000020:00000080:0.0:1790946164.297492:0:21137:0:(genops.c:885:class_export_put()) final put ffff9d4090ccf000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1790946164.297511:0:21137:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d4099fbe800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1790946164.297515:0:21137:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d4099fbe800 2 00000020:01000004:0.0:1790946164.297518:0:21137:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d4099fbe800 from lustre-OST0000 00000020:00000080:0.0:1790946164.297541:0:21137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790946164.297550:0:21137:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1790946164.297553:0:21137:0:(genops.c:885:class_export_put()) final put ffff9d3f837db000/lustre-OST0000_UUID 00000020:00000080:0.0:1790946164.297557:0:21137:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f837db000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1790946164.297563:0:21137:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1790946164.297631:0:21137:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1790946164.297636:0:21137:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1790946164.297640:0:21137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790946164.297657:0:21137:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790946164.297667:0:21137:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9d3f82249800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790946164.297672:0:21137:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff9d40b441b380) has exports, disconnecting them 00000020:00080000:0.0:1790946164.297677:0:21137:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9d3f82249800), last request at 1790946083 00000020:00000080:0.0:1790946164.297681:0:21137:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e4bd 00000020:00080000:0.0:1790946164.297689:0:21137:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3f82249800): rc 0 00000020:00000080:0.0:1790946164.297694:0:21137:0:(genops.c:885:class_export_put()) final put ffff9d3f82249800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1790946164.298401:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4090ccf000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1790946164.298412:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f82249800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1790946164.298436:0:21137:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1790946164.298441:0:21137:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790946164.298445:0:21137:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790946164.298450:0:21137:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790946164.298469:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40bae3a800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1790946164.298588:0:21137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790946164.298605:0:21137:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1790946164.298609:0:21137:0:(genops.c:885:class_export_put()) final put ffff9d40bae3f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1790946164.298611:0:21137:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bae3f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1790946164.298615:0:21137:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1790946164.298676:0:21137:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1790946164.298680:0:21137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790946164.298684:0:21137:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790946164.298688:0:21137:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9d4096fa5000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790946164.298693:0:21137:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff9d40accf0000) has exports, disconnecting them 00000020:00080000:1.0:1790946164.298697:0:21137:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9d4096fa5000), last request at 1790946083 00000020:00000080:1.0:1790946164.298701:0:21137:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e4d2 00000020:00080000:1.0:1790946164.298712:0:21137:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d4096fa5000): rc 0 00000020:00000080:1.0:1790946164.298715:0:21137:0:(genops.c:885:class_export_put()) final put ffff9d4096fa5000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1790946164.298741:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4096fa5000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1790946164.305906:0:21137:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1790946164.305918:0:21137:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790946164.305924:0:21137:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790946164.305932:0:21137:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790946164.306118:0:21137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790946164.306128:0:21137:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1790946164.306134:0:21137:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d4099fbe800 1 00000020:00000080:2.0:1790946164.306141:0:21137:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e470 00000020:00000080:2.0:1790946164.306149:0:21137:0:(genops.c:885:class_export_put()) final put ffff9d3f837db800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1790946164.306155:0:21137:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1790946164.306160:0:21137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790946164.306164:0:21137:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790946164.306186:0:21137:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff9d4084800000) has no exports 00000020:00000080:2.0:1790946164.309065:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40bae3a000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1790946164.309080:0:36:0:(genops.c:885:class_export_put()) final put ffff9d40bfee7800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1790946164.309091:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bfee7800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1790946164.309102:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1790946164.309162:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f837db800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1790946164.349916:0:21137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790946164.349928:0:21137:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1790946164.349934:0:21137:0:(genops.c:885:class_export_put()) final put ffff9d4090ccf800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1790946164.349938:0:21137:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4090ccf800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1790946164.349954:0:21137:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1790946164.350100:0:21137:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d4099fb8000 00000020:02000400:2.0:1790946164.350141:0:21137:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:2.0:1790946164.576132:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) 87d8d138-d2ce-4761-a98a-4e847b9142bd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790946164.576141:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) 87d8d138-d2ce-4761-a98a-4e847b9142bd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790946164.576145:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790946164.576148:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790946164.576529:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638696960:0@lo:400:kworker.0 00000400:00000100:3.0:1790946164.576583:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877942638696960 offset 0 length 224: 4 00010000:00010000:1.0:1790946165.028418:0:20935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946166.057364:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946167.071747:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1790946167.969740:0:3649:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946151/real 1790946151] req@ffff9d40812e9180 x1877942638696192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790946167 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:01000004:3.0:1790946167.977538:0:21339:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000100:00100000:0.0:1790946168.023195:0:3649:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9d40812e9180 x1877942638696192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790946167 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790946168.023230:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9d3f82761000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790946168.023236:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1790946168.067766:0:3649:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1790946168.067877:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 87d8d138-d2ce-4761-a98a-4e847b9142bd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790946168.067883:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 87d8d138-d2ce-4761-a98a-4e847b9142bd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790946168.067886:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790946168.067889:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790946168.067891:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790946168.067894:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1790946168.067898:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d3f82761000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790946168.067907:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 550 00000100:00080000:3.0:1790946168.067922:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9d3f82761000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790946168.067960:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f84e25c00 x1877942638697088/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790946168.068252:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1877942638697088:0@lo:38:kworker.0 00000400:00000100:2.0:1790946168.068305:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877942638697088 offset 0 length 520: 4 00000100:00100000:1.0:1790946168.068839:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638696192:0@lo:400:kworker.0 00000020:01000004:3.0:1790946168.069515:0:21339:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1790946168.069674:0:21339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0200/0xd9f4181e0d27e542 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e549 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946168.069688:0:21339:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0200/0xd9f4181e0d27e542 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e549 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946168.069715:0:21339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0200/0xd9f4181e0d27e542 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e549 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946168.069721:0:21339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d40baef0200/0xd9f4181e0d27e542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e549 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946168.069748:0:21339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790946168.069753:0:21339:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790946168.069778:0:21339:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790946168.069785:0:21339:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d40812ead80 x1877942638696064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790946171 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946168.069807:0:21339:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790946168.069813:0:21339:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790946168.069818:0:21339:0:(import.c:65:import_set_state_nolock()) ffff9d3f82763800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1790946168.069824:0:21339:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790946168.069828:0:21339:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d40812ead80 x1877942638696064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790946171 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946168.069834:0:21339:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790946168.069837:0:21339:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00010000:00010000:0.0:1790946168.070650:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946168.070661:0:18315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40baef0200/0xd9f4181e0d27e542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e549 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946168.070670:0:18315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0200 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790946168.070674:0:18315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef0200/0xd9f4181e0d27e542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e549 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946168.070685:0:18315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40baef0200/0xd9f4181e0d27e542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27e549 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946168.070692:0:18315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef0200/0xd9f4181e0d27e542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27e549 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946168.070698:0:18315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790946168.070701:0:18315:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790946168.070704:0:18315:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790946168.070720:0:18315:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d40914a7000 00010000:00010000:0.0:1790946168.070725:0:18315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40baef0200/0xd9f4181e0d27e542 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27e549 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946168.070733:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40baef0200/0xd9f4181e0d27e542 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27e549 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946168.070747:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946168.070760:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946168.070762:0:18315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946168.071161:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1877942638696064:0@lo:38:kworker.0 00000100:00080000:1.0:1790946168.083652:0:21339:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790946168.083676:0:21339:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3f84e27480 x1877942638696448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946170 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946168.083699:0:21339:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d40bff71500 x1877942638696576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946172 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946168.083709:0:21339:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d40812ea680 x1877942638696832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946175 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946168.083720:0:21339:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d40bff72d80 x1877942638696960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946180 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946168.083729:0:21339:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3f84e25c00 x1877942638697088/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790946178 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946168.083770:0:21339:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790946168.083777:0:21339:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1790946168.083784:0:21339:0:(import.c:65:import_set_state_nolock()) ffff9d3f82761000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1790946168.083791:0:21339:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790946168.083796:0:21339:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3f84e27480 x1877942638696448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946170 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946168.083801:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638696960:0@lo:400:kworker.0 00000100:00100000:1.0:1790946168.083811:0:21339:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d40bff71500 x1877942638696576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946172 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946168.083877:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638696576:0@lo:400:kworker.0 00000100:00100000:1.0:1790946168.083902:0:21339:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d40812ea680 x1877942638696832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946175 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946168.083911:0:21339:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d40bff72d80 x1877942638696960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946180 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946168.083918:0:21339:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3f84e25c00 x1877942638697088/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790946178 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946168.083925:0:21339:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790946168.087744:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638696832:0@lo:400:kworker.0 00000100:00100000:2.0:1790946168.092398:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638696448:0@lo:400:kworker.0 00000100:00100000:1.0:1790946168.093327:0:21339:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790946168.095666:0:17136:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946168.097671:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1877942638697088:0@lo:38:kworker.0 00010000:00010000:1.0:1790946168.106672:0:21339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1800/0xd9f4181e0d27e518 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e51f expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946168.106693:0:21339:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1800/0xd9f4181e0d27e518 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e51f expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946168.106702:0:21339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1800/0xd9f4181e0d27e518 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e51f expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946168.106709:0:21339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d40baef1800/0xd9f4181e0d27e518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e51f expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946168.106802:0:21339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946168.106811:0:21339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27e7d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27e7db expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946168.106819:0:21339:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27e7d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27e7db expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946168.106826:0:21339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27e7d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e7db expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946168.106833:0:21339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27e7d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd9f4181e0d27e7db expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946168.110702:0:20935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790946168.110719:0:20935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40baef1800/0xd9f4181e0d27e518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e51f expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946168.110731:0:20935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1800 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790946168.110736:0:20935:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef1800/0xd9f4181e0d27e518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e51f expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946168.110747:0:20935:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40baef1800/0xd9f4181e0d27e518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27e51f expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946168.110755:0:20935:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef1800/0xd9f4181e0d27e518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27e51f expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946168.110772:0:20935:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790946168.110775:0:20935:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1790946168.110790:0:20935:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d40914a7000 00010000:00010000:0.0:1790946168.110794:0:20935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40baef1800/0xd9f4181e0d27e518 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27e51f expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946168.110801:0:20935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40baef1800/0xd9f4181e0d27e518 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27e51f expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946168.110820:0:20935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946168.110824:0:20935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27e7d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e7db expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946168.110852:0:20935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6e00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790946168.110856:0:20935:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27e7d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd9f4181e0d27e7db expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946168.110862:0:20935:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27e7d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27e7db expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946168.110868:0:20935:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27e7d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27e7db expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946168.110874:0:20935:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790946168.110876:0:20935:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1790946168.110881:0:20935:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d40914a7000 00010000:00010000:0.0:1790946168.110884:0:20935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27e7d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27e7db expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946168.110891:0:20935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946168.110893:0:20935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946168.110895:0:20935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946168.116283:0:21339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790946168.116301:0:21339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27e7d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27e7db expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946168.116327:0:21339:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1790946168.116336:0:21339:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1790946168.116339:0:21339:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1790946168.116373:0:21339:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1790946168.116379:0:21339:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1790946168.116390:0:21339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790946168.116396:0:21339:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790946168.116401:0:21339:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff9d4084804d40) has no exports 00000020:00080000:1.0:1790946168.116425:0:21339:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff9d4084804d40) has no exports 00000020:01000000:1.0:1790946168.118229:0:21339:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9d40bc90c420 - data ffff9d408f59b000/ffff9d40862c9c00 00000020:01000000:1.0:1790946168.118412:0:21339:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9d3f831e17e0 - data ffff9d408f6fa000/ffff9d3f8312dc00 00010000:00010000:0.0:1790946168.119411:0:20934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1790946168.128599:0:21339:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1790946168.139699:0:21339:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e52d 00000020:00000080:3.0:1790946168.139713:0:21339:0:(genops.c:885:class_export_put()) final put ffff9d3f837d8000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1790946168.139738:0:21339:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d40bff17000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1790946168.139743:0:21339:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d40bff17000 2 00000020:01000004:3.0:1790946168.139746:0:21339:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d40bff17000 from lustre-OST0001 00000020:00000080:3.0:1790946168.139773:0:21339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790946168.139783:0:21339:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1790946168.139800:0:21339:0:(genops.c:885:class_export_put()) final put ffff9d40bacdf800/lustre-OST0001_UUID 00000020:00000080:3.0:1790946168.139803:0:21339:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bacdf800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1790946168.139811:0:21339:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1790946168.139924:0:21339:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 87d8d138-d2ce-4761-a98a-4e847b9142bd->MGS 00010000:00010000:3.0:1790946168.139941:0:21339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4092afcc00/0xd9f4181e0d27e33c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27e343 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946168.139955:0:21339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4092afcc00/0xd9f4181e0d27e33c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27e343 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946168.139961:0:21339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1790946168.139964:0:21339:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1790946168.139968:0:21339:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1790946168.139983:0:21339:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d40914a7000 00010000:00010000:3.0:1790946168.139987:0:21339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4092afcc00/0xd9f4181e0d27e33c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27e343 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946168.140001:0:21339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4092afd400/0xd9f4181e0d27e22b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd9f4181e0d27e232 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946168.140007:0:21339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4092afd400/0xd9f4181e0d27e22b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd9f4181e0d27e232 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946168.140012:0:21339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790946168.140014:0:21339:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1790946168.140016:0:21339:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1790946168.140032:0:21339:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d40914a7000 00010000:00010000:3.0:1790946168.140035:0:21339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4092afd400/0xd9f4181e0d27e22b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd9f4181e0d27e232 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790946168.140050:0:21339:0:(import.c:65:import_set_state_nolock()) ffff9d40914a7000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1790946168.140060:0:21339:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1790946168.140063:0:21339:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1790946168.140065:0:21339:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1790946168.140069:0:21339:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000020:00000080:0.0:1790946168.140306:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f837d8000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1790946168.141483:0:21339:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d40812e9f80 x1877942638696704/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790946174 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1790946168.141512:0:21339:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1790946168.141516:0:21339:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:0.0:1790946168.141659:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:87d8d138-d2ce-4761-a98a-4e847b9142bd:3646:1877942638696704:0@lo:250:kworker.0 10000000:01000000:3.0:1790946168.141726:0:21339:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1790946168.141738:0:21339:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e216 00000020:00000080:3.0:1790946168.141746:0:21339:0:(genops.c:885:class_export_put()) final put ffff9d3f81bb6800/87d8d138-d2ce-4761-a98a-4e847b9142bd 00000020:01000000:3.0:1790946168.141771:0:21339:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.120@tcp (flags='') 00000020:00000080:3.0:1790946168.141780:0:21339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790946168.141787:0:21339:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.120@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790946168.141790:0:21339:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9d40bc9e4d40) has no exports 10000000:01000000:3.0:1790946168.141807:0:17144:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1790946168.141874:0:21339:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.204.120@tcp: client import never connected 00000100:00080000:3.0:1790946168.141877:0:21339:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1790946168.141879:0:21339:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1790946168.141881:0:21339:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1790946168.141882:0:21339:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1790946168.141912:0:21339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790946168.141918:0:21339:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.120@tcp (uuid 87d8d138-d2ce-4761-a98a-4e847b9142bd) 00000020:01000000:3.0:1790946168.141923:0:21339:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1790946168.141926:0:21339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790946168.141929:0:21339:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790946168.141934:0:21339:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9d3f82767000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790946168.141939:0:21339:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff9d40b4a419c0) has exports, disconnecting them 00000020:00080000:3.0:1790946168.141943:0:21339:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9d3f82767000), last request at 1790946099 00000020:00000080:3.0:1790946168.141947:0:21339:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e557 00000020:00080000:3.0:1790946168.141957:0:21339:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3f82767000): rc 0 00000020:00000080:3.0:1790946168.141961:0:21339:0:(genops.c:885:class_export_put()) final put ffff9d3f82767000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1790946168.142465:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f81bb6800/87d8d138-d2ce-4761-a98a-4e847b9142bd for MGC192.168.204.120@tcp 00000020:00000080:0.0:1790946168.142474:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d40914a7000 for MGC192.168.204.120@tcp 00000020:00000080:0.0:1790946168.142481:0:36:0:(genops.c:885:class_export_put()) final put ffff9d40914a1000/87d8d138-d2ce-4761-a98a-4e847b9142bd 00000020:00000080:0.0:1790946168.142483:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40914a1000/87d8d138-d2ce-4761-a98a-4e847b9142bd for MGC192.168.204.120@tcp 00000020:01000000:0.0:1790946168.142486:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.120@tcp (87d8d138-d2ce-4761-a98a-4e847b9142bd) 00000020:00000080:0.0:1790946168.142745:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f82767000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1790946168.144279:0:21339:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1790946168.144287:0:21339:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790946168.144291:0:21339:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790946168.144323:0:21339:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790946168.144419:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f82763800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1790946168.144518:0:21339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790946168.144525:0:21339:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1790946168.144533:0:21339:0:(genops.c:885:class_export_put()) final put ffff9d40903fa800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1790946168.144538:0:21339:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40903fa800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1790946168.144551:0:21339:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1790946168.144621:0:21339:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1790946168.144626:0:21339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790946168.144630:0:21339:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790946168.144636:0:21339:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9d3f82764000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790946168.144642:0:21339:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff9d40b4a40000) has exports, disconnecting them 00000020:00080000:2.0:1790946168.144646:0:21339:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9d3f82764000), last request at 1790946099 00000020:00000080:2.0:1790946168.144650:0:21339:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e56c 00000020:00080000:2.0:1790946168.144663:0:21339:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3f82764000): rc 0 00000020:00000080:2.0:1790946168.144667:0:21339:0:(genops.c:885:class_export_put()) final put ffff9d3f82764000/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1790946168.145319:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f82764000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1790946168.161861:0:21339:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1790946168.161870:0:21339:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790946168.161874:0:21339:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790946168.161881:0:21339:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790946168.161994:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9d3f82761000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1790946168.162015:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1790946168.162539:0:18315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1790946168.164581:0:17136:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1790946168.165936:0:20935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00010000:00010000:0.0:1790946168.166181:0:20934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-5 blwis in pool) 00000100:00100000:0.0:1790946168.166539:0:17131:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9d40bc92f600:17131] 1 exiting: rc = 0 00000100:00100000:2.0:1790946168.199276:0:17130:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9d40bc92fe00:17130] 0 exiting: rc = 1 00000100:00100000:0.0:1790946168.199526:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.199822:0:17134:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9d40bc92e600:17134] 2 exiting: rc = 0 00000100:00100000:2.0:1790946168.200993:0:17133:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9d40bc92f200:17133] 1 exiting: rc = 0 00000100:00100000:3.0:1790946168.201243:0:20188:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9d40bd006c00:20188] 3 exiting: rc = 0 00000100:00100000:1.0:1790946168.201590:0:17132:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9d40bc92e000:17132] 0 exiting: rc = 1 00000100:00100000:0.0:1790946168.202681:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202693:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202701:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202708:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202715:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202723:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202729:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202735:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202740:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202746:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202752:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202759:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202764:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202770:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202775:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202782:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202787:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202795:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202801:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202806:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202825:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202830:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202835:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202840:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202845:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202850:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202856:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202861:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202866:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202872:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202878:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202884:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202889:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202895:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202901:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202906:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202912:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202919:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202925:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202931:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202938:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202943:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202949:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202955:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202961:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202966:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202973:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202978:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202984:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202989:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.202996:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.203002:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.203008:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.203014:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.203020:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.203033:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.203039:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.203045:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.203050:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.203056:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.203060:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.203066:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.203071:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.203077:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1790946168.206704:0:21339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790946168.206718:0:21339:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1790946168.206724:0:21339:0:(genops.c:885:class_export_put()) final put ffff9d3f82765800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1790946168.206729:0:21339:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f82765800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1790946168.206735:0:21339:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1790946168.206792:0:21339:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d40bff17000 1 00000020:00000080:0.0:1790946168.206799:0:21339:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd9f4181e0d27e511 00000020:00000080:0.0:1790946168.206805:0:21339:0:(genops.c:885:class_export_put()) final put ffff9d4096fa5800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1790946168.206819:0:21339:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1790946168.206830:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d4096fa5800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1790946168.206841:0:21339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790946168.206845:0:21339:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790946168.206849:0:21339:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff9d40b44199c0) has no exports 00000020:00000080:1.0:1790946168.244916:0:21339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790946168.244931:0:21339:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1790946168.244937:0:21339:0:(genops.c:885:class_export_put()) final put ffff9d40bff11800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1790946168.244942:0:21339:0:(genops.c:844:class_export_destroy()) destroying export ffff9d40bff11800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1790946168.244956:0:21339:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1790946168.245337:0:21339:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d40bff14800 00000020:01000000:1.0:1790946168.245359:0:21339:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1790946168.245363:0:21339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790946168.245368:0:21339:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790946168.245371:0:21339:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff9d40bfe94d40) has no exports 00000020:00000080:1.0:1790946168.245392:0:21339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790946168.245397:0:21339:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1790946168.245400:0:21339:0:(genops.c:885:class_export_put()) final put ffff9d3f837d9800/OSS_uuid 00000020:00000080:1.0:1790946168.245402:0:21339:0:(genops.c:844:class_export_destroy()) destroying export ffff9d3f837d9800/OSS_uuid for OSS 00000020:01000000:1.0:1790946168.245406:0:21339:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1790946168.245483:0:18669:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff9d40a72eb600:18669] 2 exiting: rc = 0 00000100:00100000:1.0:1790946168.245594:0:19252:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff9d40bc945400:19252] 3 exiting: rc = 0 00000100:00100000:1.0:1790946168.245650:0:19563:0:(service.c:3206:ptlrpc_main()) ll_ost00_004: service thread [ffff9d3f8445e200:19563] 4 exiting: rc = 0 00000100:00080000:3.0:1790946168.246742:0:17143:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1790946168.246879:0:18666:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff9d40b4bb0200:18666] 0 exiting: rc = 1 00000100:00100000:3.0:1790946168.246937:0:18667:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff9d4082f9e000:18667] 1 exiting: rc = 0 00000100:00100000:1.0:1790946168.247089:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247099:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247104:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247109:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247141:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247147:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247153:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247158:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247163:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247287:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247295:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247302:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247307:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247313:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247332:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247336:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247341:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247346:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247351:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247357:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247362:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247368:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247374:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247379:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247384:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247389:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247393:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247398:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247403:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247407:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247412:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247416:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247421:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247427:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247504:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247513:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247519:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247524:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247529:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247534:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247540:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247545:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247551:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247556:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247562:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247578:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247584:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247589:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247594:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247606:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247611:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247616:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247621:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247626:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247631:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247636:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247644:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247650:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247656:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247661:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247666:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247672:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247677:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.247688:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946168.248901:0:18670:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9d408120be00:18670] 0 exiting: rc = 1 00000100:00100000:1.0:1790946168.249021:0:18671:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9d4086244200:18671] 1 exiting: rc = 0 00000100:00100000:0.0:1790946168.249116:0:19952:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9d4086326a00:19952] 2 exiting: rc = 0 00000100:00100000:1.0:1790946168.249643:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249651:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249657:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249663:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249669:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249674:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249679:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249686:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249692:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249698:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249703:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249709:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249714:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249719:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249725:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249730:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249736:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249741:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249747:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249768:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249774:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249779:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249785:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249793:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249799:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249804:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249809:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249815:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249821:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249825:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249831:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249836:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249840:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249846:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249851:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249856:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249861:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249867:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249872:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249878:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249884:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249889:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249894:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249900:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249905:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249909:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249914:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249920:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249925:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249931:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249936:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249942:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249947:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249952:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249964:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249969:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249973:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249978:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249983:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249989:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249994:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.249999:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.250004:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946168.250017:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.252156:0:20302:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9d3f834bea00:20302] 3 exiting: rc = 0 00000100:00100000:3.0:1790946168.252411:0:18672:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9d4084788200:18672] 0 exiting: rc = 1 00000100:00100000:2.0:1790946168.252770:0:18673:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9d4084788600:18673] 1 exiting: rc = 0 00000100:00100000:0.0:1790946168.253012:0:18674:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9d4084788400:18674] 2 exiting: rc = 0 00000100:00100000:0.0:1790946168.253087:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253097:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253104:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253110:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253116:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253122:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253127:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253145:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253153:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253160:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253188:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253195:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253201:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253271:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253279:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253304:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253311:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253317:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253322:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253328:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253334:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253339:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253345:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253351:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253356:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253362:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253367:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253372:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253377:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253383:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253388:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253394:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253399:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253404:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253410:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253416:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253422:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253427:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253499:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253520:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253526:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253532:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253543:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253548:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253554:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253560:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253575:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253582:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253587:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253593:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253598:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253604:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253610:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253614:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253619:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253625:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253630:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253635:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253647:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253653:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253659:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253670:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253682:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.253693:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.260850:0:18675:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9d4084789000:18675] 0 exiting: rc = 1 00000100:00100000:0.0:1790946168.260933:0:18676:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9d4084789600:18676] 1 exiting: rc = 0 00000100:00100000:2.0:1790946168.261057:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261065:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261071:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261077:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261083:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261088:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261094:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261114:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261120:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261125:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261130:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261136:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261141:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261147:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261153:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261158:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261163:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261200:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261280:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261287:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261293:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261298:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261303:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261309:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261314:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261319:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261324:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261329:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261334:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261339:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261345:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261350:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261355:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261360:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261365:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261370:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261376:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261381:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261385:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261390:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261395:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261400:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261413:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261418:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261424:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261429:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261554:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261561:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261577:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261583:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261595:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261602:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261607:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261612:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261617:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261622:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261627:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261633:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261638:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261643:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261648:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261654:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261659:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.261664:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946168.262705:0:18677:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9d3f8326da00:18677] 0 exiting: rc = 1 00000100:00100000:0.0:1790946168.262800:0:18678:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9d40848c9e00:18678] 1 exiting: rc = 0 00000100:00100000:2.0:1790946168.262899:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.262907:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.262919:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.262945:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.262952:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.262958:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.262964:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.262970:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.262976:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.262981:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.262987:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.262993:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.262999:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263017:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263024:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263042:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263048:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263054:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263060:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263067:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263072:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263077:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263083:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263089:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263095:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263101:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263107:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263126:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263133:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263139:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263145:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263153:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263158:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263164:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263339:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263346:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263353:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263359:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263365:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263385:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263393:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263399:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263404:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263413:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263418:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263425:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263505:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263514:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263529:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263536:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263542:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263561:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263579:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263585:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263592:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263599:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263607:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263614:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263621:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263628:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263633:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263640:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263658:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946168.263673:0:21339:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1790946168.271826:0:21339:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1790946189.523610:0:22103:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1790946200.736791:0:22703:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790946200.736799:0:22703:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1790946200.736801:0:22703:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1790946200.736923:0:22703:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d3f83705800 00000020:01000004:2.0:1790946200.738140:0:22703:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1790946200.738156:0:22703:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790946200.738200:0:22703:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9d40bca84d40) 00000020:00000080:2.0:1790946200.738221:0:22703:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1790946200.815355:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1790946200.816488:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790946200.819101:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1790946200.819490:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1790946200.819952:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1790946200.820229:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1790946200.820680:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1790946200.820958:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1790946200.821276:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1790946200.821476:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1790946200.822877:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1790946200.823143:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1790946200.823511:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1790946200.823958:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1790946200.824159:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1790946200.824485:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1790946200.827398:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1790946200.828119:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1790946200.828643:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1790946200.828819:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1790946200.829007:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1790946200.829255:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1790946200.829437:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1790946200.829690:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1790946200.831378:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1790946200.832297:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1790946200.832718:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1790946200.832951:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1790946200.833288:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1790946200.833465:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1790946200.833839:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1790946200.834050:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1790946200.834664:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1790946200.837302:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1790946200.838679:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1790946200.840634:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1790946200.841014:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1790946200.841319:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1790946200.841511:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1790946200.841823:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1790946200.842018:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1790946200.842370:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1790946200.842967:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1790946200.843310:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1790946200.843669:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1790946200.843888:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1790946200.844092:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1790946200.845363:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1790946200.845877:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1790946200.846133:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1790946200.847124:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1790946200.848019:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1790946200.848389:0:22703:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:2.0:1790946200.848915:0:22703:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790946200.849145:0:22703:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1790946200.849152:0:22703:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790946200.849162:0:22703:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd9f4181e0d27ea82 00000020:01000004:2.0:1790946200.849327:0:22703:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1790946200.849333:0:22703:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1790946200.849339:0:22703:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d3f83705800 from MGS 00000020:01000004:2.0:1790946200.849354:0:22703:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1790946200.849365:0:22703:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9d40bca819c0) 00000020:00000080:2.0:1790946200.849375:0:22703:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1790946200.849439:0:22703:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3f83705800 from MGS, refs=2 00080000:01000000:2.0:1790946200.849445:0:22703:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790946200.849450:0:22703:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd9f4181e0d27ea90 00000100:00100000:2.0:1790946200.849543:0:22703:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1790946200.849801:0:22703:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1790946200.849808:0:22703:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1790946200.851785:0:22703:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1790946200.851798:0:22703:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1790946200.852789:0:22703:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790946200.853017:0:22703:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1790946200.853030:0:22703:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1790946200.856002:0:22703:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1790946200.856015:0:22703:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1790946200.857823:0:22703:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1790946200.857835:0:22703:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1790946200.858587:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946200.858591:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946200.858593:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946200.859390:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946200.859394:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946200.859396:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946200.860106:0:22703:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1790946200.862520:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1790946200.870303:0:22703:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1790946200.878088:0:22716:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1790946200.878129:0:22703:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1790946200.878215:0:22703:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790946200.880518:0:22703:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1790946200.881094:0:22703:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790946200.882111:0:22703:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1790946200.882118:0:22703:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1790946200.883890:0:22703:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1790946200.883901:0:22703:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1790946200.900015:0:22703:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1790946200.900029:0:22703:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1790946200.901547:0:22703:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1790946200.901582:0:22703:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.120@tcp' 00000020:01000004:1.0:1790946200.901584:0:22703:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1790946200.901622:0:22703:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.120@tcp (typ=mgc) 00000020:00000080:1.0:1790946200.901638:0:22703:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.120@tcp (ffff9d40accf4d40) 00000020:00000080:1.0:1790946200.901659:0:22703:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1790946200.901941:0:22703:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d40baa22000@MGC192.168.204.120@tcp: add connection 192.168.204.120@tcp at head 00010000:00010000:1.0:1790946200.902104:0:22703:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.120@tcp-0 is initialized 00000040:01000000:1.0:1790946200.902111:0:22703:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 1 is initialized 00000100:00080000:2.0:1790946200.902922:0:22720:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1790946200.903705:0:22721:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1790946200.903834:0:22703:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.120@tcp (uuid 32dbedc5-819a-4eba-958c-cd7c205dd6c7) 00000020:00000080:2.0:1790946200.903857:0:22703:0:(genops.c:1384:class_connect()) connect: client 32dbedc5-819a-4eba-958c-cd7c205dd6c7, cookie 0xd9f4181e0d27ea9e 00000100:00080000:2.0:1790946200.903869:0:22703:0:(import.c:545:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790946200.903880:0:22703:0:(import.c:666:import_select_connection()) MGC192.168.204.120@tcp: import ffff9d40baa22000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790946200.903915:0:22703:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40bff71500 x1877942638697216/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790946200.903957:0:22703:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 32dbedc5-819a-4eba-958c-cd7c205dd6c7->MGS 00000020:01000004:2.0:1790946200.903983:0:22703:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1790946200.903988:0:22703:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1790946200.904000:0:22703:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9d40bca83380) 00000020:00000080:2.0:1790946200.904010:0:22703:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1790946200.904278:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3646:1877942638697216:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1790946200.904359:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946200.904673:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638697216 00000100:00100000:1.0:1790946200.904681:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638697216 00000100:00100000:1.0:1790946200.904723:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790946200.904740:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3646:x1877942638697216:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1790946200.904773:0:22717:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 32dbedc5-819a-4eba-958c-cd7c205dd6c7@0@lo t0 exp 0000000000000000 cur 651 last 0 00000020:00000080:1.0:1790946200.904798:0:22717:0:(genops.c:1384:class_connect()) connect: client 32dbedc5-819a-4eba-958c-cd7c205dd6c7, cookie 0xd9f4181e0d27eaac 00000100:00080000:1.0:1790946200.904945:0:22717:0:(import.c:65:import_set_state_nolock()) ffff9d40baa27000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790946200.905003:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+5:3646:x1877942638697216:12345-0@lo:250:mount.lustre.0 Request processed in 263us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946200.905011:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790946200.905160:0:3646:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.120@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1790946200.905205:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.120@tcp: connect to target with instance 0 00000100:00080000:0.0:1790946200.905214:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1790946200.905218:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1790946200.905221:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40baa22000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1790946200.905223:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1790946200.905234:0:3646:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1790946200.905240:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3646:1877942638697216:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1790946200.928277:0:22703:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790946200.928490:0:22703:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1790946200.928499:0:22703:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1790946200.932936:0:22703:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1790946200.932951:0:22703:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1790946200.936555:0:22703:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1790946200.936578:0:22703:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1790946200.940445:0:22703:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790946200.940656:0:22703:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1790946200.940663:0:22703:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1790946200.948030:0:22703:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1790946200.948047:0:22703:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1790946201.005830:0:22703:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790946201.006055:0:22703:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1790946201.006061:0:22703:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1790946201.009879:0:22703:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1790946201.009897:0:22703:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1790946201.010882:0:22703:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790946201.011085:0:22703:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790946201.011091:0:22703:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1790946201.012573:0:22703:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790946201.012586:0:22703:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1790946201.014489:0:22703:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790946201.014868:0:22703:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790946201.014876:0:22703:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1790946201.015884:0:22703:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790946201.015893:0:22703:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1790946201.017490:0:22703:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790946201.018068:0:22703:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790946201.018074:0:22703:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1790946201.019638:0:22703:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790946201.019651:0:22703:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1790946201.052885:0:22703:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790946201.053614:0:22703:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790946201.053623:0:22703:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1790946201.063472:0:22703:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790946201.063490:0:22703:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1790946201.064950:0:22703:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790946201.064962:0:22703:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1790946201.067481:0:22703:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1790946201.067511:0:22703:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1790946201.067518:0:22703:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1790946201.067630:0:22703:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790946201.067672:0:22703:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.120@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1790946201.067676:0:22703:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790946201.067678:0:22703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790946201.067679:0:22703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790946201.067681:0:22703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790946201.067682:0:22703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790946201.067683:0:22703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790946201.067684:0:22703:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790946201.067686:0:22703:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790946201.067687:0:22703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790946201.067689:0:22703:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790946201.067691:0:22703:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1790946201.067693:0:22703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790946201.067694:0:22703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790946201.067695:0:22703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790946201.067696:0:22703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790946201.067697:0:22703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790946201.067699:0:22703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790946201.067700:0:22703:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790946201.067701:0:22703:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790946201.067702:0:22703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790946201.067703:0:22703:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790946201.067727:0:22703:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790946201.067747:0:22703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638697344:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790946201.067817:0:22703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946201.067868:0:22703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d199c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946201.068528:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638697344 00000100:00100000:0.0:1790946201.068538:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638697344 00000100:00100000:0.0:1790946201.068586:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790946201.068594:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+5:22703:x1877942638697344:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790946201.068649:0:22719:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790946201.068652:0:22719:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790946201.068655:0:22719:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1790946201.069285:0:22740:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1790946201.069782:0:22719:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:0.0:1790946201.073942:0:22741:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1790946201.073952:0:22741:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1790946201.073956:0:22741:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1790946201.073959:0:22741:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1790946201.076082:0:22741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1790946201.077337:0:22719:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790946201.077352:0:22719:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1790946201.087477:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+5:22703:x1877942638697344:12345-0@lo:253:mount.lustre.0 Request processed in 18871us (19647us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946201.087516:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790946201.088773:0:22703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638697344:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790946201.088794:0:22703:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790946201.088811:0:22703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790946201.088825:0:22703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790946201.088827:0:22703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790946201.088828:0:22703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790946201.088830:0:22703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790946201.088832:0:22703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790946201.088834:0:22703:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790946201.088836:0:22703:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790946201.088838:0:22703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790946201.088839:0:22703:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790946201.088866:0:22703:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d3f83705800 from lustre-MDT0000 10000000:01000000:3.0:1790946201.088910:0:22703:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1790946201.088914:0:22703:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790946201.088918:0:22703:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9d40accf4d40 10000000:01000000:3.0:1790946201.088932:0:22703:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790946201.088943:0:22703:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d40accf4d40 from 1 10000000:01000000:3.0:1790946201.088946:0:22703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790946201.088990:0:22703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27eab3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946201.089002:0:22703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27eab3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946201.089012:0:22703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27eab3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946201.089032:0:22703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638697472:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790946201.089083:0:22703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946201.089126:0:22703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d19840 going to sleep for 11 seconds 00000100:00100000:0.0:1790946201.089326:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638697472 00000100:00100000:0.0:1790946201.089334:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638697472 00000100:00100000:0.0:1790946201.089384:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790946201.089394:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+5:22703:x1877942638697472:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790946201.089411:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946201.089428:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3f83c64e00/0xd9f4181e0d27eaba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27eab3 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946201.089456:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3f83c64e00/0xd9f4181e0d27eaba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27eab3 expref: 6 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946201.089466:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3f83c64e00/0xd9f4181e0d27eaba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27eab3 expref: 6 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946201.089473:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64e00, rc 0) 00000100:00100000:0.0:1790946201.089516:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+6:22703:x1877942638697472:12345-0@lo:101:mount.lustre.0 Request processed in 123us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946201.089522:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790946201.091287:0:22703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638697472:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790946201.091318:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27eab3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eaba expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946201.091329:0:22703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27eab3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27eaba expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946201.091439:0:22703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638697600:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946201.091493:0:22703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946201.091545:0:22703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d19840 going to sleep for 11 seconds 00000100:00100000:2.0:1790946201.094348:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638697600 00000100:00100000:2.0:1790946201.094364:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638697600 00000100:00100000:2.0:1790946201.094436:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790946201.094447:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+6:22703:x1877942638697600:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946201.094629:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+6:22703:x1877942638697600:12345-0@lo:501:mount.lustre.0 Request processed in 183us (3134us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790946201.094638:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790946201.094851:0:22703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638697600:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790946201.094901:0:22703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790946201.094936:0:22703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27eab3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eaba expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946201.094948:0:22703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27eab3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eaba expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946201.094959:0:22703:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d3f83705800 10000000:01000000:3.0:1790946201.094965:0:22703:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790946201.094971:0:22703:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d3f83705800 10000000:01000000:3.0:1790946201.094974:0:22703:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1790946201.094977:0:22703:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9d3f83705800 from 1 10000000:01000000:3.0:1790946201.094980:0:22703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1790946201.095014:0:22703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1200/0xd9f4181e0d27eac1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946201.095022:0:22703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40baef1200/0xd9f4181e0d27eac1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946201.095031:0:22703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40baef1200/0xd9f4181e0d27eac1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946201.095051:0:22703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638697728:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790946201.095107:0:22703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946201.095153:0:22703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d19840 going to sleep for 11 seconds 00000100:00100000:2.0:1790946201.096784:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638697728 00000100:00100000:2.0:1790946201.096809:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638697728 00000100:00100000:2.0:1790946201.096877:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790946201.096888:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+6:22703:x1877942638697728:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946201.096904:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946201.096938:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27eac8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27eac1 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946201.096964:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27eac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27eac1 expref: 7 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946201.096977:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d6000/0xd9f4181e0d27eac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27eac1 expref: 7 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946201.096985:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d6000, rc 0) 00000100:00100000:2.0:1790946201.097059:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+7:22703:x1877942638697728:12345-0@lo:101:mount.lustre.0 Request processed in 175us (1952us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946201.097066:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790946201.097414:0:22703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638697728:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790946201.097433:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40baef1200/0xd9f4181e0d27eac1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eac8 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946201.097441:0:22703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40baef1200/0xd9f4181e0d27eac1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27eac8 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946201.097460:0:22703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1790946201.097479:0:22703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef1200/0xd9f4181e0d27eac1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eac8 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946201.097487:0:22703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40baef1200/0xd9f4181e0d27eac1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eac8 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946201.097497:0:22703:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790946201.097503:0:22703:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790946201.097509:0:22703:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d3f83705800 10000000:01000000:3.0:1790946201.097512:0:22703:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1790946201.097516:0:22703:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1790946201.097520:0:22703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790946201.097558:0:22703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0e00/0xd9f4181e0d27eacf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946201.097575:0:22703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40baef0e00/0xd9f4181e0d27eacf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946201.097583:0:22703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40baef0e00/0xd9f4181e0d27eacf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946201.097620:0:22703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638697856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790946201.097656:0:22703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946201.097694:0:22703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d19840 going to sleep for 11 seconds 00000100:00100000:0.0:1790946201.097788:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638697856 00000100:00100000:0.0:1790946201.097805:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638697856 00000100:00100000:0.0:1790946201.097846:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790946201.097854:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+7:22703:x1877942638697856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790946201.097862:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946201.097873:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3f83c65600/0xd9f4181e0d27ead6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27eacf expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946201.097902:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3f83c65600/0xd9f4181e0d27ead6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27eacf expref: 8 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946201.097912:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3f83c65600/0xd9f4181e0d27ead6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27eacf expref: 8 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946201.097919:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65600, rc 0) 00000100:00100000:0.0:1790946201.097967:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+8:22703:x1877942638697856:12345-0@lo:101:mount.lustre.0 Request processed in 114us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946201.097974:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790946201.100133:0:22703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638697856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790946201.100191:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40baef0e00/0xd9f4181e0d27eacf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ead6 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946201.100205:0:22703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40baef0e00/0xd9f4181e0d27eacf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ead6 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946201.100306:0:22703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638697984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946201.100373:0:22703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946201.100416:0:22703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d19840 going to sleep for 11 seconds 00000100:00100000:0.0:1790946201.100675:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638697984 00000100:00100000:0.0:1790946201.100682:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638697984 00000100:00100000:0.0:1790946201.100750:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790946201.100760:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+8:22703:x1877942638697984:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946201.100971:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+9:22703:x1877942638697984:12345-0@lo:501:mount.lustre.0 Request processed in 211us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946201.100979:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790946201.102292:0:22703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638697984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946201.102382:0:22703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638698112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790946201.102447:0:22703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946201.102492:0:22703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d19840 going to sleep for 11 seconds 00000100:00100000:2.0:1790946201.103511:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638698112 00000100:00100000:2.0:1790946201.103548:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638698112 00000100:00100000:2.0:1790946201.103621:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790946201.103632:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+9:22703:x1877942638698112:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790946201.109803:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+9:22703:x1877942638698112:12345-0@lo:503:mount.lustre.0 Request processed in 6153us (7335us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946201.109818:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790946201.110102:0:22703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638698112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790946201.110935:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e26a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22742:1877942638698240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790946201.110992:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946201.111115:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d19e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790946201.111300:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638698240 00000100:00100000:1.0:1790946201.111307:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638698240 00000100:00100000:1.0:1790946201.111342:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790946201.111351:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+9:22742:x1877942638698240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946201.115316:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+9:22742:x1877942638698240:12345-0@lo:502:llog_process_th.0 Request processed in 3956us (4313us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946201.115331:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790946201.115464:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e26a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22742:1877942638698240:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790946201.115505:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790946201.115524:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946201.115527:0:22742:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790946201.115533:0:22742:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1790946201.115536:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790946201.115554:0:22742:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9d40b4a44d40) 00000020:00000080:3.0:1790946201.115582:0:22742:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1790946201.115588:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790946201.115683:0:22742:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790946201.115691:0:22742:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd9f4181e0d27eae4 00000020:00000080:3.0:1790946201.115917:0:22742:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790946201.115931:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946201.115935:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946201.115937:0:22742:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790946201.115940:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790946201.115943:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946201.115945:0:22742:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1790946201.115948:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790946201.115956:0:22742:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9d40b4a43380) 00000020:00000080:3.0:1790946201.115969:0:22742:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1790946201.115973:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1790946201.115975:0:22742:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1790946201.115979:0:22742:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1790946201.115984:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790946201.116288:0:22742:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3f83705800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1790946201.116304:0:22742:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9d40b4a40000) 00000020:00000080:3.0:1790946201.116312:0:22742:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1790946201.116372:0:22742:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1790946201.116378:0:22742:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd9f4181e0d27eaf9 00000020:00000080:3.0:1790946201.116470:0:22742:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1790946201.116476:0:22742:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1790946201.116480:0:22742:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd9f4181e0d27eb00 00080000:01000000:3.0:1790946201.116485:0:22742:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790946201.116489:0:22742:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd9f4181e0d27eb07 00010000:00010000:1.0:1790946201.251979:0:22742:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1790946201.252480:0:22742:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:1.0:1790946201.253092:0:22742:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1790946201.254230:0:22742:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9d40accf19c0) 00000020:00000080:1.0:1790946201.254257:0:22742:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1790946201.254388:0:22742:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:1.0:1790946201.254399:0:22742:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd9f4181e0d27eb15 00000020:00000080:2.0:1790946201.255226:0:22742:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1790946201.268505:0:22742:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd9f4181e0d27eb1c 00000020:00000080:2.0:1790946201.270059:0:22742:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1790946201.270073:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946201.270082:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946201.270085:0:22742:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1790946201.270089:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790946201.270091:0:22742:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1790946201.270093:0:22742:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790946201.270094:0:22742:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790946201.270095:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790946201.270098:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946201.270099:0:22742:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790946201.270101:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946201.270106:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946201.270107:0:22742:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1790946201.270111:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1790946201.270192:0:22742:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1790946201.270212:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946201.270217:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946201.270218:0:22742:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1790946201.270221:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790946201.270270:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946201.270284:0:22742:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1790946201.270289:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790946201.270296:0:22742:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:00000080:3.0:1790946201.270329:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790946201.270349:0:22742:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9d40b4a419c0) 00000020:00000080:3.0:1790946201.270367:0:22742:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1790946201.270372:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790946201.270441:0:22742:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1790946201.270447:0:22742:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:3.0:1790946201.270453:0:22742:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd9f4181e0d27eb2a 00010000:00080000:3.0:1790946201.270486:0:22742:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d4096c64800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:3.0:1790946201.272160:0:22742:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1790946201.277781:0:22742:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790946201.277810:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1790946201.277848:0:22742:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1790946201.277870:0:22742:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd9f4181e0d27eb31 00000100:00080000:2.0:1790946201.277881:0:22742:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790946201.277891:0:22742:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d4096c64800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790946201.277938:0:22742:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40bff72d80 x1877942638698368/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790946201.278016:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638698368:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790946201.278088:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946201.278207:0:22729:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638698368 00000100:00100000:1.0:1790946201.278218:0:22729:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638698368 00000100:00100000:1.0:1790946201.278262:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790946201.278270:0:22729:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1877942638698368:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1790946201.278285:0:22729:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1790946201.281360:0:22742:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1790946201.281481:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946201.281489:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946201.281491:0:22742:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1790946201.281496:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790946201.281499:0:22742:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1790946201.281501:0:22742:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790946201.281503:0:22742:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790946201.281505:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790946201.281508:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946201.281509:0:22742:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790946201.281512:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790946201.281517:0:22742:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1790946201.281521:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946201.281522:0:22742:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1790946201.281526:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790946201.281530:0:22742:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:2.0:1790946201.281567:0:22742:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790946201.281570:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790946201.281588:0:22742:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9d40bca80000) 00000020:00000080:2.0:1790946201.281609:0:22742:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1790946201.281614:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790946201.281696:0:22742:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1790946201.281702:0:22742:0:(osd_handler.c:8931:osd_obd_connect()) connect #6 00000020:00000080:2.0:1790946201.281708:0:22742:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd9f4181e0d27eb3f 00010000:00080000:2.0:1790946201.281737:0:22742:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d4096c61000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1790946201.282007:0:22742:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1790946201.284139:0:22742:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790946201.284705:0:22742:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1790946201.285081:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790946201.285097:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3648:1877942638698496:0@lo:400:kworker.0 00000100:00100000:3.0:1790946201.285192:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946201.286813:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638698496 00000100:00100000:3.0:1790946201.286829:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638698496 00000100:00100000:3.0:1790946201.286882:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790946201.286890:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+9:3648:x1877942638698496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946201.286995:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+9:3648:x1877942638698496:12345-0@lo:400:kworker.0 Request processed in 105us (1834us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946201.287003:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790946201.287057:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3648:1877942638698496:0@lo:400:kworker.0 00000040:00080000:2.0:1790946201.291094:0:22742:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790946201.291908:0:22742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1790946201.307597:0:22742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000100:00100000:1.0:1790946201.307729:0:22729:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1877942638698368:12345-0@lo:38:llog_process_th.0 Request processed in 29454us (29635us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790946201.307755:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790946201.308299:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d4096c64800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790946201.308305:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790946201.308309:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638698368:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1790946201.309050:0:22748:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1790946201.309056:0:22748:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1790946201.315018:0:22742:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790946201.315038:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790946201.315093:0:22742:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790946201.315117:0:22742:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd9f4181e0d27eb46 00000100:00080000:0.0:1790946201.315131:0:22742:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790946201.315142:0:22742:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d4096c61000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1790946201.315325:0:22742:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40812e8e00 x1877942638698624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790946201.315389:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638698624:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1790946201.315467:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877942638698624 offset 0 length 520: 4 00000100:00080000:0.0:1790946201.315619:0:22742:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1790946201.315695:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790946201.315700:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946201.315702:0:22742:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1790946201.315705:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790946201.315708:0:22742:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1790946201.315709:0:22742:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790946201.315711:0:22742:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790946201.315713:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790946201.315715:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946201.315717:0:22742:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790946201.315719:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790946201.315723:0:22742:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1790946201.315727:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946201.315728:0:22742:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1790946201.315731:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790946201.315735:0:22742:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:0.0:1790946201.315756:0:22742:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1790946201.315759:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790946201.315773:0:22742:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9d40b4418000) 00000020:00000080:0.0:1790946201.315787:0:22742:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1790946201.315791:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790946201.315870:0:22742:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1790946201.315878:0:22742:0:(osd_handler.c:8931:osd_obd_connect()) connect #7 00000020:00000080:0.0:1790946201.315884:0:22742:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd9f4181e0d27eb54 00010000:00080000:0.0:1790946201.315913:0:22742:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3f81bb0800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:0.0:1790946201.316312:0:22742:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1790946201.316388:0:22742:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790946201.316654:0:22742:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1790946201.319678:0:22742:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790946201.320050:0:22742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1790946201.320272:0:22742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:0.0:1790946201.320849:0:22750:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1790946201.320854:0:22750:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1790946201.321802:0:22742:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790946201.321816:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790946201.321854:0:22742:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790946201.321877:0:22742:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd9f4181e0d27eb5b 00000100:00080000:0.0:1790946201.321888:0:22742:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790946201.321901:0:22742:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d3f81bb0800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1790946201.322022:0:22742:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40812e8700 x1877942638698752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790946201.322091:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638698752:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1790946201.322144:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877942638698752 offset 0 length 520: 4 00000100:00080000:0.0:1790946201.322233:0:22742:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1790946201.322350:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790946201.322354:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946201.322356:0:22742:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1790946201.322360:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790946201.322363:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946201.322365:0:22742:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790946201.322368:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790946201.322370:0:22742:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790946201.322372:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790946201.322374:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946201.322386:0:22742:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790946201.322390:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790946201.322393:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946201.322394:0:22742:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790946201.322398:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790946201.322441:0:22742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22742:1877942638698880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790946201.322508:0:22742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946201.322527:0:22742:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4083687900 going to sleep for 11 seconds 00000100:00100000:1.0:1790946201.322868:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638698880 00000100:00100000:1.0:1790946201.322877:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638698880 00000100:00100000:1.0:1790946201.322973:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790946201.322984:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+9:22742:x1877942638698880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946201.323126:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+9:22742:x1877942638698880:12345-0@lo:502:llog_process_th.0 Request processed in 143us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946201.323134:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790946201.323218:0:22742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22742:1877942638698880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790946201.323246:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790946201.323251:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946201.323253:0:22742:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790946201.323256:0:22742:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1790946201.323572:0:22703:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1790946201.323594:0:22703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790946201.323616:0:22703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0e00/0xd9f4181e0d27eacf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ead6 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946201.323627:0:22703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40baef0e00/0xd9f4181e0d27eacf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ead6 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946201.323635:0:22703:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d3f83705800 from 1 10000000:01000000:2.0:1790946201.323638:0:22703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790946201.323671:0:22703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6600/0xd9f4181e0d27eb62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946201.323679:0:22703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6600/0xd9f4181e0d27eb62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946201.323688:0:22703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6600/0xd9f4181e0d27eb62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946201.323705:0:22703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638699008:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790946201.323742:0:22703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946201.325864:0:22703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f240 going to sleep for 11 seconds 00000100:00100000:3.0:1790946201.326149:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638699008 00000100:00100000:3.0:1790946201.326159:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638699008 00000100:00100000:3.0:1790946201.326219:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790946201.326240:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+9:22703:x1877942638699008:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790946201.326256:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946201.326277:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27eb69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27eb62 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946201.326302:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27eb69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27eb62 expref: 10 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946201.326313:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27eb69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27eb62 expref: 10 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946201.326321:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef0c00, rc 0) 00000100:00100000:3.0:1790946201.326374:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+10:22703:x1877942638699008:12345-0@lo:101:mount.lustre.0 Request processed in 135us (2632us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946201.326380:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790946201.326530:0:22703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638699008:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946201.326549:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6600/0xd9f4181e0d27eb62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eb69 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946201.326566:0:22703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6600/0xd9f4181e0d27eb62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27eb69 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946201.327349:0:22703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638699136:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1790946201.327402:0:22703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946201.327724:0:22703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f240 going to sleep for 11 seconds 00000100:00100000:3.0:1790946201.327750:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638699136 00000100:00100000:3.0:1790946201.327757:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638699136 00000100:00100000:3.0:1790946201.327789:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790946201.327797:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+10:22703:x1877942638699136:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1790946201.327815:0:22717:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1790946201.327821:0:22717:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1790946201.327900:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+10:22703:x1877942638699136:12345-0@lo:256:mount.lustre.0 Request processed in 103us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946201.327907:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790946201.328136:0:22703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638699136:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1790946201.328895:0:22703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790946201.328932:0:22703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6600/0xd9f4181e0d27eb62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eb69 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946201.328943:0:22703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6600/0xd9f4181e0d27eb62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eb69 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946201.328951:0:22703:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3f83705800 from 1 10000000:01000000:2.0:1790946201.328954:0:22703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790946201.328986:0:22703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27eb70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946201.328994:0:22703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27eb70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946201.329004:0:22703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27eb70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946201.329019:0:22703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638699264:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790946201.329062:0:22703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946201.329076:0:22703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f240 going to sleep for 11 seconds 00000100:00100000:3.0:1790946201.329351:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638699264 00000100:00100000:3.0:1790946201.329358:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638699264 00000100:00100000:3.0:1790946201.329385:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790946201.329393:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+10:22703:x1877942638699264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790946201.329422:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946201.329435:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef0400/0xd9f4181e0d27eb77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27eb70 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946201.329457:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef0400/0xd9f4181e0d27eb77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27eb70 expref: 11 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946201.329468:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef0400/0xd9f4181e0d27eb77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27eb70 expref: 11 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946201.329476:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef0400, rc 0) 00000100:00100000:3.0:1790946201.329517:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+11:22703:x1877942638699264:12345-0@lo:101:mount.lustre.0 Request processed in 124us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946201.329524:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790946201.329872:0:22703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638699264:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946201.329888:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27eb70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eb77 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946201.329898:0:22703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27eb70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27eb77 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946201.329975:0:22703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638699392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946201.330005:0:22703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946201.330039:0:22703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f240 going to sleep for 11 seconds 00000100:00100000:3.0:1790946201.330154:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638699392 00000100:00100000:3.0:1790946201.330159:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638699392 00000100:00100000:3.0:1790946201.330206:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790946201.330213:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+11:22703:x1877942638699392:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946201.330351:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+11:22703:x1877942638699392:12345-0@lo:501:mount.lustre.0 Request processed in 138us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946201.330359:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790946201.330628:0:22703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638699392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946201.330675:0:22703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638699520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790946201.330727:0:22703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946201.330846:0:22703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f240 going to sleep for 11 seconds 00000100:00100000:0.0:1790946201.331060:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638699520 00000100:00100000:0.0:1790946201.331066:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638699520 00000100:00100000:3.0:1790946201.331112:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790946201.331120:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+11:22703:x1877942638699520:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790946201.331227:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+11:22703:x1877942638699520:12345-0@lo:503:mount.lustre.0 Request processed in 108us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946201.331234:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790946201.331324:0:22703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638699520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790946201.331794:0:22752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22752:1877942638699648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790946201.331833:0:22752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946201.331864:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f600 going to sleep for 11 seconds 00000100:00100000:1.0:1790946201.334150:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638699648 00000100:00100000:1.0:1790946201.334195:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638699648 00000100:00100000:1.0:1790946201.334270:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790946201.334280:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+11:22752:x1877942638699648:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946201.337640:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+11:22752:x1877942638699648:12345-0@lo:502:llog_process_th.0 Request processed in 3352us (5796us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946201.337655:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790946201.337730:0:22752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22752:1877942638699648:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790946201.337767:0:22752:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946201.337777:0:22752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946201.337780:0:22752:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790946201.337787:0:22752:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3f83705800 00000020:00000080:2.0:1790946201.337789:0:22752:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790946201.337797:0:22752:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946201.337799:0:22752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946201.337809:0:22752:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1790946201.337812:0:22752:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946201.337815:0:22752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946201.337817:0:22752:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790946201.337820:0:22752:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3f83705800 00000020:00000080:2.0:1790946201.337822:0:22752:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790946201.337891:0:22752:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946201.337895:0:22752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946201.337897:0:22752:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1790946201.337899:0:22752:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946201.337901:0:22752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946201.337903:0:22752:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790946201.337906:0:22752:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d3f83705800 00000020:00000080:2.0:1790946201.337908:0:22752:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790946201.339155:0:22752:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946201.339161:0:22752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946201.339163:0:22752:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790946201.339179:0:22752:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946201.339184:0:22752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946201.339186:0:22752:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1790946201.339191:0:22752:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d3f83705800 00000020:00000080:2.0:1790946201.339193:0:22752:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790946201.339253:0:22752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22752:1877942638699776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790946201.339319:0:22752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946201.339362:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f600 going to sleep for 11 seconds 00000100:00100000:0.0:1790946201.339475:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638699776 00000100:00100000:0.0:1790946201.339484:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638699776 00000100:00100000:0.0:1790946201.339532:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790946201.339541:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+11:22752:x1877942638699776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790946201.339673:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+11:22752:x1877942638699776:12345-0@lo:502:llog_process_th.0 Request processed in 132us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946201.339680:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790946201.340589:0:22752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22752:1877942638699776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790946201.340622:0:22752:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946201.340629:0:22752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946201.340631:0:22752:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1790946201.340635:0:22752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1790946201.344622:0:22703:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1790946201.344668:0:22703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790946201.344689:0:22703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27eb70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eb77 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946201.344708:0:22703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27eb70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eb77 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946201.344788:0:22703:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790946201.344792:0:22703:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d3f83705800 10000000:01000000:0.0:1790946201.344795:0:22703:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d3f83705800 10000000:01000000:0.0:1790946201.344800:0:22703:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790946201.344806:0:22703:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d3f83705800 from 1 10000000:01000000:0.0:1790946201.344808:0:22703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790946201.344856:0:22703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64400/0xd9f4181e0d27eb7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946201.344865:0:22703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64400/0xd9f4181e0d27eb7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946201.344876:0:22703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64400/0xd9f4181e0d27eb7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946201.344900:0:22703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638699904:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790946201.344986:0:22703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946201.345032:0:22703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d199c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946201.345099:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638699904 00000100:00100000:1.0:1790946201.345107:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638699904 00000100:00100000:1.0:1790946201.345154:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790946201.345163:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+11:22703:x1877942638699904:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790946201.345202:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946201.345215:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40813ff600/0xd9f4181e0d27eb85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27eb7e expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946201.345239:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40813ff600/0xd9f4181e0d27eb85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27eb7e expref: 12 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946201.345250:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40813ff600/0xd9f4181e0d27eb85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27eb7e expref: 12 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946201.345265:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813ff600, rc 0) 00000100:00100000:1.0:1790946201.345306:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:22703:x1877942638699904:12345-0@lo:101:mount.lustre.0 Request processed in 144us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946201.345313:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790946201.345571:0:22703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638699904:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790946201.345587:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64400/0xd9f4181e0d27eb7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eb85 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946201.345597:0:22703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64400/0xd9f4181e0d27eb7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27eb85 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946201.345655:0:22703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638700032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946201.345684:0:22703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946201.345759:0:22703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d199c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946201.347651:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638700032 00000100:00100000:1.0:1790946201.347665:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638700032 00000100:00100000:1.0:1790946201.347939:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790946201.347953:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:22703:x1877942638700032:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946201.348152:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:22703:x1877942638700032:12345-0@lo:501:mount.lustre.0 Request processed in 203us (2467us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946201.348161:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790946201.348984:0:22703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638700032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946201.349040:0:22703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638700160:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790946201.349096:0:22703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946201.349139:0:22703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096d199c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946201.349719:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638700160 00000100:00100000:1.0:1790946201.349727:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638700160 00000100:00100000:1.0:1790946201.349774:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790946201.349783:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:22703:x1877942638700160:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790946201.352132:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:22703:x1877942638700160:12345-0@lo:503:mount.lustre.0 Request processed in 2340us (3025us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946201.352147:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790946201.353434:0:22703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638700160:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790946201.360929:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22756:1877942638700288:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946201.361018:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946201.361063:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638700288 00000100:00100000:1.0:1790946201.361070:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638700288 00000100:00100000:1.0:1790946201.361112:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790946201.361121:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:22756:x1877942638700288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946201.361262:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:22756:x1877942638700288:12345-0@lo:502:llog_process_th.0 Request processed in 141us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946201.361275:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790946201.361328:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084caeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790946201.361349:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22756:1877942638700288:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1790946201.361421:0:22756:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1790946201.361435:0:22756:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9d40accf0000) 00000020:00000080:1.0:1790946201.361454:0:22756:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1790946201.361538:0:22756:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3f83705800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790946201.361543:0:22756:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3f83705800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790946201.361545:0:22756:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d3f83705800 4 00010000:00080000:1.0:1790946201.361575:0:22756:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d40914a0000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:1.0:1790946201.363138:0:22756:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1790946201.363376:0:22756:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1790946201.363415:0:22756:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790946201.363430:0:22756:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd9f4181e0d27eb93 00000100:00080000:1.0:1790946201.363443:0:22756:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790946201.363454:0:22756:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9d40914a0000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1790946201.363489:0:22756:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f8441f480 x1877942638700416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790946201.363515:0:22756:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790946201.368310:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22756:1877942638700544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946201.368483:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946201.368533:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638700544 00000100:00100000:1.0:1790946201.368540:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638700544 00000100:00100000:1.0:1790946201.368582:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790946201.368591:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:22756:x1877942638700544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946201.368708:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:22756:x1877942638700544:12345-0@lo:502:llog_process_th.0 Request processed in 118us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946201.368723:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790946201.368776:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084cae180 going to sleep for 11 seconds 00000100:00100000:1.0:1790946201.368799:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22756:1877942638700544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946201.368840:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22756:1877942638700672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946201.369527:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946201.369559:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638700672 00000100:00100000:1.0:1790946201.369566:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638700672 00000100:00100000:1.0:1790946201.369603:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790946201.369610:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4090317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:22756:x1877942638700672:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946201.369694:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4090317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:22756:x1877942638700672:12345-0@lo:502:llog_process_th.0 Request processed in 84us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946201.369702:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790946201.369744:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084cae180 going to sleep for 11 seconds 00000100:00100000:1.0:1790946201.369759:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22756:1877942638700672:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1790946201.369785:0:22756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1790946201.370790:0:22703:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1790946201.370822:0:22703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790946201.370838:0:22703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64400/0xd9f4181e0d27eb7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eb85 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946201.371080:0:22703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64400/0xd9f4181e0d27eb7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eb85 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790946201.371137:0:22703:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790946201.371139:0:22703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790946201.371140:0:22703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790946201.371145:0:22703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790946201.371146:0:22703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790946201.371147:0:22703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790946201.371148:0:22703:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790946201.371150:0:22703:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790946201.371151:0:22703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790946201.371152:0:22703:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790946201.371156:0:22703:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1790946201.371159:0:22703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790946201.371160:0:22703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790946201.371161:0:22703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790946201.371162:0:22703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790946201.371163:0:22703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790946201.371164:0:22703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790946201.371181:0:22703:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790946201.371183:0:22703:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790946201.371184:0:22703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790946201.371184:0:22703:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790946201.371207:0:22703:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790946201.371220:0:22703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638700800:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790946201.371271:0:22703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946201.371302:0:22703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084cae180 going to sleep for 11 seconds 00000100:00100000:1.0:1790946201.371345:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638700800 00000100:00100000:1.0:1790946201.371351:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638700800 00000100:00100000:1.0:1790946201.371392:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790946201.371400:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4090317050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:22703:x1877942638700800:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790946201.371436:0:22719:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790946201.371450:0:22719:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1790946201.372105:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1877942638700416:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790946201.372160:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946201.373000:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638700416 00000100:00100000:2.0:1790946201.373015:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638700416 00000100:00100000:2.0:1790946201.373052:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790946201.373059:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1877942638700416:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790946201.373139:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1877942638700416:12345-0@lo:38:llog_process_th.0 Request processed in 80us (977us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790946201.373147:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790946201.373221:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790946201.373230:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40914a0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790946201.373235:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790946201.373238:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1877942638700416:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1790946201.374847:0:22719:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790946201.374862:0:22719:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1790946201.377366:0:22740:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790946201.377377:0:22740:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790946201.377414:0:22740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d40813ff000/0xd9f4181e0d27eb9a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946201.377433:0:22740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27eb69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27eb62 expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946201.377453:0:22740:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d40813ff000/0xd9f4181e0d27eb9a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946201.377493:0:22740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27eb69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27eb62 expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946201.377508:0:22740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27eb69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27eb62 expref: 12 pid: 22717 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946201.377522:0:22740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22740:1877942638700928:0@lo:104: 00000100:00100000:1.0:1790946201.377602:0:22740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946201.377634:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4090317050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:22703:x1877942638700800:12345-0@lo:253:mount.lustre.0 Request processed in 6234us (6361us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946201.377644:0:22740:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084cae780 going to sleep for 11 seconds 00000100:00100000:2.0:1790946201.377646:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790946201.377680:0:22703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22703:1877942638700800:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790946201.377693:0:22703:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790946201.377697:0:22703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790946201.377699:0:22703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790946201.377700:0:22703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790946201.377701:0:22703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790946201.377703:0:22703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790946201.377704:0:22703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790946201.377705:0:22703:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000100:00100000:2.0:1790946201.377707:0:22707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638700928 00000020:01000004:1.0:1790946201.377707:0:22703:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790946201.377708:0:22703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790946201.377710:0:22703:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1790946201.377713:0:22707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638700928 00000020:02000000:1.0:1790946201.377722:0:22703:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1790946201.377763:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790946201.377772:0:22707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+3:22740:x1877942638700928:12345-0@lo:104: 00010000:00010000:2.0:1790946201.377784:0:22707:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6600/0xd9f4181e0d27eb62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27eb69 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946201.377835:0:22707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790946201.377841:0:22707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+3:22740:x1877942638700928:12345-0@lo:104: Request processed in 71us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946201.377846:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1790946201.379384:0:22713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946201.379399:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6600/0xd9f4181e0d27eb62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27eb69 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946201.379410:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6600 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:3.0:1790946201.379414:0:22713:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6600/0xd9f4181e0d27eb62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27eb69 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946201.379425:0:22713:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6600/0xd9f4181e0d27eb62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27eb69 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946201.379433:0:22713:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6600/0xd9f4181e0d27eb62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27eb69 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946201.379440:0:22713:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790946201.379493:0:22713:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6600/0xd9f4181e0d27eb62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27eb69 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946201.379501:0:22713:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790946201.379525:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6600/0xd9f4181e0d27eb62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27eb69 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946201.379532:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6600/0xd9f4181e0d27eb62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27eb69 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946201.379549:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946201.379551:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946201.379553:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946201.379571:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3648:1877942638701056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790946201.379644:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946201.381063:0:22709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638701056 00000100:00100000:0.0:1790946201.381078:0:22709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638701056 00010000:00010000:0.0:1790946201.381112:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27eb69 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27eb62 expref: 12 pid: 22717 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946201.381158:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790946201.381190:0:22709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:3648:x1877942638701056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790946201.381206:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946201.381212:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27eb69 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27eb62 expref: 12 pid: 22717 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946201.381225:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27eb69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27eb62 expref: 12 pid: 22717 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946201.381315:0:22709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d40813ff000/0xd9f4181e0d27eb9a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946201.381325:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40813ff000/0xd9f4181e0d27eb9a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790946201.381342:0:22709:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003966590s 00010000:00010000:0.0:1790946201.381347:0:22709:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40813ff000/0xd9f4181e0d27eb9a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946201.381441:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40813ff000/0xd9f4181e0d27eb9a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946201.381448:0:22709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d40813ff000/0xd9f4181e0d27eb9a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946201.381455:0:22709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d40813ff000/0xd9f4181e0d27eb9a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946201.381460:0:22709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813ff000 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790946201.381465:0:22709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d40813ff000/0xd9f4181e0d27eb9a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946201.381473:0:22709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d40813ff000/0xd9f4181e0d27eb9a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946201.381482:0:22709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d40813ff000/0xd9f4181e0d27eb9a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946201.381492:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946201.381566:0:22709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:3648:x1877942638701056:12345-0@lo:103:ldlm_bl.0 Request processed in 399us (1920us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946201.381575:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790946201.381604:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3648:1877942638701056:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790946201.382458:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef0c00/0xd9f4181e0d27eb69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27eb62 expref: 11 pid: 22717 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946201.382475:0:22740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22740:1877942638700928:0@lo:104: 00010000:00010000:0.0:1790946201.382496:0:22740:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d40813ff000/0xd9f4181e0d27eb9a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946201.382515:0:22740:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d40813ff000/0xd9f4181e0d27eb9a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946201.382522:0:22740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d40813ff000/0xd9f4181e0d27eb9a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946201.382528:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40813ff000/0xd9f4181e0d27eb9a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1790946201.418221:0:22703:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:1.0:1790946201.418633:0:22703:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1790946201.418695:0:22764:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:2.0:1790946201.418700:0:22764:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:01000000:2.0:1790946201.418940:0:22765:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1790946201.419050:0:22703:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:0.0:1790946201.419599:0:22766:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9d40812e9c00 x1877942638701184/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946201.419611:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a93c0 going to sleep for 0 seconds 00000040:00080000:2.0:1790946201.419707:0:22765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1790946201.420028:0:22703:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1790946201.420065:0:22703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1790946201.421538:0:22703:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1790946201.421570:0:22703:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1790946201.421641:0:22703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790946201.423013:0:22765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790946201.423084:0:22765:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1790946201.424448:0:22703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1790946201.425563:0:22703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1790946201.425621:0:22703:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1790946201.426668:0:22703:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1790946201.428061:0:22703:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:1.0:1790946201.431117:0:22703:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1790946201.434313:0:22703:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1790946201.434352:0:22703:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb827c154b988 00100000:10000000:0.0:1790946201.434425:0:22703:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1790946201.435837:0:22703:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790946201.435858:0:22703:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790946201.435877:0:22703:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1790946201.435906:0:22703:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1790946201.436778:0:22703:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790946201.437040:0:22703:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790946201.887343:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790946202.400788:0:22760:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790946202.400799:0:22760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790946202.401803:0:22760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1790946202.401812:0:22760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1790946202.466077:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a93c0 going to sleep for 0 seconds 10000000:01000000:1.0:1790946202.787037:0:22721:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790946202.787046:0:22721:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d3f83705800 from 11 10000000:01000000:1.0:1790946202.787051:0:22721:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790946202.787102:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813fea00/0xd9f4181e0d27eba1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946202.787115:0:22721:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40813fea00/0xd9f4181e0d27eba1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946202.787126:0:22721:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40813fea00/0xd9f4181e0d27eba1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946202.787151:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638701312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790946202.787254:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946202.787293:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096c2bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790946202.787317:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638701312 00000100:00100000:1.0:1790946202.787325:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638701312 00000100:00100000:1.0:1790946202.787370:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790946202.787379:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4090314c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+11:22721:x1877942638701312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946202.787394:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946202.787407:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27eba8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27eba1 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946202.787442:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27eba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27eba1 expref: 12 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946202.787453:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27eba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27eba1 expref: 12 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946202.787462:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813ffe00, rc 0) 00000100:00100000:1.0:1790946202.787500:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4090314c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:22721:x1877942638701312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946202.787507:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790946202.787564:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638701312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946202.787578:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40813fea00/0xd9f4181e0d27eba1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eba8 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946202.787586:0:22721:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40813fea00/0xd9f4181e0d27eba1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27eba8 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946202.788087:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638701440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790946202.788123:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946202.788140:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096c2bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1790946202.788523:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638701440 00000100:00100000:2.0:1790946202.788589:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638701440 00000100:00100000:2.0:1790946202.788803:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790946202.788812:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4090315450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:22721:x1877942638701440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790946202.788829:0:22719:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790946202.788844:0:22719:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790946202.788847:0:22719:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1790946202.789142:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4090315450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:22721:x1877942638701440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 330us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946202.789149:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790946202.789454:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638701440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790946202.789502:0:22721:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790946202.789511:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813fea00/0xd9f4181e0d27eba1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eba8 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946202.789521:0:22721:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40813fea00/0xd9f4181e0d27eba1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eba8 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946202.911538:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790946203.428232:0:22760:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790946203.428241:0:22760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790946203.428371:0:22760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1790946203.428411:0:22760:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790946203.431789:0:22760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:1.0:1790946203.487282:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a93c0 going to sleep for 0 seconds 00010000:00010000:0.0:1790946203.935875:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946204.518019:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a93c0 going to sleep for 0 seconds 00010000:00010000:3.0:1790946204.961601:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946205.536590:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a93c0 going to sleep for 0 seconds 00010000:00010000:3.0:1790946205.993757:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790946206.059663:0:23008:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1790946206.564311:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790946206.564318:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1790946206.564322:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d4096c64800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790946206.564331:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 652 00000100:00080000:2.0:1790946206.564337:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790946206.564349:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d4096c64800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790946206.564374:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40bff72680 x1877942638701696/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790946206.564392:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790946206.564396:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790946206.564399:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790946206.564403:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790946206.564415:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790946206.564418:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790946206.564420:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d40914a0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790946206.564426:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9d40914a0000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790946206.564441:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40bff71c00 x1877942638701824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790946206.564486:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790946206.564498:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3650:1877942638701568:0@lo:400:kworker.0 00000100:00100000:2.0:1790946206.564578:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946206.564627:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638701696:0@lo:38:kworker.0 00000100:00100000:2.0:1790946206.564722:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946206.564746:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1877942638701824:0@lo:38:kworker.0 00000100:00100000:2.0:1790946206.564788:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946206.564845:0:22730:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638701696 00000100:00100000:2.0:1790946206.564852:0:22730:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638701696 00000100:00100000:2.0:1790946206.564881:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790946206.564888:0:22730:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1877942638701696:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790946206.564906:0:22730:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790946206.564950:0:22730:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1877942638701696:12345-0@lo:38:kworker.0 Request processed in 61us (227us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790946206.564957:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1790946206.564997:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d4096c64800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790946206.565002:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790946206.565005:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638701696:0@lo:38:kworker.0 00000100:00100000:2.0:1790946206.565050:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638701824 00000100:00100000:2.0:1790946206.565060:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638701824 00000100:00100000:2.0:1790946206.565079:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790946206.565084:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1877942638701824:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1790946206.565100:0:22726:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 657 last 0 00000020:00000080:2.0:1790946206.565140:0:22726:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd9f4181e0d27ebaf 00000004:00100000:2.0:1790946206.565155:0:22726:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790946206.565333:0:22726:0:(import.c:65:import_set_state_nolock()) ffff9d40914a1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790946206.565375:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1877942638701824:12345-0@lo:38:kworker.0 Request processed in 289us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946206.565381:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790946206.565406:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d40bff71c00 x1877942638701824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790946216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790946206.565418:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1790946206.565425:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1790946206.565429:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790946206.565431:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40914a0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790946206.565436:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1877942638701824:0@lo:38:kworker.0 00000100:00100000:1.0:1790946206.566243:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638701568 00000100:00100000:1.0:1790946206.566251:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638701568 00000100:00100000:1.0:1790946206.566291:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790946206.566299:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4090315c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:3650:x1877942638701568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946206.566374:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4090315c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:3650:x1877942638701568:12345-0@lo:400:kworker.0 Request processed in 75us (1795us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946206.566390:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790946206.566441:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3650:1877942638701568:0@lo:400:kworker.0 00000100:00100000:1.0:1790946206.568393:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a93c0 going to sleep for 0 seconds 00000020:00000004:0.0:1790946207.005889:0:23060:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790946207.006104:0:23060:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790946207.009868:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946207.586043:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a93c0 going to sleep for 0 seconds 00000020:00000004:2.0:1790946207.931614:0:23111:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790946207.931899:0:23111:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790946208.034058:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946208.609064:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a93c0 going to sleep for 0 seconds 00010000:00010000:1.0:1790946209.058216:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946209.633898:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a93c0 going to sleep for 0 seconds 00010000:00010000:0.0:1790946210.080922:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946210.656730:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a93c0 going to sleep for 0 seconds 00010000:00010000:1.0:1790946211.103561:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946211.679273:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946201/real 1790946201] req@ffff9d40812e8700 x1877942638698752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946211 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946211.679306:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d40812e8700 x1877942638698752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946211 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946211.679316:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946201/real 1790946201] req@ffff9d40812e8e00 x1877942638698624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946211 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946211.679354:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d40812e8e00 x1877942638698624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946211 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790946211.679373:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f81bb0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790946211.679383:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790946211.679387:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638698752:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790946211.679394:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d4096c61000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790946211.679398:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790946211.679400:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638698624:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1790946211.679557:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790946211.679562:0:15915:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1790946211.679564:0:15915:0:(import.c:65:import_set_state_nolock()) ffff9d4096c64800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790946211.679569:0:15915:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 657 00000100:00080000:3.0:1790946211.679574:0:15915:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790946211.679585:0:15915:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d4096c64800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1790946211.679587:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3650:1877942638701952:0@lo:400:kworker.0 00000100:00100000:3.0:1790946211.679606:0:15915:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f84e24380 x1877942638702080/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790946211.679623:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946211.679627:0:15915:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790946211.679629:0:15915:0:(import.c:65:import_set_state_nolock()) ffff9d4096c61000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790946211.679632:0:15915:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 652 00000100:00080000:3.0:1790946211.679634:0:15915:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790946211.679648:0:15915:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d4096c61000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790946211.679664:0:15915:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f84e27800 x1877942638702208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790946211.679673:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790946211.679681:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946211.679684:0:15915:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790946211.679686:0:15915:0:(import.c:65:import_set_state_nolock()) ffff9d3f81bb0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790946211.679689:0:15915:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 652 00000100:00080000:3.0:1790946211.679692:0:15915:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790946211.679696:0:15915:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d3f81bb0800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790946211.679723:0:15915:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f84e27b80 x1877942638702336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790946211.679771:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638702464:0@lo:400:kworker.0 00000100:00100000:1.0:1790946211.679775:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638701952 00000100:00100000:1.0:1790946211.679784:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638701952 00000100:00100000:3.0:1790946211.679814:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946211.679897:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638702464 00000100:00100000:2.0:1790946211.679902:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638702464 00000100:00100000:1.0:1790946211.679912:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790946211.679925:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40929a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:3650:x1877942638701952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946211.679938:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790946211.679948:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638702464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946211.679980:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40929a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:3650:x1877942638701952:12345-0@lo:400:kworker.0 Request processed in 59us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946211.679988:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790946211.680011:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638702464:12345-0@lo:400:kworker.0 Request processed in 64us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946211.680019:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790946211.680034:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3650:1877942638701952:0@lo:400:kworker.0 00010000:00080000:2.0:1790946211.680060:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d3f84e25500 x1877942638702464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946211.680070:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638702464:0@lo:400:kworker.0 00000100:00100000:0.0:1790946211.680193:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638702080:0@lo:38:kworker.0 00000100:00100000:0.0:1790946211.680257:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946211.680290:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638702208:0@lo:8:kworker.0 00000400:00000100:0.0:1790946211.680315:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877942638702208 offset 0 length 520: 4 00000100:00100000:0.0:1790946211.680334:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638702336:0@lo:8:kworker.0 00000400:00000100:0.0:1790946211.680354:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877942638702336 offset 0 length 520: 4 00000100:00100000:3.0:1790946211.680379:0:22730:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638702080 00000100:00100000:3.0:1790946211.680385:0:22730:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638702080 00000100:00100000:3.0:1790946211.680415:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790946211.680420:0:22730:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1877942638702080:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1790946211.680439:0:22730:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790946211.680484:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a93c0 going to sleep for 0 seconds 00000100:00100000:3.0:1790946211.680490:0:22730:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1877942638702080:12345-0@lo:38:kworker.0 Request processed in 66us (230us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790946211.680497:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1790946211.680556:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d4096c64800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790946211.680561:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790946211.680564:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638702080:0@lo:38:kworker.0 00010000:00010000:0.0:1790946212.127508:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946212.708913:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a93c0 going to sleep for 0 seconds 00010000:00010000:1.0:1790946213.154468:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790946213.665634:0:22760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790946213.727286:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a93c0 going to sleep for 0 seconds 00010000:00010000:3.0:1790946214.176920:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946214.756395:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a93c0 going to sleep for 0 seconds 00000020:01000004:3.0:1790946214.898541:0:23458:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790946214.898546:0:23458:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1790946214.898547:0:23458:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1790946214.898683:0:23458:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d4096c6b800 00000020:01000004:3.0:1790946214.898698:0:23458:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1790946214.898710:0:23458:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1790946214.898724:0:23458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9d40af68b380) 00000020:00000080:3.0:1790946214.898740:0:23458:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1790946214.966698:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1790946214.967853:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1790946214.969960:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1790946214.970304:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1790946214.970547:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1790946214.971229:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1790946214.971497:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1790946214.971739:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1790946214.971984:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1790946214.972492:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1790946214.972907:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1790946214.973527:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1790946214.973785:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1790946214.974075:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1790946214.974407:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1790946214.974642:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1790946214.974888:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1790946214.975194:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1790946214.975452:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1790946214.975694:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1790946214.975929:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1790946214.976421:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1790946214.976753:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1790946214.976990:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1790946214.977306:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1790946214.977579:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1790946214.977824:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1790946214.978113:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1790946214.978436:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1790946214.978668:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1790946214.978891:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1790946214.979162:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1790946214.979400:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1790946214.979586:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1790946214.981741:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1790946214.982219:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1790946214.982528:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1790946214.982768:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1790946214.982997:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1790946214.983323:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1790946214.983551:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1790946214.983859:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1790946214.984218:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1790946214.984456:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1790946214.984692:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1790946214.984918:0:23458:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:01000000:1.0:1790946214.985619:0:23458:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1790946214.985848:0:23458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1790946214.985858:0:23458:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790946214.985870:0:23458:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd9f4181e0d27ebbd 00000020:01000004:1.0:1790946214.985875:0:23458:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1790946214.985895:0:23458:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.120@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790946214.985898:0:23458:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790946214.985904:0:23458:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1790946214.985930:0:23458:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1790946214.985935:0:23458:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1790946214.990720:0:23458:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790946214.990761:0:23458:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.120@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1790946214.990766:0:23458:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790946214.990767:0:23458:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790946214.990773:0:23458:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946214.990774:0:23458:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946214.990775:0:23458:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946214.990776:0:23458:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946214.990778:0:23458:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790946214.990779:0:23458:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946214.990780:0:23458:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790946214.990784:0:23458:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1790946214.990786:0:23458:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790946214.990787:0:23458:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790946214.990789:0:23458:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946214.990790:0:23458:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946214.990791:0:23458:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946214.990792:0:23458:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946214.990793:0:23458:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790946214.990794:0:23458:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946214.990795:0:23458:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790946214.990835:0:23458:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1790946214.990856:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638702592:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790946214.990924:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946214.991082:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcbcde40 going to sleep for 11 seconds 00000100:00100000:3.0:1790946214.991137:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638702592 00000100:00100000:3.0:1790946214.991145:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638702592 00000100:00100000:3.0:1790946214.991413:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790946214.991424:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40929a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:23458:x1877942638702592:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790946214.991455:0:22718:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1790946214.991458:0:22718:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1790946214.991465:0:22718:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1790946214.991914:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40929a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:23458:x1877942638702592:12345-0@lo:253:mount.lustre.0 Request processed in 491us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946214.991923:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790946214.992011:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638702592:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790946214.992022:0:23458:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1790946214.992025:0:23458:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790946214.992026:0:23458:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790946214.992027:0:23458:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946214.992029:0:23458:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946214.992030:0:23458:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946214.992031:0:23458:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946214.992033:0:23458:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790946214.992034:0:23458:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946214.992035:0:23458:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790946214.992055:0:23458:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d4096c6b800 from lustre-MDT0001 10000000:01000000:2.0:1790946214.992079:0:23458:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1790946214.992083:0:23458:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1790946214.992090:0:23458:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d40accf4d40 local copy 00010000:00010000:2.0:1790946214.992101:0:23458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27eab3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eaba expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946214.992217:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638702720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946214.992249:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946214.992840:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f600 going to sleep for 11 seconds 00000100:00100000:1.0:1790946214.993096:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638702720 00000100:00100000:1.0:1790946214.993105:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638702720 00000100:00100000:1.0:1790946214.993146:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790946214.993154:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40929a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:23458:x1877942638702720:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946214.993274:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40929a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:23458:x1877942638702720:12345-0@lo:501:mount.lustre.0 Request processed in 120us (1023us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790946214.993307:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790946214.993445:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638702720:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790946214.993462:0:23458:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790946214.993485:0:23458:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790946214.993492:0:23458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27eab3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eaba expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946214.993502:0:23458:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27eab3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eaba expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946214.993532:0:23458:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d4096c6b800 10000000:01000000:2.0:1790946214.993537:0:23458:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790946214.993542:0:23458:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9d40accf4d40 10000000:01000000:2.0:1790946214.993544:0:23458:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1790946214.993547:0:23458:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9d40accf4d40 from 1 10000000:01000000:2.0:1790946214.993550:0:23458:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1790946214.993578:0:23458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27ebc4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946214.993587:0:23458:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27ebc4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946214.993595:0:23458:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27ebc4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946214.993677:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638702848:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790946214.993708:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946214.993739:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f600 going to sleep for 11 seconds 00000100:00100000:1.0:1790946214.993785:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638702848 00000100:00100000:1.0:1790946214.993790:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638702848 00000100:00100000:1.0:1790946214.993810:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790946214.993816:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+12:23458:x1877942638702848:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790946214.993825:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946214.993837:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40813ff800/0xd9f4181e0d27ebcb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ebc4 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946214.993857:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40813ff800/0xd9f4181e0d27ebcb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ebc4 expref: 13 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946214.993868:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40813ff800/0xd9f4181e0d27ebcb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ebc4 expref: 13 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946214.993877:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813ff800, rc 0) 00000100:00100000:1.0:1790946214.993913:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+13:23458:x1877942638702848:12345-0@lo:101:mount.lustre.0 Request processed in 97us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946214.993920:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790946214.994018:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638702848:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946214.994030:0:23458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27ebc4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ebcb expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946214.994039:0:23458:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27ebc4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ebcb expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946214.994054:0:23458:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1790946214.994070:0:23458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27ebc4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ebcb expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946214.994078:0:23458:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6200/0xd9f4181e0d27ebc4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ebcb expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946214.994085:0:23458:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d4096c6b800 10000000:01000000:2.0:1790946214.994089:0:23458:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1790946214.994092:0:23458:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9d4096c6b800 from 1 10000000:01000000:2.0:1790946214.994094:0:23458:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1790946214.994108:0:23458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7800/0xd9f4181e0d27ebd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946214.994116:0:23458:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7800/0xd9f4181e0d27ebd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946214.994124:0:23458:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7800/0xd9f4181e0d27ebd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946214.994142:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638702976:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790946214.994188:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946214.994201:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f600 going to sleep for 11 seconds 00000100:00100000:1.0:1790946214.994259:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638702976 00000100:00100000:1.0:1790946214.994264:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638702976 00000100:00100000:1.0:1790946214.994281:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790946214.994286:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+13:23458:x1877942638702976:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790946214.994305:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946214.994313:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40813ff400/0xd9f4181e0d27ebd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ebd2 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946214.994327:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40813ff400/0xd9f4181e0d27ebd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ebd2 expref: 14 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946214.994341:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40813ff400/0xd9f4181e0d27ebd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ebd2 expref: 14 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946214.994348:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813ff400, rc 0) 00000100:00100000:1.0:1790946214.994384:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+14:23458:x1877942638702976:12345-0@lo:101:mount.lustre.0 Request processed in 98us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946214.994391:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790946214.994505:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638702976:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946214.994516:0:23458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7800/0xd9f4181e0d27ebd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ebd9 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946214.994524:0:23458:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7800/0xd9f4181e0d27ebd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ebd9 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946214.994534:0:23458:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1790946214.994550:0:23458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7800/0xd9f4181e0d27ebd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ebd9 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946214.994558:0:23458:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7800/0xd9f4181e0d27ebd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ebd9 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946214.994564:0:23458:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1790946214.994568:0:23458:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790946214.994573:0:23458:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d4096c6b800 10000000:01000000:2.0:1790946214.994576:0:23458:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1790946214.994579:0:23458:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1790946214.994581:0:23458:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1790946214.994594:0:23458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6400/0xd9f4181e0d27ebe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946214.994601:0:23458:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6400/0xd9f4181e0d27ebe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946214.994615:0:23458:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6400/0xd9f4181e0d27ebe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946214.994627:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638703104:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790946214.994664:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946214.994683:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f600 going to sleep for 11 seconds 00000100:00100000:1.0:1790946214.994733:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638703104 00000100:00100000:1.0:1790946214.994738:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638703104 00000100:00100000:1.0:1790946214.994756:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790946214.994761:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+14:23458:x1877942638703104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790946214.994768:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946214.994776:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40813fe400/0xd9f4181e0d27ebe7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ebe0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946214.994789:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40813fe400/0xd9f4181e0d27ebe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ebe0 expref: 15 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946214.994798:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40813fe400/0xd9f4181e0d27ebe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ebe0 expref: 15 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946214.994805:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813fe400, rc 0) 00000100:00100000:1.0:1790946214.994840:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+15:23458:x1877942638703104:12345-0@lo:101:mount.lustre.0 Request processed in 78us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946214.994847:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790946214.994904:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638703104:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946214.994915:0:23458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6400/0xd9f4181e0d27ebe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ebe7 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946214.994923:0:23458:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6400/0xd9f4181e0d27ebe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ebe7 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790946214.996407:0:23458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1790946214.997086:0:23458:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790946215.006719:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1790946215.006779:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1790946215.006861:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1790946215.006876:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1790946215.006895:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1790946215.006912:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1790946215.006926:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1790946215.006940:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1790946215.006954:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1790946215.006969:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1790946215.006982:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1790946215.006997:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1790946215.007012:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1790946215.007027:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1790946215.007056:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1790946215.007071:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1790946215.007083:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1790946215.007097:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1790946215.007112:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1790946215.007126:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1790946215.007140:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1790946215.007152:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1790946215.007307:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1790946215.007333:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1790946215.007349:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1790946215.007364:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1790946215.007379:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1790946215.007394:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1790946215.007412:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1790946215.007432:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1790946215.007446:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1790946215.007459:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1790946215.007543:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1790946215.007563:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1790946215.007661:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1790946215.007681:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1790946215.007693:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1790946215.007706:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1790946215.007719:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1790946215.007733:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1790946215.007747:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1790946215.007762:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1790946215.007778:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1790946215.007852:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1790946215.007887:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1790946215.007894:0:23458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1790946215.008020:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638703232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946215.008112:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946215.008159:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946215.008213:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638703232 00000100:00100000:1.0:1790946215.008223:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638703232 00000100:00100000:1.0:1790946215.008285:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790946215.008421:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+15:23458:x1877942638703232:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946215.008581:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+15:23458:x1877942638703232:12345-0@lo:501:mount.lustre.0 Request processed in 162us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946215.008589:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790946215.008816:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638703232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946215.008851:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638703360:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790946215.009028:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946215.009059:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946215.009096:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638703360 00000100:00100000:0.0:1790946215.009101:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638703360 00000100:00100000:0.0:1790946215.009134:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790946215.009141:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+15:23458:x1877942638703360:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790946215.010795:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+15:23458:x1877942638703360:12345-0@lo:503:mount.lustre.0 Request processed in 1648us (1761us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946215.010808:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790946215.010844:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638703360:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790946215.011718:0:23458:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790946215.011808:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638703488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790946215.011887:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946215.011927:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f600 going to sleep for 11 seconds 00000100:00100000:3.0:1790946215.012117:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638703488 00000100:00100000:3.0:1790946215.012126:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638703488 00000100:00100000:3.0:1790946215.012195:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790946215.012204:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+15:23458:x1877942638703488:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946215.013145:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+15:23458:x1877942638703488:12345-0@lo:502:mount.lustre.0 Request processed in 938us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946215.013155:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790946215.013299:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638703488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790946215.013560:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1790946215.013586:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1790946215.013598:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1790946215.013610:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1790946215.013624:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1790946215.013640:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1790946215.013665:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1790946215.013681:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1790946215.013695:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1790946215.013710:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1790946215.013724:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1790946215.013755:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1790946215.013772:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1790946215.013784:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1790946215.013795:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1790946215.013815:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1790946215.013826:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1790946215.013837:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1790946215.013848:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1790946215.014110:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:2.0:1790946215.014128:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1790946215.014141:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1790946215.014151:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1790946215.014387:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1790946215.014410:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1790946215.014429:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1790946215.014441:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1790946215.014452:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1790946215.014463:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1790946215.014474:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1790946215.014485:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1790946215.014498:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1790946215.014513:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1790946215.014526:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1790946215.014540:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1790946215.014554:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1790946215.014567:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1790946215.014579:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1790946215.014592:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1790946215.014608:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1790946215.014623:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1790946215.014636:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1790946215.014659:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1790946215.014676:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1790946215.014716:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638703616:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790946215.014789:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946215.014946:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408704f600 going to sleep for 11 seconds 00000100:00100000:0.0:1790946215.020425:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638703616 00000100:00100000:0.0:1790946215.020444:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638703616 00000100:00100000:0.0:1790946215.021428:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790946215.021447:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+15:23458:x1877942638703616:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790946215.021631:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+15:23458:x1877942638703616:12345-0@lo:502:mount.lustre.0 Request processed in 190us (6841us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946215.021639:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790946215.021767:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638703616:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790946215.021851:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1790946215.021879:0:23458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1790946215.024991:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946215.025007:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946215.025009:0:23462:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1790946215.025016:0:23462:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1790946215.025019:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790946215.025036:0:23462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9d40bfe94d40) 00000020:00000080:2.0:1790946215.025058:0:23462:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1790946215.025064:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1790946215.025152:0:23462:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790946215.025159:0:23462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd9f4181e0d27ebf5 00000020:00000080:2.0:1790946215.025638:0:23462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1790946215.025643:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946215.025647:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946215.025658:0:23462:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1790946215.025663:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946215.025667:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946215.025668:0:23462:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1790946215.025671:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790946215.025679:0:23462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9d40bfe919c0) 00000020:00000080:2.0:1790946215.025691:0:23462:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1790946215.025695:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1790946215.025697:0:23462:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1790946215.025700:0:23462:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1790946215.025706:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790946215.026029:0:23462:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d4096c6b800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1790946215.026043:0:23462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9d40bfe90000) 00000020:00000080:2.0:1790946215.026056:0:23462:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1790946215.026109:0:23462:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1790946215.026115:0:23462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd9f4181e0d27ec0a 00000020:00000080:2.0:1790946215.027071:0:23462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1790946215.027082:0:23462:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1790946215.027090:0:23462:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xd9f4181e0d27ec11 00080000:01000000:2.0:1790946215.027098:0:23462:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:2.0:1790946215.027102:0:23462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd9f4181e0d27ec18 00010000:00010000:3.0:1790946215.112008:0:23462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1790946215.113479:0:23462:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:3.0:1790946215.114572:0:23462:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1790946215.119515:0:23462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1790946215.119530:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946215.119538:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946215.119547:0:23462:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1790946215.119552:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790946215.119558:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946215.119559:0:23462:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1790946215.119562:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790946215.119568:0:23462:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:00000080:3.0:1790946215.119596:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790946215.119610:0:23462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9d40af6899c0) 00000020:00000080:3.0:1790946215.119630:0:23462:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1790946215.119636:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790946215.119742:0:23462:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1790946215.119750:0:23462:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790946215.119757:0:23462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd9f4181e0d27ec26 00010000:00080000:3.0:1790946215.119795:0:23462:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d40bff09800@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.120@tcp at head 00010000:00010000:3.0:1790946215.121419:0:23462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1790946215.128759:0:23462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790946215.128776:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1790946215.128821:0:23462:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790946215.128846:0:23462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd9f4181e0d27ec2d 00000100:00080000:1.0:1790946215.128869:0:23462:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790946215.128882:0:23462:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9d40bff09800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1790946215.128921:0:23462:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f8441dc00 x1877942638703744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790946215.128948:0:23462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1790946215.129040:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946215.129044:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946215.129046:0:23462:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1790946215.129050:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790946215.129053:0:23462:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1790946215.129054:0:23462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790946215.129056:0:23462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790946215.129058:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790946215.129060:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946215.129061:0:23462:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790946215.129064:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790946215.129068:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946215.129070:0:23462:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1790946215.129073:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1790946215.129105:0:23462:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1790946215.129117:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946215.129126:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946215.129127:0:23462:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1790946215.129131:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790946215.129132:0:23462:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1790946215.129134:0:23462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790946215.129136:0:23462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790946215.129137:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790946215.129140:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946215.129141:0:23462:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790946215.129143:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790946215.129147:0:23462:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1790946215.129150:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946215.129152:0:23462:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1790946215.129154:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790946215.129158:0:23462:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:1.0:1790946215.129207:0:23462:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1790946215.129210:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790946215.129223:0:23462:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9d40accf3380) 00000020:00000080:1.0:1790946215.129235:0:23462:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1790946215.129239:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1790946215.129544:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638703744:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790946215.129615:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790946215.129754:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790946215.129760:0:15915:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1790946215.129763:0:15915:0:(import.c:65:import_set_state_nolock()) ffff9d4096c64800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790946215.129768:0:15915:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 662 00000100:00080000:2.0:1790946215.129773:0:15915:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1790946215.129780:0:15915:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d4096c64800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1790946215.129801:0:15915:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40bff71c00 x1877942638703872/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790946215.129821:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790946215.129826:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790946215.129828:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790946215.129831:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790946215.129880:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638704000:0@lo:400:kworker.0 00000100:00100000:2.0:1790946215.129914:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946215.129959:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638704000 00000100:00100000:2.0:1790946215.129967:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638704000 00000100:00100000:2.0:1790946215.130022:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790946215.130032:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638704000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946215.130081:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638704000:12345-0@lo:400:kworker.0 Request processed in 51us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946215.130088:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790946215.130134:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d40bff72680 x1877942638704000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946215.130147:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638704000:0@lo:400:kworker.0 00000100:00100000:2.0:1790946215.130203:0:22730:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638703744 00000100:00100000:2.0:1790946215.130208:0:22730:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638703744 00000100:00100000:2.0:1790946215.130227:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790946215.130232:0:22730:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1877942638703744:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790946215.130252:0:22730:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 665 last 0 00000020:00000080:2.0:1790946215.130285:0:22730:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd9f4181e0d27ec3b 00000004:00100000:2.0:1790946215.130299:0:22730:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1790946215.130517:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638703872:0@lo:38:kworker.0 00000100:00100000:0.0:1790946215.130550:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:2.0:1790946215.130595:0:22730:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:2.0:1790946215.130684:0:22729:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1790946215.130692:0:22729:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1790946215.131130:0:22729:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638703872 00000100:00100000:0.0:1790946215.131135:0:22729:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638703872 00000100:00100000:2.0:1790946215.131322:0:23467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790946215.131329:0:23467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1877942638703872:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1790946215.131393:0:23467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1877942638703872:12345-0@lo:38:kworker.0 Request processed in 63us (842us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790946215.131401:0:23467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790946215.131520:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790946215.131528:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d4096c64800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790946215.131533:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790946215.131537:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638703872:0@lo:38:kworker.0 00000004:00080000:1.0:1790946215.131596:0:23462:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1790946215.131606:0:23462:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:1.0:1790946215.131616:0:23462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd9f4181e0d27ec42 00010000:00080000:1.0:1790946215.131659:0:23462:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3f83c3e000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.120@tcp at head 00010000:00010000:1.0:1790946215.132250:0:23462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:1.0:1790946215.143894:0:23462:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1790946215.144271:0:23462:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1790946215.149584:0:23462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1790946215.149960:0:22730:0:(import.c:65:import_set_state_nolock()) ffff9d4087221000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790946215.150831:0:22730:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1877942638703744:12345-0@lo:38:llog_process_th.0 Request processed in 20591us (21208us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946215.150844:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:3.0:1790946215.151408:0:23462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1790946215.151624:0:23462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:0.0:1790946215.151710:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790946215.151722:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1790946215.151739:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1790946215.151744:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790946215.151748:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bff09800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790946215.151771:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638703744:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790946215.151978:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790946215.151994:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638704128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790946215.152138:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946215.152242:0:22729:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638704128 00000100:00100000:1.0:1790946215.152250:0:22729:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638704128 00000100:00100000:1.0:1790946215.152299:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790946215.152377:0:22729:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1877942638704128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790946215.152452:0:22729:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790946215.152521:0:22729:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1877942638704128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 213us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946215.152529:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790946215.152595:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638704128:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1790946215.155244:0:23468:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1790946215.155252:0:23468:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1790946215.161765:0:23462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790946215.161782:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790946215.161831:0:23462:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1790946215.162970:0:23462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd9f4181e0d27ec49 00000100:00080000:3.0:1790946215.162986:0:23462:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790946215.163061:0:23462:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9d3f83c3e000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790946215.163105:0:23462:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f84e24000 x1877942638704256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790946215.163206:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638704256:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1790946215.163265:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877942638704256 offset 0 length 520: 4 00000100:00080000:3.0:1790946215.163421:0:23462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1790946215.163515:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946215.163521:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946215.163523:0:23462:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1790946215.163526:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790946215.163544:0:23462:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1790946215.163545:0:23462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790946215.163547:0:23462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790946215.163549:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790946215.163552:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946215.163553:0:23462:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790946215.163556:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790946215.163560:0:23462:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1790946215.163564:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946215.163566:0:23462:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1790946215.163569:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790946215.163573:0:23462:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:3.0:1790946215.163593:0:23462:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1790946215.163595:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790946215.163609:0:23462:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9d40af68cd40) 00000020:00000080:3.0:1790946215.163628:0:23462:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1790946215.163634:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790946215.163719:0:23462:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00000100:00080000:2.0:1790946215.163722:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790946215.163726:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00080000:01000000:3.0:1790946215.163727:0:23462:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000100:00080000:2.0:1790946215.163729:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790946215.163732:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:3.0:1790946215.163736:0:23462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd9f4181e0d27ec57 00010000:00080000:3.0:1790946215.163763:0:23462:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d40bc9b9000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.120@tcp at head 00010000:00010000:3.0:1790946215.164032:0:23462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1790946215.164107:0:23462:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1790946215.164123:0:23462:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1790946215.172430:0:23462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790946215.173213:0:23462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1790946215.173382:0:23462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:1.0:1790946215.176248:0:23470:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1790946215.176256:0:23470:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1790946215.180585:0:23462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790946215.180601:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790946215.180669:0:23462:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790946215.180691:0:23462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd9f4181e0d27ec5e 00000100:00080000:3.0:1790946215.180701:0:23462:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790946215.180725:0:23462:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d40bc9b9000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790946215.180761:0:23462:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f84e26680 x1877942638704384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790946215.180791:0:23462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1790946215.180872:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946215.180876:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946215.180879:0:23462:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1790946215.180881:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790946215.180885:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946215.180887:0:23462:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790946215.180890:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790946215.180891:0:23462:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790946215.180894:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946215.180896:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946215.180897:0:23462:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790946215.180900:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790946215.180902:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946215.180903:0:23462:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790946215.180907:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1790946215.180941:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946215.180944:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946215.180946:0:23462:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790946215.180949:0:23462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00100000:1.0:1790946215.181130:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638704384:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1790946215.181224:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877942638704384 offset 0 length 520: 4 00000100:00080000:2.0:1790946215.181618:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790946215.181624:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790946215.181626:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790946215.181629:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1790946215.183432:0:23458:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1790946215.183481:0:23458:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1790946215.183509:0:23458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6400/0xd9f4181e0d27ebe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ebe7 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946215.183521:0:23458:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6400/0xd9f4181e0d27ebe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ebe7 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946215.183529:0:23458:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d4096c6b800 from 1 10000000:01000000:2.0:1790946215.183532:0:23458:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790946215.183570:0:23458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27ec65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946215.183579:0:23458:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27ec65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946215.183591:0:23458:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27ec65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946215.183613:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638704512:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790946215.183696:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946215.183742:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408aad8900 going to sleep for 11 seconds 00000100:00100000:3.0:1790946215.184780:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638704512 00000100:00100000:3.0:1790946215.184792:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638704512 00000100:00100000:3.0:1790946215.184850:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790946215.184860:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+15:23458:x1877942638704512:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790946215.184875:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946215.184890:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef0000/0xd9f4181e0d27ec6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ec65 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946215.184939:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef0000/0xd9f4181e0d27ec6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ec65 expref: 16 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946215.184950:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef0000/0xd9f4181e0d27ec6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ec65 expref: 16 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946215.184959:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef0000, rc 0) 00000100:00100000:3.0:1790946215.186513:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+16:23458:x1877942638704512:12345-0@lo:101:mount.lustre.0 Request processed in 1645us (2808us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946215.186524:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790946215.186738:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638704512:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946215.186779:0:23458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27ec65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ec6c expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946215.186790:0:23458:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27ec65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ec6c expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946215.187517:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638704640:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1790946215.187568:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946215.187678:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408aad8900 going to sleep for 11 seconds 00000100:00100000:0.0:1790946215.188917:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638704640 00000100:00100000:0.0:1790946215.188929:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638704640 00000100:00100000:0.0:1790946215.188975:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790946215.188984:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+16:23458:x1877942638704640:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1790946215.189006:0:22717:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1790946215.189029:0:22717:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790946215.189032:0:22717:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1790946215.189161:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+16:23458:x1877942638704640:12345-0@lo:256:mount.lustre.0 Request processed in 178us (1592us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946215.189192:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790946215.189448:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638704640:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1790946215.190126:0:23458:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790946215.190153:0:23458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27ec65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ec6c expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946215.190165:0:23458:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27ec65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ec6c expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946215.190197:0:23458:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d4096c6b800 from 1 10000000:01000000:2.0:1790946215.190200:0:23458:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790946215.190234:0:23458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27ec73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946215.190243:0:23458:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27ec73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946215.190253:0:23458:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27ec73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946215.190273:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638704768:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790946215.190390:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946215.190435:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408aad8900 going to sleep for 11 seconds 00000100:00100000:1.0:1790946215.190519:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638704768 00000100:00100000:1.0:1790946215.190526:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638704768 00000100:00100000:1.0:1790946215.190577:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790946215.190586:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+16:23458:x1877942638704768:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790946215.190600:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946215.190613:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40813ff200/0xd9f4181e0d27ec7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ec73 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946215.190635:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40813ff200/0xd9f4181e0d27ec7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ec73 expref: 17 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946215.190657:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40813ff200/0xd9f4181e0d27ec7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ec73 expref: 17 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946215.190666:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813ff200, rc 0) 00000100:00100000:1.0:1790946215.190703:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+17:23458:x1877942638704768:12345-0@lo:101:mount.lustre.0 Request processed in 119us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946215.190710:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790946215.190793:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638704768:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946215.190806:0:23458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27ec73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ec7a expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946215.190815:0:23458:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27ec73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ec7a expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790946215.192512:0:23458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1790946215.192810:0:23458:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790946215.193005:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1790946215.193032:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1790946215.193046:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1790946215.193059:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1790946215.193071:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1790946215.193084:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1790946215.193110:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1790946215.193124:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1790946215.193136:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1790946215.193148:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1790946215.193160:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1790946215.193227:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1790946215.193234:0:23458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1790946215.193523:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638704896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946215.193588:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946215.193634:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408aad86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946215.193709:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638704896 00000100:00100000:1.0:1790946215.193718:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638704896 00000100:00100000:1.0:1790946215.193766:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790946215.193783:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+17:23458:x1877942638704896:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946215.193936:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+17:23458:x1877942638704896:12345-0@lo:501:mount.lustre.0 Request processed in 154us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946215.193944:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790946215.194032:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638704896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946215.194070:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638705024:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790946215.194109:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946215.194132:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b38780 going to sleep for 11 seconds 00000100:00100000:1.0:1790946215.194266:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638705024 00000100:00100000:1.0:1790946215.194271:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638705024 00000100:00100000:1.0:1790946215.194323:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790946215.194330:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+17:23458:x1877942638705024:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790946215.194407:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+17:23458:x1877942638705024:12345-0@lo:503:mount.lustre.0 Request processed in 78us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946215.194414:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790946215.195478:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638705024:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790946215.195924:0:23458:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790946215.196004:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638705152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946215.196065:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946215.196095:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b38780 going to sleep for 11 seconds 00000100:00100000:1.0:1790946215.196441:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638705152 00000100:00100000:1.0:1790946215.196449:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638705152 00000100:00100000:1.0:1790946215.196488:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790946215.196496:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+17:23458:x1877942638705152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946215.196593:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+17:23458:x1877942638705152:12345-0@lo:502:mount.lustre.0 Request processed in 96us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946215.196602:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790946215.197000:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638705152:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790946215.197256:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1790946215.197285:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1790946215.197300:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1790946215.197417:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1790946215.197431:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:3.0:1790946215.197456:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1790946215.197469:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:3.0:1790946215.197481:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:3.0:1790946215.197496:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1790946215.197512:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:3.0:1790946215.197526:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:3.0:1790946215.197559:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638705280:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946215.197613:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946215.197710:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b38780 going to sleep for 11 seconds 00010000:00010000:3.0:1790946215.203059:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946215.203290:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638705280 00000100:00100000:1.0:1790946215.203355:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638705280 00000100:00100000:1.0:1790946215.203456:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790946215.203467:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+17:23458:x1877942638705280:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946215.203725:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+17:23458:x1877942638705280:12345-0@lo:502:mount.lustre.0 Request processed in 259us (6111us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946215.203733:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790946215.204420:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638705280:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790946215.204663:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:3.0:1790946215.204677:0:23458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1790946215.205873:0:23472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790946215.205933:0:23472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946215.205936:0:23472:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790946215.205945:0:23472:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d4096c6b800 00000020:00000080:3.0:1790946215.205948:0:23472:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790946215.205955:0:23472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946215.205957:0:23472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946215.205958:0:23472:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1790946215.205960:0:23472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790946215.205962:0:23472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946215.205963:0:23472:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790946215.205967:0:23472:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d4096c6b800 00000020:00000080:3.0:1790946215.205969:0:23472:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790946215.206029:0:23472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946215.206033:0:23472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946215.206034:0:23472:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790946215.206037:0:23472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790946215.206039:0:23472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946215.206048:0:23472:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790946215.206052:0:23472:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d4096c6b800 00000020:00000080:3.0:1790946215.206054:0:23472:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790946215.206074:0:23472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946215.206076:0:23472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946215.206078:0:23472:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790946215.206080:0:23472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790946215.206082:0:23472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946215.206083:0:23472:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790946215.206086:0:23472:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d4096c6b800 00000020:00000080:3.0:1790946215.206088:0:23472:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790946215.206109:0:23472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946215.206112:0:23472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946215.206113:0:23472:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1790946215.206116:0:23472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1790946215.209492:0:23458:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1790946215.209545:0:23458:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790946215.209569:0:23458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27ec73 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ec7a expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946215.209589:0:23458:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27ec73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ec7a expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946215.209660:0:23458:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790946215.209664:0:23458:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d4096c6b800 10000000:01000000:2.0:1790946215.209667:0:23458:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d4096c6b800 10000000:01000000:2.0:1790946215.209671:0:23458:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790946215.209677:0:23458:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d4096c6b800 from 1 10000000:01000000:2.0:1790946215.209680:0:23458:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790946215.209717:0:23458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7400/0xd9f4181e0d27ec81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946215.209725:0:23458:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7400/0xd9f4181e0d27ec81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946215.209736:0:23458:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7400/0xd9f4181e0d27ec81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946215.209760:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638705408:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790946215.209832:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946215.209890:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638705408 00000100:00100000:2.0:1790946215.209898:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638705408 00000100:00100000:2.0:1790946215.209941:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790946215.209950:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+17:23458:x1877942638705408:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946215.209964:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946215.209978:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d6600/0xd9f4181e0d27ec88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ec81 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946215.210014:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d6600/0xd9f4181e0d27ec88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ec81 expref: 18 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946215.210023:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d6600/0xd9f4181e0d27ec88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ec81 expref: 18 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946215.210031:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d6600, rc 0) 00000100:00100000:2.0:1790946215.210065:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:23458:x1877942638705408:12345-0@lo:101:mount.lustre.0 Request processed in 116us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946215.210072:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790946215.210124:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408aad80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946215.210147:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638705408:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946215.210161:0:23458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7400/0xd9f4181e0d27ec81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ec88 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946215.210190:0:23458:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7400/0xd9f4181e0d27ec81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ec88 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790946215.219340:0:23458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1790946215.219695:0:23458:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790946215.219905:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1790946215.219935:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1790946215.219954:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1790946215.219970:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1790946215.219986:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1790946215.220002:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1790946215.220034:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1790946215.220053:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1790946215.220070:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1790946215.220084:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1790946215.220097:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1790946215.220112:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1790946215.220129:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1790946215.220147:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1790946215.220159:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1790946215.220207:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1790946215.220236:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1790946215.220252:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1790946215.220272:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1790946215.220288:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1790946215.220302:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1790946215.220321:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1790946215.220352:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1790946215.220374:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1790946215.220393:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1790946215.220413:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1790946215.220432:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1790946215.220450:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1790946215.220470:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1790946215.220486:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1790946215.220500:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1790946215.220512:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1790946215.220525:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1790946215.220537:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1790946215.220549:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1790946215.220561:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1790946215.220573:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1790946215.220586:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1790946215.220611:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1790946215.220627:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1790946215.220640:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1790946215.220671:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1790946215.220684:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1790946215.220696:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1790946215.220708:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1790946215.220720:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1790946215.220733:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1790946215.220745:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1790946215.220854:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1790946215.220879:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1790946215.220896:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1790946215.220902:0:23458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1790946215.220993:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638705536:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946215.221062:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946215.221114:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638705536 00000100:00100000:3.0:1790946215.221121:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638705536 00000100:00100000:3.0:1790946215.221162:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790946215.221200:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:23458:x1877942638705536:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946215.221306:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:23458:x1877942638705536:12345-0@lo:501:mount.lustre.0 Request processed in 108us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946215.221314:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790946215.221359:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b38540 going to sleep for 11 seconds 00000100:00100000:3.0:1790946215.221383:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638705536:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946215.221412:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638705664:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790946215.221448:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946215.221481:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b38540 going to sleep for 11 seconds 00000100:00100000:1.0:1790946215.221494:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638705664 00000100:00100000:1.0:1790946215.221505:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638705664 00000100:00100000:1.0:1790946215.221537:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790946215.221544:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:23458:x1877942638705664:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790946215.221626:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:23458:x1877942638705664:12345-0@lo:503:mount.lustre.0 Request processed in 81us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946215.221633:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790946215.223264:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638705664:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790946215.223757:0:23458:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790946215.223839:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638705792:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946215.223900:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946215.223938:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638705792 00000100:00100000:3.0:1790946215.223944:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638705792 00000100:00100000:3.0:1790946215.224808:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790946215.224821:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:23458:x1877942638705792:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946215.224937:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:23458:x1877942638705792:12345-0@lo:502:mount.lustre.0 Request processed in 119us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946215.224952:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790946215.225131:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b38540 going to sleep for 11 seconds 00000100:00100000:3.0:1790946215.225151:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638705792:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790946215.225394:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1790946215.225423:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1790946215.225439:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1790946215.225452:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1790946215.225465:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1790946215.225478:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1790946215.225490:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1790946215.225504:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1790946215.225517:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1790946215.225529:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1790946215.225543:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1790946215.225556:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1790946215.225568:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1790946215.225580:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1790946215.225597:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1790946215.225611:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1790946215.225625:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1790946215.226194:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1790946215.226219:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1790946215.226233:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1790946215.226247:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1790946215.226259:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1790946215.226273:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1790946215.226288:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1790946215.226301:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1790946215.226315:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1790946215.226329:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1790946215.226356:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1790946215.226370:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1790946215.226384:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1790946215.226397:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1790946215.226410:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1790946215.226423:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1790946215.226449:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1790946215.226466:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1790946215.226479:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1790946215.226492:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1790946215.226505:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1790946215.226518:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1790946215.226530:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1790946215.226543:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1790946215.226555:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1790946215.226567:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1790946215.226580:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1790946215.226592:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1790946215.226604:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1790946215.226617:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1790946215.226629:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1790946215.226697:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638705920:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946215.226767:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946215.226803:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638705920 00000100:00100000:3.0:1790946215.226810:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638705920 00000100:00100000:3.0:1790946215.226851:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790946215.226860:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:23458:x1877942638705920:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946215.226962:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:23458:x1877942638705920:12345-0@lo:502:mount.lustre.0 Request processed in 103us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946215.226970:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790946215.227022:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b38540 going to sleep for 11 seconds 00000100:00100000:3.0:1790946215.227041:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638705920:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790946215.227216:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:3.0:1790946215.227238:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:3.0:1790946215.227258:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638706048:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946215.227291:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946215.227312:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638706048 00000100:00100000:3.0:1790946215.227317:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638706048 00000100:00100000:3.0:1790946215.227338:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790946215.227344:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:23458:x1877942638706048:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946215.227398:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:23458:x1877942638706048:12345-0@lo:502:mount.lustre.0 Request processed in 54us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946215.227405:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790946215.227438:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b38540 going to sleep for 11 seconds 00000100:00100000:3.0:1790946215.227449:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638706048:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790946215.227480:0:23458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1790946215.227487:0:23458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1790946215.231692:0:23477:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1790946215.231710:0:23477:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9d40af688000) 00000020:00000080:3.0:1790946215.231734:0:23477:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1790946215.231808:0:23477:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d4096c6b800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1790946215.231813:0:23477:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d4096c6b800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1790946215.231815:0:23477:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d4096c6b800 3 00010000:00080000:3.0:1790946215.231871:0:23477:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d40bc9bd000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.120@tcp at head 00010000:00010000:3.0:1790946215.237237:0:23477:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1790946215.237439:0:23477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1790946215.237490:0:23477:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790946215.237511:0:23477:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xd9f4181e0d27ec96 00000100:00080000:3.0:1790946215.237523:0:23477:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790946215.237536:0:23477:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9d40bc9bd000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790946215.237591:0:23477:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f84e24e00 x1877942638706176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790946215.237676:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1877942638706176:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790946215.237767:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790946215.237822:0:23477:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790946215.238538:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790946215.238544:0:15915:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1790946215.238549:0:15915:0:(import.c:65:import_set_state_nolock()) ffff9d4096c64800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790946215.238563:0:15915:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d4096c64800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1790946215.238589:0:15915:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f8441fb80 x1877942638706304/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790946215.238609:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946215.238613:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790946215.238615:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946215.238618:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790946215.238673:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946215.238676:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790946215.238679:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946215.238683:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790946215.238722:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638706176 00000100:00100000:1.0:1790946215.238730:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638706176 00000100:00100000:1.0:1790946215.238766:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790946215.238773:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1877942638706176:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790946215.238804:0:22726:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 666 last 0 00000020:00000080:1.0:1790946215.238837:0:22726:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xd9f4181e0d27ec9d 00000004:00100000:1.0:1790946215.238850:0:22726:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790946215.238876:0:22726:0:(import.c:65:import_set_state_nolock()) ffff9d40bacd4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790946215.238936:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1877942638706176:12345-0@lo:38:llog_process_th.0 Request processed in 161us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946215.238943:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790946215.241706:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790946215.241737:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638706432:0@lo:400:kworker.0 00000100:00100000:3.0:1790946215.241811:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946215.241865:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638706304:0@lo:38:kworker.0 00000100:00100000:3.0:1790946215.241911:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1790946215.241949:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3f84e24e00 x1877942638706176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790946225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946215.241961:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790946215.241972:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1790946215.241981:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1790946215.241986:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790946215.241989:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bc9bd000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790946215.241997:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1877942638706176:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790946215.242149:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638706560:0@lo:400:kworker.0 00000100:00100000:2.0:1790946215.242206:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946215.242244:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638706432 00000100:00100000:2.0:1790946215.242251:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638706432 00000100:00100000:2.0:1790946215.242295:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790946215.242303:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638706432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946215.242352:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638706432:12345-0@lo:400:kworker.0 Request processed in 49us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946215.242367:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790946215.242404:0:22730:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638706304 00000100:00100000:2.0:1790946215.242408:0:22730:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638706304 00000100:00100000:2.0:1790946215.242424:0:22730:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638706560 00000100:00100000:2.0:1790946215.242427:0:22730:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638706560 00000100:00100000:2.0:1790946215.242440:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790946215.242445:0:22730:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1877942638706304:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1790946215.242489:0:22730:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1877942638706304:12345-0@lo:38:kworker.0 Request processed in 43us (578us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790946215.242495:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790946215.242505:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790946215.242510:0:22730:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1877942638706560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946215.242542:0:22730:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1877942638706560:12345-0@lo:400:kworker.0 Request processed in 31us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946215.242547:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1790946215.242577:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3f8441d500 x1877942638706432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946215.242586:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638706432:0@lo:400:kworker.0 00000100:00100000:2.0:1790946215.242614:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638706560:0@lo:400:kworker.0 00000100:00080000:2.0:1790946215.242633:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d4096c64800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790946215.242637:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790946215.242641:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638706304:0@lo:38:kworker.0 00000040:00080000:3.0:1790946215.243909:0:23477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:3.0:1790946215.243961:0:23458:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1790946215.243990:0:23458:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790946215.244003:0:23458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7400/0xd9f4181e0d27ec81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ec88 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946215.244021:0:23458:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7400/0xd9f4181e0d27ec81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ec88 expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790946215.244063:0:23458:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790946215.244065:0:23458:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790946215.244067:0:23458:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790946215.244068:0:23458:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790946215.244069:0:23458:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790946215.244071:0:23458:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790946215.244072:0:23458:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790946215.244074:0:23458:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790946215.244075:0:23458:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790946215.244079:0:23458:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1790946215.244081:0:23458:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790946215.244083:0:23458:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790946215.244084:0:23458:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790946215.244085:0:23458:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790946215.244087:0:23458:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790946215.244088:0:23458:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790946215.244089:0:23458:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790946215.244090:0:23458:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790946215.244090:0:23458:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790946215.244111:0:23458:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1790946215.244126:0:23458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638706688:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790946215.244203:0:23458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946215.244233:0:23458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b38d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790946215.244250:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638706688 00000100:00100000:3.0:1790946215.244255:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638706688 00000100:00100000:3.0:1790946215.244285:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790946215.244291:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:23458:x1877942638706688:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790946215.244313:0:22718:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1790946215.244326:0:22718:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1790946215.251420:0:22704:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1790946215.251557:0:22718:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790946215.251573:0:22718:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1790946215.251598:0:22740:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790946215.251604:0:22740:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790946215.251629:0:22740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d3f83c65a00/0xd9f4181e0d27eca4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946215.251669:0:22740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27eba8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27eba1 expref: 18 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946215.251678:0:22740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40baef0000/0xd9f4181e0d27ec6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ec65 expref: 18 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946215.251687:0:22740:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d3f83c65a00/0xd9f4181e0d27eca4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946215.251724:0:22740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40baef0000/0xd9f4181e0d27ec6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27ec65 expref: 18 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946215.251738:0:22740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40baef0000/0xd9f4181e0d27ec6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27ec65 expref: 18 pid: 22718 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946215.251752:0:22740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22740:1877942638706816:0@lo:104: 00000100:00100000:0.0:1790946215.251820:0:22740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946215.251866:0:22708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638706816 00010000:00010000:0.0:1790946215.251875:0:22740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27eba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27eba1 expref: 18 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946215.251876:0:22708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638706816 00010000:00010000:0.0:1790946215.251888:0:22740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27eba8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27eba1 expref: 18 pid: 22718 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946215.251898:0:22740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812eb100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22740:1877942638706944:0@lo:104: 00000100:00100000:2.0:1790946215.251924:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790946215.251926:0:22740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946215.251939:0:22740:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4099fa4540 going to sleep for 11 seconds 00000100:00100000:2.0:1790946215.251955:0:22708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+3:22740:x1877942638706816:12345-0@lo:104: 00010000:00010000:2.0:1790946215.251969:0:22708:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27ec65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ec6c expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946215.252033:0:22708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790946215.252040:0:22708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+3:22740:x1877942638706816:12345-0@lo:104: Request processed in 89us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946215.252047:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790946215.252064:0:22708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638706944 00000100:00100000:2.0:1790946215.252067:0:22708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638706944 00000100:00100000:2.0:1790946215.252080:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790946215.252085:0:22708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+3:22740:x1877942638706944:12345-0@lo:104: 00010000:00010000:2.0:1790946215.252093:0:22708:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40813fea00/0xd9f4181e0d27eba1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27eba8 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946215.252122:0:22740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22740:1877942638706816:0@lo:104: 00000100:00100000:0.0:1790946215.252140:0:22740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812eb100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22740:1877942638706944:0@lo:104: 00010000:00010000:2.0:1790946215.252144:0:22708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790946215.252153:0:22708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+3:22740:x1877942638706944:12345-0@lo:104: Request processed in 66us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946215.252161:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1790946215.252190:0:22740:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d3f83c65a00/0xd9f4181e0d27eca4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946215.255101:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790946215.255116:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27ec65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ec6c expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946215.255128:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d6e00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:3.0:1790946215.255133:0:22712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27ec65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27ec6c expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946215.255145:0:22712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27ec65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27ec6c expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946215.255156:0:22712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27ec65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27ec6c expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946215.255163:0:22712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790946215.255235:0:22712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27ec65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ec6c expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946215.255243:0:22712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790946215.255261:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27ec65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ec6c expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946215.255269:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40c21d6e00/0xd9f4181e0d27ec65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ec6c expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946215.255283:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946215.255287:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40813fea00/0xd9f4181e0d27eba1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27eba8 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946215.255293:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813fea00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:3.0:1790946215.255302:0:22712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40813fea00/0xd9f4181e0d27eba1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27eba8 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946215.255310:0:22712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40813fea00/0xd9f4181e0d27eba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27eba8 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946215.255317:0:22712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40813fea00/0xd9f4181e0d27eba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27eba8 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946215.255323:0:22712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790946215.255340:0:22712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40813fea00/0xd9f4181e0d27eba1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27eba8 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946215.255347:0:22712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790946215.255359:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40813fea00/0xd9f4181e0d27eba1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27eba8 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946215.255366:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40813fea00/0xd9f4181e0d27eba1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27eba8 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946215.255380:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946215.255382:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946215.255384:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946215.255390:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946215.255548:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790946215.255569:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3650:1877942638707200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790946215.255638:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946215.257435:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3648:1877942638707072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790946215.257507:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946215.257595:0:22710:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638707200 00000100:00100000:2.0:1790946215.257604:0:22710:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638707200 00010000:00010000:2.0:1790946215.257634:0:22710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27eba8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27eba1 expref: 19 pid: 22718 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946215.257786:0:22709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638707072 00000100:00100000:0.0:1790946215.257792:0:22709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638707072 00010000:00010000:0.0:1790946215.257812:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40baef0000/0xd9f4181e0d27ec6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ec65 expref: 20 pid: 22718 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946215.257852:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790946215.257860:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790946215.257866:0:22709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+20:3648:x1877942638707072:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790946215.257873:0:22710:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+20:3650:x1877942638707200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790946215.257884:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946215.257892:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40baef0000/0xd9f4181e0d27ec6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ec65 expref: 20 pid: 22718 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946215.257894:0:22710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946215.257902:0:22710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27eba8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27eba1 expref: 20 pid: 22718 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946215.257909:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40baef0000/0xd9f4181e0d27ec6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27ec65 expref: 20 pid: 22718 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946215.257927:0:22710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27eba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27eba1 expref: 20 pid: 22718 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946215.257944:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40813ffe00/0xd9f4181e0d27eba8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27eba1 expref: 20 pid: 22718 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946215.257958:0:22710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946215.258007:0:22710:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+19:3650:x1877942638707200:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (2368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946215.258015:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790946215.258059:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3650:1877942638707200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790946215.258087:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:23458:x1877942638706688:12345-0@lo:253:mount.lustre.0 Request processed in 13794us (13882us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946215.258096:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790946215.258150:0:23458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:23458:1877942638706688:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790946215.258162:0:23458:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1790946215.258188:0:23458:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790946215.258190:0:23458:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790946215.258192:0:23458:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946215.258194:0:23458:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946215.258195:0:23458:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946215.258197:0:23458:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946215.258198:0:23458:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790946215.258200:0:23458:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946215.258202:0:23458:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790946215.258212:0:23458:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1790946215.258444:0:22709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef0000/0xd9f4181e0d27ec6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27ec65 expref: 17 pid: 22718 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946215.258457:0:22709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d3f83c65a00/0xd9f4181e0d27eca4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946215.258466:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3f83c65a00/0xd9f4181e0d27eca4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790946215.258482:0:22709:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006878358s 00010000:00010000:0.0:1790946215.258487:0:22709:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3f83c65a00/0xd9f4181e0d27eca4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946215.258493:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3f83c65a00/0xd9f4181e0d27eca4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946215.258508:0:22709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d3f83c65a00/0xd9f4181e0d27eca4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946215.258515:0:22709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d3f83c65a00/0xd9f4181e0d27eca4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946215.258521:0:22709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65a00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790946215.258526:0:22709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d3f83c65a00/0xd9f4181e0d27eca4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946215.258534:0:22709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d3f83c65a00/0xd9f4181e0d27eca4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946215.258556:0:22709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d3f83c65a00/0xd9f4181e0d27eca4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946215.258569:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946215.258612:0:22709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+16:3648:x1877942638707072:12345-0@lo:103:ldlm_bl.0 Request processed in 751us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946215.258620:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1790946215.258684:0:22740:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d3f83c65a00/0xd9f4181e0d27eca4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946215.258693:0:22740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d3f83c65a00/0xd9f4181e0d27eca4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946215.258700:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3f83c65a00/0xd9f4181e0d27eca4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946215.259293:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3648:1877942638707072:0@lo:103:ldlm_bl.0 00000040:01000000:3.0:1790946215.263891:0:23458:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1790946215.264055:0:23483:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1790946215.264059:0:23483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1790946215.264485:0:23484:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1790946215.264673:0:23458:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1790946215.265128:0:23485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441d180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23485:1877942638707328:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790946215.265242:0:23485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946215.265274:0:23485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790946215.265446:0:22730:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638707328 00000100:00100000:2.0:1790946215.265453:0:22730:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638707328 00000100:00100000:2.0:1790946215.265517:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790946215.265526:0:22730:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23485:x1877942638707328:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790946215.265606:0:22730:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23485:x1877942638707328:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 81us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946215.265613:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000040:00080000:2.0:1790946215.265854:0:23484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790946215.267917:0:23485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441d180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23485:1877942638707328:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1790946215.267969:0:23485:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1790946215.268013:0:23485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812eb100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23485:1877942638707456:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790946215.268073:0:23485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946215.268102:0:23485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4099fa4540 going to sleep for 11 seconds 00000040:00080000:2.0:1790946215.268998:0:23484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790946215.269075:0:23484:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1790946215.269213:0:23467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638707456 00000100:00100000:2.0:1790946215.269221:0:23467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638707456 00000100:00100000:2.0:1790946215.269270:0:23467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790946215.269279:0:23467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23485:x1877942638707456:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790946215.269420:0:23467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23485:x1877942638707456:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 142us (1346us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946215.269428:0:23467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790946215.269733:0:23485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812eb100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23485:1877942638707456:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790946215.269810:0:23485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441f480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23485:1877942638707584:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1790946215.269854:0:23485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946215.269883:0:23485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946215.269942:0:22735:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638707584 00000100:00100000:0.0:1790946215.269958:0:22735:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638707584 00000100:00100000:0.0:1790946215.269992:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790946215.269999:0:22735:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23485:x1877942638707584:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1790946215.270048:0:22735:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23485:x1877942638707584:12345-0@lo:900:lod0001_rec0000.0 Request processed in 49us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946215.270055:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:3.0:1790946215.270946:0:23458:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1790946215.270983:0:23458:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1790946215.271582:0:23458:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1790946215.271592:0:23458:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1790946215.271635:0:23458:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:2.0:1790946215.272345:0:23485:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3f8441f480 x1877942638707584/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790946231 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946215.272361:0:23485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441f480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23485:1877942638707584:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1790946215.272437:0:23485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff73480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23485:1877942638707712:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790946215.272511:0:23485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946215.272593:0:23485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4088c76900 going to sleep for 11 seconds 00000040:00080000:3.0:1790946215.273458:0:23458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1790946215.273681:0:22729:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638707712 00000100:00100000:1.0:1790946215.273707:0:22729:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638707712 00000100:00100000:1.0:1790946215.273762:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790946215.273772:0:22729:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23485:x1877942638707712:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790946215.273888:0:22729:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23485:x1877942638707712:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 117us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946215.273895:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790946215.273969:0:23485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff73480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23485:1877942638707712:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1790946215.274018:0:23485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790946215.276204:0:23485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790946215.276291:0:23485:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1790946215.276295:0:23485:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:2.0:1790946215.278281:0:23458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1790946215.278363:0:23458:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1790946215.278551:0:23458:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1790946215.279580:0:23458:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:2.0:1790946215.282481:0:23458:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1790946215.287759:0:23458:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1790946215.287803:0:23458:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb827c1d83988 00100000:10000000:2.0:1790946215.287812:0:23458:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1790946215.288736:0:23458:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790946215.288772:0:23458:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790946215.288788:0:23458:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1790946215.288806:0:23458:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1790946215.295080:0:23458:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790946215.296498:0:23458:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1790946215.777544:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a93c0 going to sleep for 0 seconds 00010000:00010000:3.0:1790946216.224051:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790946216.292903:0:22721:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790946216.292913:0:22721:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d4096c6b800 from 12 10000000:01000000:0.0:1790946216.292918:0:22721:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790946216.292968:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65c00/0xd9f4181e0d27ecab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946216.292981:0:22721:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65c00/0xd9f4181e0d27ecab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946216.292993:0:22721:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65c00/0xd9f4181e0d27ecab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946216.293033:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638707840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790946216.293121:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946216.293198:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4099fa4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790946216.293236:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638707840 00000100:00100000:0.0:1790946216.293251:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638707840 00000100:00100000:0.0:1790946216.293305:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790946216.293315:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+16:22721:x1877942638707840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946216.293332:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946216.293347:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3f83c65a00/0xd9f4181e0d27ecb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ecab expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946216.293377:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3f83c65a00/0xd9f4181e0d27ecb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ecab expref: 17 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946216.293389:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3f83c65a00/0xd9f4181e0d27ecb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ecab expref: 17 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946216.293398:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65a00, rc 0) 00000100:00100000:0.0:1790946216.293442:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+17:22721:x1877942638707840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946216.293449:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790946216.293505:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638707840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946216.293523:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65c00/0xd9f4181e0d27ecab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ecb2 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946216.293531:0:22721:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65c00/0xd9f4181e0d27ecab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ecb2 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946216.293583:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638707968:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790946216.293791:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946216.293818:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4099fa4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790946216.294545:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638707968 00000100:00100000:0.0:1790946216.294564:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638707968 00000100:00100000:0.0:1790946216.294663:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790946216.294672:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+17:22721:x1877942638707968:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790946216.294691:0:22718:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790946216.294708:0:22718:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790946216.294711:0:22718:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1790946216.294817:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+17:22721:x1877942638707968:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946216.294825:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000040:00080000:2.0:1790946216.295988:0:23480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790946216.296469:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638707968:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790946216.296535:0:22721:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790946216.296546:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65c00/0xd9f4181e0d27ecab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ecb2 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946216.296557:0:22721:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65c00/0xd9f4181e0d27ecab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ecb2 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946216.296568:0:22721:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790946216.296570:0:22721:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d3f83705800 from 12 10000000:01000000:1.0:1790946216.296574:0:22721:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790946216.296686:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27ecb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946216.296695:0:22721:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27ecb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946216.296705:0:22721:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27ecb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946216.296727:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638708096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790946216.296783:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946216.296836:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946216.296927:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638708096 00000100:00100000:2.0:1790946216.296935:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638708096 00000100:00100000:2.0:1790946216.296985:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790946216.296995:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+17:22721:x1877942638708096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790946216.297099:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946216.297115:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27ecc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ecb9 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946216.297138:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27ecc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ecb9 expref: 18 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946216.297148:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27ecc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ecb9 expref: 18 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946216.297156:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d6800, rc 0) 00000100:00100000:2.0:1790946216.297418:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:22721:x1877942638708096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 423us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946216.297425:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790946216.297521:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638708096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946216.297534:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27ecb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ecc0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946216.297543:0:22721:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27ecb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ecc0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946216.297683:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638708224:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790946216.297731:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946216.297753:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946216.297797:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638708224 00000100:00100000:2.0:1790946216.297809:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638708224 00000100:00100000:2.0:1790946216.297843:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790946216.297850:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:22721:x1877942638708224:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790946216.297867:0:22719:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790946216.297882:0:22719:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790946216.297886:0:22719:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1790946216.297969:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:22721:x1877942638708224:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946216.297977:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790946216.298102:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638708224:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790946216.298152:0:22721:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790946216.298159:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27ecb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ecc0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946216.298184:0:22721:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27ecb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ecc0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946216.804895:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a93c0 going to sleep for 0 seconds 00010000:00010000:1.0:1790946217.248018:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790946217.312842:0:23480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790946217.823624:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a93c0 going to sleep for 0 seconds 00010000:00010000:1.0:1790946218.272560:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946218.849224:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a93c0 going to sleep for 0 seconds 00010000:00010000:3.0:1790946219.299385:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790946219.855958:0:23727:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1790946219.871404:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a93c0 going to sleep for 0 seconds 00010000:00010000:1.0:1790946220.319433:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790946220.383393:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790946220.383400:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1790946220.383405:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d4096c64800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790946220.383423:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d4096c64800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1790946220.383428:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3650:1877942638708480:0@lo:400:kworker.0 00000100:00100000:3.0:1790946220.383452:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f84e27480 x1877942638708608/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790946220.383471:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946220.383475:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790946220.383478:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946220.383482:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790946220.383502:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1790946220.383503:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790946220.383508:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790946220.383511:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946220.383515:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790946220.383574:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638708864:0@lo:400:kworker.0 00000100:00100000:1.0:1790946220.383575:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638708992:0@lo:400:kworker.0 00000100:00100000:1.0:1790946220.383613:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946220.383633:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946220.383660:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638708352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790946220.383683:0:22730:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638708864 00000100:00100000:1.0:1790946220.383690:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946220.383694:0:22730:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638708864 00000100:00100000:1.0:1790946220.383713:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790946220.383721:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638708736:0@lo:400:kworker.0 00000100:00100000:3.0:1790946220.383741:0:22730:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638708352 00000100:00100000:3.0:1790946220.383746:0:22730:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638708352 00000100:00100000:1.0:1790946220.383751:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946220.383768:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790946220.383778:0:22730:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1877942638708864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946220.383788:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638708480 00000100:00100000:1.0:1790946220.383792:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638708480 00000100:00100000:1.0:1790946220.383823:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790946220.383831:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:3650:x1877942638708480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946220.383838:0:22730:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1877942638708864:12345-0@lo:400:kworker.0 Request processed in 61us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946220.383847:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790946220.383866:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790946220.383877:0:22730:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638708352:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790946220.383877:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:3650:x1877942638708480:12345-0@lo:400:kworker.0 Request processed in 45us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946220.383891:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000004:00000024:3.0:1790946220.383909:0:22730:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790946220.383921:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638708992 00000100:00100000:1.0:1790946220.383926:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638708992 00000100:00100000:1.0:1790946220.383955:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638708736 00000100:00100000:1.0:1790946220.383959:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638708736 00000100:00100000:3.0:1790946220.383961:0:22730:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638708352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946220.383971:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790946220.383977:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790946220.383987:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638708992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946220.384001:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638708608:0@lo:38:kworker.0 00000100:00100000:1.0:1790946220.384020:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638708992:12345-0@lo:400:kworker.0 Request processed in 34us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946220.384028:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790946220.384035:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946220.384044:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790946220.384052:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638708736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946220.384429:0:22729:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638708608 00000100:00100000:0.0:1790946220.384435:0:22729:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638708608 00000100:00100000:0.0:1790946220.384459:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790946220.384476:0:22729:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1877942638708608:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1790946220.384502:0:22729:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 671 last 0 00000020:00000080:0.0:1790946220.384552:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd9f4181e0d27ecc7 00000004:00100000:0.0:1790946220.384567:0:22729:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1790946220.384574:0:22729:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1790946220.384800:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638708864:0@lo:400:kworker.0 00010000:00080000:0.0:1790946220.386470:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3f84e24380 x1877942638708992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946220.386598:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638708736:12345-0@lo:400:kworker.0 Request processed in 2543us (2845us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946220.386613:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790946220.386739:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638708992:0@lo:400:kworker.0 00000100:00100000:1.0:1790946220.386980:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3650:1877942638708480:0@lo:400:kworker.0 00000100:00100000:3.0:1790946220.389599:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638708352:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1790946220.389637:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3f84e24e00 x1877942638708736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946220.389649:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638708736:0@lo:400:kworker.0 00000100:00080000:0.0:1790946220.391120:0:22729:0:(import.c:65:import_set_state_nolock()) ffff9d3f85022000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790946220.391264:0:22729:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1877942638708608:12345-0@lo:38:kworker.0 Request processed in 6795us (7228us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946220.391276:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1790946220.391559:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1790946220.391580:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1790946220.391585:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1790946220.391588:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d4096c64800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1790946220.391609:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000006b7d9d14): req@ffff9d40812e9c00 x1877942638701184/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946220.391629:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638708608:0@lo:38:kworker.0 00000100:00100000:1.0:1790946220.391711:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946220.391739:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871a93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946220.391756:0:23467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638701184 00000100:00100000:0.0:1790946220.391783:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790946220.391794:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638709120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790946220.391834:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946220.391861:0:22730:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638709120 00000100:00100000:0.0:1790946220.391866:0:22730:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638709120 00000100:00100000:0.0:1790946220.391898:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790946220.391905:0:22730:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1877942638709120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790946220.391951:0:22730:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790946220.391998:0:22730:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1877942638709120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946220.392005:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790946220.392034:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638709120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790946220.392584:0:23467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638701184 00000100:00100000:1.0:1790946220.392615:0:23467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790946220.392622:0:23467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22766:x1877942638701184:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1790946220.392715:0:23467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22766:x1877942638701184:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 93us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946220.392722:0:23467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790946220.392756:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e9c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22766:1877942638701184:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1790946220.392797:0:22766:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1790946220.392835:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441c000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22766:1877942638709248:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1790946220.392871:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946220.392888:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2000 going to sleep for 11 seconds 00000100:00100000:0.0:1790946220.393127:0:22730:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638709248 00000100:00100000:0.0:1790946220.393132:0:22730:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638709248 00000100:00100000:0.0:1790946220.393316:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790946220.393329:0:22730:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22766:x1877942638709248:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1790946220.393442:0:22730:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22766:x1877942638709248:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 116us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946220.393448:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790946220.393476:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441c000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22766:1877942638709248:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1790946220.393560:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e8e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22766:1877942638709376:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1790946220.393706:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946220.393774:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f827a5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790946220.394598:0:22730:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638709376 00000100:00100000:1.0:1790946220.394607:0:22730:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638709376 00000100:00100000:1.0:1790946220.394657:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790946220.394665:0:22730:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22766:x1877942638709376:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1790946220.394769:0:22730:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22766:x1877942638709376:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 105us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946220.394777:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790946220.394997:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e8e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22766:1877942638709376:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1790946220.395050:0:22766:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790946220.399622:0:22766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790946220.399777:0:22766:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:1.0:1790946220.399783:0:22766:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:2.0:1790946220.905709:0:23779:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790946220.905915:0:23779:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790946221.344765:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790946222.046669:0:23830:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790946222.046932:0:23830:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790946222.367469:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790946223.223503:0:23878:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7a0c5150 20000000:00000080:1.0:1790946223.223522:0:23878:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d408853ac00 uarg=0000000000000000 20000000:01000000:1.0:1790946223.223562:0:23878:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1790946223.223569:0:23878:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1790946223.223574:0:23878:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1790946223.230940:0:23879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1790946223.234666:0:23878:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1790946223.247984:0:23878:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790946223.249696:0:23878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d3f83c64a00/0xd9f4181e0d27ecce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946223.249718:0:23878:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40baef0400/0xd9f4181e0d27eb77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27eb70 expref: 17 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946223.249742:0:23878:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40813ff200/0xd9f4181e0d27ec7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ec73 expref: 17 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946223.249750:0:23878:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d3f83c64a00/0xd9f4181e0d27ecce lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946223.249793:0:23878:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40813ff200/0xd9f4181e0d27ec7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27ec73 expref: 17 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946223.249809:0:23878:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40813ff200/0xd9f4181e0d27ec7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27ec73 expref: 17 pid: 22719 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946223.249825:0:23878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812ea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23878:1877942638709504:0@lo:104: 00000100:00100000:0.0:1790946223.249892:0:23878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790946223.249998:0:23878:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40baef0400/0xd9f4181e0d27eb77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27eb70 expref: 17 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946223.250007:0:23878:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40baef0400/0xd9f4181e0d27eb77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27eb70 expref: 17 pid: 22717 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946223.250016:0:23878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23878:1877942638709632:0@lo:104: 00000100:00100000:0.0:1790946223.250039:0:23878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946223.250412:0:23878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f827a5780 going to sleep for 11 seconds 00000100:00100000:2.0:1790946223.254090:0:22707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638709504 00000100:00100000:2.0:1790946223.254111:0:22707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638709504 00000100:00100000:2.0:1790946223.254194:0:22707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638709632 00000100:00100000:2.0:1790946223.254198:0:22707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638709632 00000100:00100000:2.0:1790946223.254219:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790946223.254229:0:22707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+4:23878:x1877942638709504:12345-0@lo:104: 00010000:00010000:2.0:1790946223.254251:0:22707:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27ec73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ec7a expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946223.254370:0:22707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790946223.254376:0:22707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+4:23878:x1877942638709504:12345-0@lo:104: Request processed in 149us (4485us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946223.254383:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790946223.254402:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790946223.254408:0:22707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+3:23878:x1877942638709632:12345-0@lo:104: 00010000:00010000:2.0:1790946223.254416:0:22707:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27eb70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27eb77 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946223.254480:0:22707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790946223.254485:0:22707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+3:23878:x1877942638709632:12345-0@lo:104: Request processed in 78us (4446us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946223.254506:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1790946223.254532:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790946223.254537:0:22713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946223.254540:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27ec73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ec7a expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946223.254549:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d7a00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:2.0:1790946223.254554:0:22712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27ec73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27ec7a expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946223.254574:0:22712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27ec73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27ec7a expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946223.254582:0:22712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27ec73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27ec7a expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946223.254731:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946223.254738:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27eb70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27eb77 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946223.254746:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d7600 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:1.0:1790946223.254750:0:22713:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27eb70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27eb77 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946223.254757:0:22713:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27eb70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27eb77 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790946223.254763:0:22713:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27eb70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27eb77 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946223.254775:0:22713:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790946223.254815:0:22713:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27eb70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27eb77 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946223.254822:0:22713:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790946223.254839:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27eb70 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27eb77 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946223.254846:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27eb70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27eb77 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946223.254860:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946223.254861:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946223.254863:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946223.254868:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946223.254870:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790946223.254942:0:22712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1790946223.254958:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3648:1877942638709760:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790946223.254961:0:22712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27ec73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ec7a expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946223.254970:0:22712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790946223.255012:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946223.255025:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3649:1877942638709888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790946223.255061:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946223.255085:0:22709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638709760 00000100:00100000:0.0:1790946223.255091:0:22709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638709760 00010000:00010000:2.0:1790946223.255110:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27ec73 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ec7a expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946223.255114:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40baef0400/0xd9f4181e0d27eb77 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27eb70 expref: 18 pid: 22717 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946223.255120:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27ec73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ec7a expref: -99 pid: 23458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946223.255151:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946223.255155:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946223.255157:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946223.255187:0:22709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638709888 00000100:00100000:0.0:1790946223.255191:0:22709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638709888 00010000:00010000:0.0:1790946223.255206:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40813ff200/0xd9f4181e0d27ec7a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ec73 expref: 19 pid: 22719 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946223.255208:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790946223.255222:0:22710:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+19:3648:x1877942638709760:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790946223.255225:0:22709:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790946223.255234:0:22709:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1790946223.255237:0:22710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946223.255244:0:22710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40baef0400/0xd9f4181e0d27eb77 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27eb70 expref: 19 pid: 22717 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946223.255255:0:22710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40baef0400/0xd9f4181e0d27eb77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27eb70 expref: 19 pid: 22717 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946223.255273:0:22710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946223.255319:0:22710:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+19:3648:x1877942638709760:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946223.255321:0:23878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812ea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23878:1877942638709504:0@lo:104: 00000100:00100000:2.0:1790946223.255333:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1790946223.255341:0:23878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef0400/0xd9f4181e0d27eb77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27eb70 expref: 19 pid: 22717 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946223.255355:0:23878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23878:1877942638709632:0@lo:104: 00000100:00100000:2.0:1790946223.255357:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790946223.255368:0:22710:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+17:3649:x1877942638709888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790946223.255378:0:22710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946223.255382:0:22710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40813ff200/0xd9f4181e0d27ec7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ec73 expref: 17 pid: 22719 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946223.255384:0:23878:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d3f83c64a00/0xd9f4181e0d27ecce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946223.255401:0:22710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40813ff200/0xd9f4181e0d27ec7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27ec73 expref: 17 pid: 22719 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946223.257633:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3648:1877942638709760:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790946223.258057:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40813ff200/0xd9f4181e0d27ec7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27ec73 expref: 17 pid: 22719 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946223.258098:0:22710:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d3f83c64a00/0xd9f4181e0d27ecce lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946223.258107:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3f83c64a00/0xd9f4181e0d27ecce lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946223.258124:0:22710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3f83c64a00/0xd9f4181e0d27ecce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946223.258131:0:22710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3f83c64a00/0xd9f4181e0d27ecce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946223.258138:0:22710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d3f83c64a00/0xd9f4181e0d27ecce lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946223.258145:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d3f83c64a00/0xd9f4181e0d27ecce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946223.258151:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64a00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946223.258155:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d3f83c64a00/0xd9f4181e0d27ecce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946223.258163:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d3f83c64a00/0xd9f4181e0d27ecce lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946223.258347:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d3f83c64a00/0xd9f4181e0d27ecce lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946223.258359:0:22710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946223.258477:0:22710:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+16:3649:x1877942638709888:12345-0@lo:103:ldlm_bl.0 Request processed in 3109us (3413us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946223.258527:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1790946223.258583:0:23878:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d3f83c64a00/0xd9f4181e0d27ecce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946223.258594:0:23878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d3f83c64a00/0xd9f4181e0d27ecce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946223.258601:0:23878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3f83c64a00/0xd9f4181e0d27ecce lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946223.258830:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3649:1877942638709888:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790946223.392960:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790946223.911033:0:22760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790946224.415491:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790946225.185396:0:22721:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790946225.185404:0:22721:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d4096c6b800 from 13 10000000:01000000:2.0:1790946225.185411:0:22721:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790946225.185483:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27ecd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946225.185495:0:22721:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27ecd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946225.185506:0:22721:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27ecd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946225.185532:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638710016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790946225.185607:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946225.185647:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4087172240 going to sleep for 11 seconds 00000100:00100000:0.0:1790946225.185776:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638710016 00000100:00100000:0.0:1790946225.185785:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638710016 00000100:00100000:0.0:1790946225.185840:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790946225.185849:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+16:22721:x1877942638710016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946225.185863:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946225.185889:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3f83c65400/0xd9f4181e0d27ecdc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ecd5 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946225.185912:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3f83c65400/0xd9f4181e0d27ecdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ecd5 expref: 17 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946225.185924:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3f83c65400/0xd9f4181e0d27ecdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ecd5 expref: 17 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946225.185933:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65400, rc 0) 00000100:00100000:0.0:1790946225.185981:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+17:22721:x1877942638710016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946225.185988:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790946225.186607:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638710016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790946225.186623:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27ecd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ecdc expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946225.186632:0:22721:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27ecd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ecdc expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946225.186694:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638710144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790946225.186726:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946225.186759:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4087172240 going to sleep for 11 seconds 00000100:00100000:0.0:1790946225.188099:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638710144 00000100:00100000:0.0:1790946225.188111:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638710144 00000100:00100000:0.0:1790946225.188159:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790946225.188748:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+17:22721:x1877942638710144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790946225.188983:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+17:22721:x1877942638710144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 815us (2254us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946225.188993:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790946225.190339:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638710144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790946225.190414:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638710272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790946225.190493:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946225.190570:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4087172240 going to sleep for 11 seconds 00000100:00100000:1.0:1790946225.190708:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638710272 00000100:00100000:1.0:1790946225.190715:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638710272 00000100:00100000:1.0:1790946225.190800:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790946225.190808:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+17:22721:x1877942638710272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790946225.190923:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+17:22721:x1877942638710272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946225.190937:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790946225.191006:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638710272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790946225.191735:0:23953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790946225.191796:0:22721:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790946225.191817:0:22721:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790946225.191828:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27ecd5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ecdc expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946225.191840:0:22721:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27ecd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ecdc expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946225.191850:0:22721:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790946225.191853:0:22721:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3f83705800 from 13 10000000:01000000:3.0:1790946225.191856:0:22721:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790946225.191886:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0000/0xd9f4181e0d27ece3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946225.191894:0:22721:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40baef0000/0xd9f4181e0d27ece3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946225.191903:0:22721:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40baef0000/0xd9f4181e0d27ece3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946225.191918:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638710400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790946225.191960:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946225.192531:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcbcd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946225.192930:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638710400 00000100:00100000:2.0:1790946225.192937:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638710400 00000100:00100000:2.0:1790946225.192991:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790946225.193000:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+17:22721:x1877942638710400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790946225.193013:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946225.193027:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27ecea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ece3 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946225.193048:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27ecea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ece3 expref: 18 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946225.193058:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27ecea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ece3 expref: 18 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946225.193067:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d7c00, rc 0) 00000100:00100000:2.0:1790946225.193124:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:22721:x1877942638710400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946225.193369:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790946225.193742:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638710400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790946225.193758:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40baef0000/0xd9f4181e0d27ece3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ecea expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946225.193767:0:22721:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40baef0000/0xd9f4181e0d27ece3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ecea expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946225.193857:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638710528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790946225.193897:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946225.193915:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4087172840 going to sleep for 11 seconds 00000100:00100000:3.0:1790946225.194036:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638710528 00000100:00100000:3.0:1790946225.194049:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638710528 00000100:00100000:3.0:1790946225.194100:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790946225.194110:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:22721:x1877942638710528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946225.194316:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:22721:x1877942638710528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946225.194324:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790946225.195160:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638710528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946225.195494:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638710656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790946225.195555:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946225.195585:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcbcd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946225.195760:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638710656 00000100:00100000:2.0:1790946225.195766:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638710656 00000100:00100000:2.0:1790946225.195817:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790946225.195826:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:22721:x1877942638710656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790946225.195935:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:22721:x1877942638710656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946225.195943:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790946225.196027:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638710656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790946225.197283:0:23954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1790946225.197469:0:22721:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1790946225.197496:0:22721:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790946225.197509:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0000/0xd9f4181e0d27ece3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ecea expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946225.197521:0:22721:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40baef0000/0xd9f4181e0d27ece3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ecea expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946225.439427:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946225.503367:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638710784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790946225.503459:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790946225.503992:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946225.503998:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790946225.504001:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946225.504004:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790946225.504040:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946225.504043:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790946225.504046:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946225.504048:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790946225.504102:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946215/real 1790946215] req@ffff9d3f84e26680 x1877942638704384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946225 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946225.504138:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3f84e26680 x1877942638704384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946225 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946225.504147:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946215/real 1790946215] req@ffff9d3f84e24000 x1877942638704256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946225 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946225.504157:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3f84e24000 x1877942638704256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946225 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790946225.504186:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bc9b9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790946225.504198:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790946225.504202:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638704384:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1790946225.504207:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f83c3e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790946225.504211:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790946225.504214:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638704256:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1790946225.504239:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638711040:0@lo:400:kworker.0 00000100:00100000:3.0:1790946225.504276:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946225.504297:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790946225.504302:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638710912:0@lo:400:kworker.0 00000100:00100000:3.0:1790946225.504324:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946225.504345:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638711168:0@lo:400:kworker.0 00000100:00100000:3.0:1790946225.504365:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790946225.504387:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946225.504390:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790946225.504392:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946225.504400:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790946225.504403:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946225.504405:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790946225.504407:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d3f83c3e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790946225.504411:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 665 00000100:00080000:3.0:1790946225.504415:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790946225.504425:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9d3f83c3e000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790946225.504456:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f84e24380 x1877942638711296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790946225.504471:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946225.504473:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790946225.504475:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d40bc9b9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790946225.504477:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 665 00000100:00080000:3.0:1790946225.504480:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790946225.504484:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d40bc9b9000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790946225.504495:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f84415f80 x1877942638711424/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790946225.504515:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638711296:0@lo:8:kworker.0 00000400:00000100:3.0:1790946225.504538:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877942638711296 offset 0 length 520: 4 00000100:00100000:3.0:1790946225.504562:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638711424:0@lo:8:kworker.0 00000400:00000100:3.0:1790946225.504579:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877942638711424 offset 0 length 520: 4 00000100:00100000:1.0:1790946225.504689:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638710912 00000100:00100000:1.0:1790946225.504697:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638710912 00000100:00100000:1.0:1790946225.504737:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638711168 00000100:00100000:1.0:1790946225.504740:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638711168 00000100:00100000:1.0:1790946225.504757:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790946225.504766:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638710912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946225.504821:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638710912:12345-0@lo:400:kworker.0 Request processed in 57us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946225.504828:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790946225.504845:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790946225.504850:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638711168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946225.504875:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638711168:12345-0@lo:400:kworker.0 Request processed in 25us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946225.504882:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790946225.504919:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3f84e24a80 x1877942638710912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946225.504931:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638710912:0@lo:400:kworker.0 00000100:00100000:1.0:1790946225.504951:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638711552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790946225.504975:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946225.505003:0:23467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638710784 00000100:00100000:1.0:1790946225.505006:0:23467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638710784 00000100:00100000:1.0:1790946225.505027:0:23467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638711040 00000100:00100000:1.0:1790946225.505037:0:23467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638711040 00000100:00100000:1.0:1790946225.505051:0:23467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638711552 00000100:00100000:1.0:1790946225.505053:0:23467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638711552 00000100:00100000:1.0:1790946225.505062:0:23467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790946225.505067:0:23467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1877942638710784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790946225.505094:0:23467:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790946225.505134:0:23467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1877942638710784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946225.505140:0:23467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790946225.505152:0:23467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790946225.505158:0:23467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1877942638711040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946225.505218:0:23467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1877942638711040:12345-0@lo:400:kworker.0 Request processed in 60us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946225.505223:0:23467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790946225.505234:0:23467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790946225.505239:0:23467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638711552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790946225.505254:0:23467:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790946225.505279:0:23467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638711552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 40us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946225.505285:0:23467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790946225.505307:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638711040:0@lo:400:kworker.0 00000100:00100000:1.0:1790946225.505327:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638711552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790946225.505340:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638710784:0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1790946225.506933:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3f84e27480 x1877942638711168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946225.506964:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638711168:0@lo:400:kworker.0 00000001:00100000:0.0:1790946226.017677:0:23459:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1790946226.463606:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946226.527336:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946211/real 1790946211] req@ffff9d3f84e27800 x1877942638702208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946226 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946226.527369:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3f84e27800 x1877942638702208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946226 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946226.527379:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946211/real 1790946211] req@ffff9d3f84e27b80 x1877942638702336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946226 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946226.527406:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3f84e27b80 x1877942638702336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946226 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790946226.527438:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d4096c61000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790946226.527455:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790946226.527459:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638702208:0@lo:8:kworker.0 00000100:00080000:0.0:1790946226.527465:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f81bb0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790946226.527470:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790946226.527472:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638702336:0@lo:8:kworker.0 00000100:00080000:3.0:1790946226.527675:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946226.527680:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790946226.527684:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d4096c61000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790946226.527691:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 662 00000100:00100000:0.0:1790946226.527692:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3647:1877942638711680:0@lo:400:kworker.0 00000100:00080000:3.0:1790946226.527696:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790946226.527709:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d4096c61000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790946226.527730:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f84417800 x1877942638711936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790946226.527746:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946226.527749:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790946226.527751:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d3f81bb0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790946226.527755:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 662 00000100:00080000:3.0:1790946226.527757:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:0.0:1790946226.527763:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790946226.527766:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d3f81bb0800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790946226.527779:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f84415180 x1877942638712064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790946226.527810:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:3.0:1790946226.527820:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946226.527824:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790946226.527827:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946226.527830:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790946226.527857:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790946226.527866:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638712448:0@lo:400:kworker.0 00000100:00100000:0.0:1790946226.527895:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638711808:0@lo:400:kworker.0 00000100:00100000:3.0:1790946226.527901:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946226.527932:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638712192:0@lo:400:kworker.0 00000100:00100000:0.0:1790946226.527937:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946226.527963:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946226.527979:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638711680 00000100:00100000:3.0:1790946226.527986:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790946226.527988:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638711680 00000100:00100000:3.0:1790946226.527994:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638712320:0@lo:400:kworker.0 00000100:00100000:3.0:1790946226.528019:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946226.528039:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790946226.528050:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:3647:x1877942638711680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946226.528056:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638712448 00000100:00100000:3.0:1790946226.528075:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638712448 00000100:00100000:0.0:1790946226.528109:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:3647:x1877942638711680:12345-0@lo:400:kworker.0 Request processed in 60us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946226.528111:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638712192 00000100:00100000:3.0:1790946226.528115:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638712192 00000100:00100000:0.0:1790946226.528120:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790946226.528132:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790946226.528139:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638712448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946226.528157:0:23467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638711808 00000100:00100000:0.0:1790946226.528162:0:23467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638711808 00000100:00100000:3.0:1790946226.528197:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638712448:12345-0@lo:400:kworker.0 Request processed in 58us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946226.528204:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790946226.528215:0:23467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638712320 00000100:00100000:0.0:1790946226.528220:0:23467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638712320 00000100:00100000:3.0:1790946226.528222:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790946226.528229:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638712192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946226.528260:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638712192:12345-0@lo:400:kworker.0 Request processed in 31us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946226.528266:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1790946226.528304:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3f84417100 x1877942638712448/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946226.528317:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638712448:0@lo:400:kworker.0 00010000:00080000:3.0:1790946226.528343:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3f84414380 x1877942638712192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946226.528375:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638712192:0@lo:400:kworker.0 00000100:00100000:0.0:1790946226.528379:0:23467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790946226.528389:0:23467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638711808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946226.528436:0:23467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638711808:12345-0@lo:400:kworker.0 Request processed in 48us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946226.528443:0:23467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790946226.528456:0:23467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790946226.528462:0:23467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638712320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946226.528603:0:23467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638712320:12345-0@lo:400:kworker.0 Request processed in 141us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946226.528610:0:23467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790946226.528639:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638711936:0@lo:8:kworker.0 00000400:00000100:0.0:1790946226.528663:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877942638711936 offset 0 length 520: 4 00000100:00100000:0.0:1790946226.528675:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638712064:0@lo:8:kworker.0 00000400:00000100:0.0:1790946226.528689:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877942638712064 offset 0 length 520: 4 00000100:00100000:0.0:1790946226.528717:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638711808:0@lo:400:kworker.0 00000100:00100000:0.0:1790946226.528725:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3647:1877942638711680:0@lo:400:kworker.0 00000100:00100000:3.0:1790946226.529555:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638712320:0@lo:400:kworker.0 00010000:00010000:2.0:1790946227.495028:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790946227.553902:0:23480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790946228.513116:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946229.537109:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790946229.700137:0:24228:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790946229.700142:0:24228:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1790946229.700143:0:24228:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1790946229.700329:0:24228:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d40bfee6800 00000020:01000004:2.0:1790946229.700344:0:24228:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1790946229.700358:0:24228:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790946229.700383:0:24228:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9d40bfe93380) 00000020:00000080:2.0:1790946229.700402:0:24228:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1790946229.794387:0:24228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1790946229.795600:0:24228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1790946229.796356:0:24228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1790946229.796868:0:24228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1790946229.797615:0:24228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1790946229.797993:0:24228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1790946229.798386:0:24228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:0.0:1790946229.801733:0:24228:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1790946229.801982:0:24228:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1790946229.801997:0:24228:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790946229.802020:0:24228:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd9f4181e0d27ecf8 00000020:01000004:0.0:1790946229.802027:0:24228:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1790946229.802049:0:24228:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.120@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1790946229.802052:0:24228:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1790946229.802058:0:24228:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1790946229.802063:0:24228:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1790946229.802076:0:24228:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9d40b44199c0) 00000020:00000080:0.0:1790946229.802087:0:24228:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1790946229.803443:0:24228:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790946229.803598:0:24228:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1790946229.803604:0:24228:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1790946229.811926:0:24228:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1790946229.811943:0:24228:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1790946229.813737:0:24228:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1790946229.813751:0:24228:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1790946229.820770:0:24228:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790946229.820952:0:24228:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1790946229.820970:0:24228:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1790946229.825550:0:24228:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1790946229.825572:0:24228:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1790946229.865275:0:24228:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790946229.865760:0:24228:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1790946229.865767:0:24228:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1790946229.869581:0:24228:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790946229.869597:0:24228:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1790946229.873333:0:24228:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790946229.873347:0:24228:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1790946229.875520:0:24228:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790946229.875734:0:24228:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1790946229.875741:0:24228:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1790946229.879445:0:24228:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1790946229.879463:0:24228:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1790946229.927667:0:24228:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790946229.928092:0:24228:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1790946229.928100:0:24228:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790946229.931547:0:24228:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790946229.931561:0:24228:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1790946229.932941:0:24228:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1790946229.932986:0:24228:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1790946229.932992:0:24228:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790946229.964264:0:24228:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790946229.964305:0:24228:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.120@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1790946229.964310:0:24228:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790946229.964311:0:24228:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790946229.964313:0:24228:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946229.964314:0:24228:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946229.964315:0:24228:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946229.964317:0:24228:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946229.964318:0:24228:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946229.964320:0:24228:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946229.964321:0:24228:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790946229.964325:0:24228:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1790946229.964332:0:24228:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790946229.964334:0:24228:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790946229.964335:0:24228:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946229.964335:0:24228:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946229.964337:0:24228:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946229.964338:0:24228:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946229.964339:0:24228:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946229.964340:0:24228:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946229.964341:0:24228:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790946229.964380:0:24228:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790946229.964399:0:24228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff73800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638712576:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790946229.964480:0:24228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946229.964604:0:24228:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408aad8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790946229.965118:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638712576 00000100:00100000:1.0:1790946229.965135:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638712576 00000100:00100000:1.0:1790946229.965347:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790946229.965369:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:24228:x1877942638712576:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790946229.965401:0:22718:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790946229.965403:0:22718:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1790946229.965407:0:22718:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1790946229.966865:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:24228:x1877942638712576:12345-0@lo:253:mount.lustre.0 Request processed in 1502us (2378us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946229.966877:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790946229.966988:0:24228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff73800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638712576:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790946229.967015:0:24228:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790946229.967018:0:24228:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790946229.967020:0:24228:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790946229.967022:0:24228:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946229.967023:0:24228:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946229.967024:0:24228:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946229.967026:0:24228:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946229.967028:0:24228:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946229.967030:0:24228:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946229.967031:0:24228:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790946229.967056:0:24228:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d40bfee6800 from lustre-OST0000 10000000:01000000:2.0:1790946229.967107:0:24228:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1790946229.967110:0:24228:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790946229.967119:0:24228:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d40accf4d40 local copy 00010000:00010000:2.0:1790946229.967130:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27eab3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eaba expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946229.967268:0:24228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff73800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638712704:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946229.967307:0:24228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946229.969031:0:24228:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408aad8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790946229.969378:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638712704 00000100:00100000:0.0:1790946229.969388:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638712704 00000100:00100000:0.0:1790946229.969468:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790946229.969476:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:24228:x1877942638712704:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946229.969589:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:24228:x1877942638712704:12345-0@lo:501:mount.lustre.0 Request processed in 113us (2282us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790946229.969596:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790946229.969703:0:24228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff73800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638712704:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790946229.969723:0:24228:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790946229.969764:0:24228:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790946229.969773:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27eab3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eaba expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946229.969783:0:24228:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27eab3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eaba expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946229.969812:0:24228:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d40bfee6800 10000000:01000000:2.0:1790946229.969817:0:24228:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790946229.969822:0:24228:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790946229.969824:0:24228:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790946229.969828:0:24228:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1790946229.969831:0:24228:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1790946229.969860:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27ed06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946229.969868:0:24228:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27ed06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946229.969877:0:24228:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27ed06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946229.969895:0:24228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff73800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638712832:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790946229.969926:0:24228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946229.969954:0:24228:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408aad8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790946229.970203:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638712832 00000100:00100000:0.0:1790946229.970208:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638712832 00000100:00100000:0.0:1790946229.970345:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790946229.970369:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+18:24228:x1877942638712832:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790946229.970379:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946229.970391:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3f83c64200/0xd9f4181e0d27ed0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ed06 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946229.970420:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3f83c64200/0xd9f4181e0d27ed0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ed06 expref: 19 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946229.970430:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3f83c64200/0xd9f4181e0d27ed0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ed06 expref: 19 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946229.970437:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64200, rc 0) 00000100:00100000:0.0:1790946229.970476:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+19:24228:x1877942638712832:12345-0@lo:101:mount.lustre.0 Request processed in 122us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946229.970482:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790946229.973672:0:24228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff73800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638712832:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946229.973702:0:24228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27ed06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ed0d expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946229.973735:0:24228:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27ed06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ed0d expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790946229.974873:0:24228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1790946229.978190:0:24228:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790946229.980618:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1790946229.980685:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1790946229.980702:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1790946229.980716:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1790946229.980730:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1790946229.980745:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1790946229.980759:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1790946229.980772:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1790946229.980785:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1790946229.980817:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1790946229.980835:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1790946229.980848:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1790946229.980874:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1790946229.980880:0:24228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1790946229.981730:0:24228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff73800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638712960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946229.981805:0:24228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946229.981853:0:24228:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408aad8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790946229.981929:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638712960 00000100:00100000:1.0:1790946229.981938:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638712960 00000100:00100000:1.0:1790946229.982001:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790946229.982010:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+19:24228:x1877942638712960:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946229.982191:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+19:24228:x1877942638712960:12345-0@lo:501:mount.lustre.0 Request processed in 181us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946229.982199:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790946229.982353:0:24228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff73800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638712960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946229.982404:0:24228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638713088:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790946229.982448:0:24228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946229.982476:0:24228:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871c6780 going to sleep for 11 seconds 00000100:00100000:1.0:1790946229.982634:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638713088 00000100:00100000:1.0:1790946229.982639:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638713088 00000100:00100000:1.0:1790946229.982672:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790946229.982678:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+19:24228:x1877942638713088:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790946229.984510:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+19:24228:x1877942638713088:12345-0@lo:503:mount.lustre.0 Request processed in 1825us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946229.984522:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790946229.984653:0:24228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638713088:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790946229.985139:0:24228:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790946229.985396:0:24228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638713216:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946229.985453:0:24228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946229.985544:0:24228:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871c6780 going to sleep for 11 seconds 00000100:00100000:0.0:1790946229.986149:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638713216 00000100:00100000:0.0:1790946229.986158:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638713216 00000100:00100000:0.0:1790946229.986396:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790946229.986406:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+19:24228:x1877942638713216:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790946229.987008:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+19:24228:x1877942638713216:12345-0@lo:502:mount.lustre.0 Request processed in 591us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946229.987017:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790946229.987114:0:24228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638713216:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790946229.987398:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1790946229.987429:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1790946229.987443:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1790946229.987456:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1790946229.987469:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1790946229.987481:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1790946229.987494:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1790946229.987507:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1790946229.987532:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1790946229.987546:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1790946229.987559:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1790946229.987574:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1790946229.987606:0:24228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638713344:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946229.987653:0:24228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946229.990962:0:24228:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871c6780 going to sleep for 11 seconds 00000100:00100000:1.0:1790946229.993294:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638713344 00000100:00100000:1.0:1790946229.993310:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638713344 00000100:00100000:1.0:1790946229.993399:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790946229.993409:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+19:24228:x1877942638713344:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946229.993603:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+19:24228:x1877942638713344:12345-0@lo:502:mount.lustre.0 Request processed in 195us (5949us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946229.993611:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790946229.994740:0:24228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638713344:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790946229.994852:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1790946229.994870:0:24228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1790946229.997321:0:24245:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790946229.997333:0:24245:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1790946229.997372:0:24245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946229.997375:0:24245:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1790946229.997383:0:24245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790946229.997400:0:24245:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9d40a763b380) 00000020:00000080:3.0:1790946229.997429:0:24245:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1790946229.997437:0:24245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790946229.997511:0:24245:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d40bfee6800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1790946229.997521:0:24245:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790946229.997530:0:24245:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd9f4181e0d27ed1b 00010000:00010000:3.0:1790946230.008542:0:24245:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1790946230.009069:0:24245:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1790946230.011156:0:24245:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1790946230.015148:0:24245:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1790946230.015161:0:24245:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946230.015189:0:24245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946230.015191:0:24245:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1790946230.015195:0:24245:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790946230.015198:0:24245:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1790946230.015207:0:24245:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790946230.015209:0:24245:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790946230.015211:0:24245:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790946230.015214:0:24245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946230.015215:0:24245:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790946230.015218:0:24245:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790946230.015221:0:24245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946230.015222:0:24245:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790946230.015225:0:24245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790946230.015227:0:24245:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790946230.015229:0:24245:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946230.015232:0:24245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946230.015233:0:24245:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790946230.015235:0:24245:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790946230.015237:0:24245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946230.015238:0:24245:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790946230.015240:0:24245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1790946230.015272:0:24245:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946230.015275:0:24245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946230.015276:0:24245:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790946230.015279:0:24245:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1790946230.020618:0:24228:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1790946230.020676:0:24228:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1790946230.020907:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27ed06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ed0d expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946230.020920:0:24228:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7a00/0xd9f4181e0d27ed06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ed0d expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946230.020953:0:24228:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d40bfee6800 from 1 10000000:01000000:2.0:1790946230.020957:0:24228:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790946230.021006:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27ed22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946230.021015:0:24228:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27ed22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946230.021028:0:24228:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27ed22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946230.021065:0:24228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638713472:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790946230.021353:0:24228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946230.021431:0:24228:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408aad86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946230.023527:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638713472 00000100:00100000:2.0:1790946230.023543:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638713472 00000100:00100000:2.0:1790946230.023606:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790946230.023616:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+19:24228:x1877942638713472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946230.023633:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946230.023651:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d6e00/0xd9f4181e0d27ed29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ed22 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946230.023679:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d6e00/0xd9f4181e0d27ed29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ed22 expref: 20 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946230.023691:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d6e00/0xd9f4181e0d27ed29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ed22 expref: 20 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946230.023722:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d6e00, rc 0) 00000100:00100000:2.0:1790946230.024139:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+20:24228:x1877942638713472:12345-0@lo:101:mount.lustre.0 Request processed in 523us (2785us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946230.024147:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790946230.024247:0:24228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638713472:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946230.024269:0:24228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27ed22 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ed29 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946230.024279:0:24228:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27ed22 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ed29 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790946230.030068:0:24228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1790946230.030459:0:24228:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790946230.030678:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1790946230.030704:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1790946230.030718:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1790946230.030752:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1790946230.030768:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1790946230.030782:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1790946230.030794:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1790946230.030806:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1790946230.030818:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1790946230.030830:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1790946230.030842:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1790946230.030858:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1790946230.030863:0:24228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1790946230.030941:0:24228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638713600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946230.031009:0:24228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946230.031064:0:24228:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408aad8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790946230.031656:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638713600 00000100:00100000:1.0:1790946230.031666:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638713600 00000100:00100000:1.0:1790946230.031715:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790946230.031725:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+20:24228:x1877942638713600:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946230.031900:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+20:24228:x1877942638713600:12345-0@lo:501:mount.lustre.0 Request processed in 176us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946230.031910:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790946230.032434:0:24228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638713600:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946230.032493:0:24228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638713728:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790946230.032550:0:24228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946230.032750:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638713728 00000100:00100000:2.0:1790946230.032755:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638713728 00000100:00100000:2.0:1790946230.032791:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790946230.032798:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+20:24228:x1877942638713728:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790946230.032887:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+20:24228:x1877942638713728:12345-0@lo:503:mount.lustre.0 Request processed in 89us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946230.032894:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790946230.033130:0:24228:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084352cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946230.033149:0:24228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638713728:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790946230.034700:0:24228:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790946230.034823:0:24228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638713856:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790946230.034897:0:24228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946230.034943:0:24228:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084352cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946230.035145:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638713856 00000100:00100000:2.0:1790946230.035165:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638713856 00000100:00100000:2.0:1790946230.035236:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790946230.035246:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+20:24228:x1877942638713856:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790946230.035387:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+20:24228:x1877942638713856:12345-0@lo:502:mount.lustre.0 Request processed in 142us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946230.035395:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790946230.035690:0:24228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638713856:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790946230.035946:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1790946230.035990:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1790946230.037165:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1790946230.037201:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1790946230.037216:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1790946230.037233:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1790946230.037251:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1790946230.037267:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1790946230.037306:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1790946230.037324:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1790946230.037340:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1790946230.037391:0:24228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638713984:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790946230.037466:0:24228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946230.037499:0:24228:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084352cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946230.037635:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638713984 00000100:00100000:1.0:1790946230.037643:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638713984 00000100:00100000:1.0:1790946230.037695:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790946230.037705:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+20:24228:x1877942638713984:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946230.037859:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+20:24228:x1877942638713984:12345-0@lo:502:mount.lustre.0 Request processed in 155us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946230.037868:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790946230.038494:0:24228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638713984:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790946230.038565:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1790946230.038577:0:24228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1790946230.043107:0:24249:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790946230.043122:0:24249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946230.043125:0:24249:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790946230.043133:0:24249:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d40bfee6800 00000020:00000080:0.0:1790946230.043136:0:24249:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790946230.043144:0:24249:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790946230.043147:0:24249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946230.043148:0:24249:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790946230.043150:0:24249:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790946230.043153:0:24249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946230.043154:0:24249:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790946230.043157:0:24249:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d40bfee6800 00000020:00000080:0.0:1790946230.043159:0:24249:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790946230.043562:0:24249:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790946230.043567:0:24249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946230.043568:0:24249:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790946230.043571:0:24249:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790946230.043573:0:24249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946230.043574:0:24249:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790946230.043578:0:24249:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d40bfee6800 00000020:00000080:0.0:1790946230.043580:0:24249:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790946230.045891:0:24249:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790946230.045904:0:24249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946230.045906:0:24249:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790946230.045910:0:24249:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790946230.045914:0:24249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946230.045916:0:24249:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790946230.045922:0:24249:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d40bfee6800 00000020:00000080:0.0:1790946230.045926:0:24249:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790946230.045986:0:24249:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790946230.045989:0:24249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946230.045991:0:24249:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790946230.045994:0:24249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1790946230.049370:0:24228:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1790946230.049420:0:24228:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790946230.049451:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27ed22 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ed29 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946230.049464:0:24228:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27ed22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ed29 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946230.049541:0:24228:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790946230.049544:0:24228:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d40bfee6800 10000000:01000000:1.0:1790946230.049551:0:24228:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d40bfee6800 10000000:01000000:1.0:1790946230.049556:0:24228:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790946230.049562:0:24228:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d40bfee6800 from 1 10000000:01000000:1.0:1790946230.049565:0:24228:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790946230.049613:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813fe800/0xd9f4181e0d27ed30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946230.049621:0:24228:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40813fe800/0xd9f4181e0d27ed30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946230.049632:0:24228:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40813fe800/0xd9f4181e0d27ed30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946230.049659:0:24228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638714112:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790946230.049736:0:24228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946230.049777:0:24228:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4c20e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790946230.050847:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638714112 00000100:00100000:2.0:1790946230.050861:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638714112 00000100:00100000:2.0:1790946230.050960:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790946230.050971:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+20:24228:x1877942638714112:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946230.050987:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946230.051005:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40c21d6a00/0xd9f4181e0d27ed37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ed30 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946230.051033:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40c21d6a00/0xd9f4181e0d27ed37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ed30 expref: 21 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946230.051059:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40c21d6a00/0xd9f4181e0d27ed37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ed30 expref: 21 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946230.051079:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40c21d6a00, rc 0) 00000100:00100000:2.0:1790946230.051152:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:24228:x1877942638714112:12345-0@lo:101:mount.lustre.0 Request processed in 183us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946230.051160:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790946230.051303:0:24228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638714112:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790946230.051322:0:24228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40813fe800/0xd9f4181e0d27ed30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ed37 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946230.051331:0:24228:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40813fe800/0xd9f4181e0d27ed30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ed37 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790946230.068810:0:24228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1790946230.069149:0:24228:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790946230.069379:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1790946230.069406:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1790946230.069422:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1790946230.069449:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1790946230.069465:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1790946230.069481:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1790946230.069493:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1790946230.069525:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1790946230.069541:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1790946230.069553:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1790946230.069565:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1790946230.069577:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1790946230.069590:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1790946230.069602:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1790946230.069615:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1790946230.069627:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1790946230.069640:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1790946230.069653:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1790946230.069666:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1790946230.069679:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1790946230.069691:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1790946230.069704:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1790946230.069718:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1790946230.069744:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1790946230.069759:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1790946230.069772:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1790946230.069784:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1790946230.069797:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1790946230.069810:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1790946230.069822:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1790946230.069835:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1790946230.069846:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1790946230.069859:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1790946230.069871:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1790946230.069884:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1790946230.069897:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1790946230.069920:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1790946230.069934:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1790946230.069945:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1790946230.069973:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1790946230.069990:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1790946230.070003:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1790946230.070017:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1790946230.070031:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1790946230.070044:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1790946230.070057:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1790946230.070070:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1790946230.070085:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1790946230.070235:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1790946230.070257:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1790946230.070275:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1790946230.070281:0:24228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1790946230.070385:0:24228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638714240:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946230.070453:0:24228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946230.070494:0:24228:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baf8f840 going to sleep for 11 seconds 00000100:00100000:0.0:1790946230.070524:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638714240 00000100:00100000:0.0:1790946230.070531:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638714240 00000100:00100000:0.0:1790946230.070584:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790946230.070593:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:24228:x1877942638714240:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946230.070713:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:24228:x1877942638714240:12345-0@lo:501:mount.lustre.0 Request processed in 120us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946230.070721:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790946230.070768:0:24228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638714240:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946230.070799:0:24228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638714368:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790946230.070836:0:24228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946230.075458:0:24228:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baf8f840 going to sleep for 11 seconds 00000100:00100000:3.0:1790946230.076973:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638714368 00000100:00100000:3.0:1790946230.076989:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638714368 00000100:00100000:3.0:1790946230.077222:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790946230.077233:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:24228:x1877942638714368:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790946230.077424:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:24228:x1877942638714368:12345-0@lo:503:mount.lustre.0 Request processed in 192us (6586us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946230.077432:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790946230.077500:0:24228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638714368:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790946230.077954:0:24228:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790946230.079388:0:24228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638714496:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946230.079468:0:24228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946230.079546:0:24228:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83f7c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946230.084683:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638714496 00000100:00100000:1.0:1790946230.084702:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638714496 00000100:00100000:1.0:1790946230.085242:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790946230.085254:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:24228:x1877942638714496:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946230.085472:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:24228:x1877942638714496:12345-0@lo:502:mount.lustre.0 Request processed in 220us (6003us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946230.085479:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790946230.085574:0:24228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638714496:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790946230.085839:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1790946230.085873:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1790946230.085890:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1790946230.085906:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1790946230.085921:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1790946230.085950:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1790946230.085968:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1790946230.085981:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1790946230.086007:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1790946230.086025:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1790946230.086041:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1790946230.086055:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1790946230.086068:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1790946230.086091:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1790946230.086107:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1790946230.086121:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1790946230.086136:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1790946230.086150:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1790946230.086162:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1790946230.086193:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1790946230.086207:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1790946230.086236:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1790946230.086254:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1790946230.086270:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1790946230.086285:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1790946230.086300:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1790946230.086320:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1790946230.086335:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1790946230.086349:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1790946230.086377:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1790946230.086402:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1790946230.086417:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1790946230.086429:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1790946230.086439:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1790946230.086452:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1790946230.086466:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1790946230.086479:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1790946230.086506:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1790946230.086521:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1790946230.086534:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1790946230.086546:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1790946230.086557:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1790946230.086570:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1790946230.086583:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1790946230.086596:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1790946230.086607:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1790946230.086620:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1790946230.086632:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1790946230.086678:0:24228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638714624:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790946230.086732:0:24228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946230.086779:0:24228:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40baf8f240 going to sleep for 11 seconds 00000100:00100000:1.0:1790946230.087584:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638714624 00000100:00100000:1.0:1790946230.087596:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638714624 00000100:00100000:1.0:1790946230.087652:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790946230.087661:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:24228:x1877942638714624:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946230.088365:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:24228:x1877942638714624:12345-0@lo:502:mount.lustre.0 Request processed in 235us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946230.088388:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790946230.088459:0:24228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638714624:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790946230.088702:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1790946230.088730:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1790946230.088764:0:24228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638714752:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946230.088814:0:24228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946230.088852:0:24228:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4c20000 going to sleep for 11 seconds 00000100:00100000:2.0:1790946230.088897:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638714752 00000100:00100000:2.0:1790946230.088903:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638714752 00000100:00100000:2.0:1790946230.088943:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790946230.088951:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:24228:x1877942638714752:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790946230.089075:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:24228:x1877942638714752:12345-0@lo:502:mount.lustre.0 Request processed in 113us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946230.089083:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790946230.089127:0:24228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638714752:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790946230.089195:0:24228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1790946230.089204:0:24228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1790946230.091804:0:24255:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1790946230.091823:0:24255:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9d40b441b380) 00000020:00000080:0.0:1790946230.091850:0:24255:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1790946230.091954:0:24255:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d40bfee6800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790946230.091959:0:24255:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d40bfee6800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790946230.091963:0:24255:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d40bfee6800 3 00010000:00080000:0.0:1790946230.092291:0:24255:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3f826b0000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.120@tcp at head 00010000:00010000:0.0:1790946230.094492:0:24255:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1790946230.094741:0:24255:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1790946230.094783:0:24255:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790946230.094800:0:24255:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd9f4181e0d27ed45 00000100:00080000:0.0:1790946230.094809:0:24255:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790946230.094822:0:24255:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d3f826b0000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1790946230.094858:0:24255:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40812eb100 x1877942638714880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790946230.094892:0:24255:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790946230.094978:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1877942638714880:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790946230.095066:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946230.095261:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638714880 00000100:00100000:0.0:1790946230.095269:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638714880 00000100:00100000:0.0:1790946230.095305:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790946230.095313:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1877942638714880:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790946230.095340:0:22725:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 680 last 0 00000020:00000080:0.0:1790946230.095395:0:22725:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd9f4181e0d27ed4c 00000004:00100000:0.0:1790946230.095412:0:22725:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790946230.095446:0:22725:0:(import.c:65:import_set_state_nolock()) ffff9d40b4e2f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790946230.095498:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1877942638714880:12345-0@lo:38:llog_process_th.0 Request processed in 184us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946230.095506:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790946230.095597:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d40812eb100 x1877942638714880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790946240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946230.095608:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790946230.095615:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1790946230.095621:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790946230.095625:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790946230.095633:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f826b0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790946230.095639:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1877942638714880:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1790946230.096276:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946230.096281:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790946230.096284:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946230.096287:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790946230.096319:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946230.096322:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790946230.096324:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946230.096333:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790946230.096383:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1877942638715392:0@lo:400:kworker.0 00000100:00100000:0.0:1790946230.096439:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946230.096468:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790946230.096474:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638715008:0@lo:400:kworker.0 00000100:00100000:0.0:1790946230.096501:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946230.096533:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638715392 00000100:00100000:0.0:1790946230.096538:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638715392 00000100:00100000:0.0:1790946230.096572:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790946230.096579:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8312ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1877942638715392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946230.096622:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8312ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1877942638715392:12345-0@lo:400:kworker.0 Request processed in 44us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946230.096628:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790946230.096649:0:23467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638715008 00000100:00100000:0.0:1790946230.096653:0:23467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638715008 00000100:00100000:0.0:1790946230.096675:0:23467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790946230.096681:0:23467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8312c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638715008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946230.096713:0:23467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8312c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638715008:12345-0@lo:400:kworker.0 Request processed in 33us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946230.096719:0:23467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790946230.096747:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638715008:0@lo:400:kworker.0 00010000:00080000:0.0:1790946230.096758:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d40812e9180 x1877942638715392/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946230.096768:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1877942638715392:0@lo:400:kworker.0 00000100:00100000:1.0:1790946230.098219:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638715264:0@lo:400:kworker.0 00000100:00100000:1.0:1790946230.098275:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946230.098311:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790946230.098318:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638715136:0@lo:400:kworker.0 00000100:00100000:1.0:1790946230.098341:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1790946230.099811:0:24255:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1790946230.099833:0:24255:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9d40b441cd40) 00000020:00000080:0.0:1790946230.099857:0:24255:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1790946230.099942:0:24255:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d40bfee6800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790946230.099946:0:24255:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d40bfee6800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790946230.099949:0:24255:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d40bfee6800 3 00010000:00080000:0.0:1790946230.099979:0:24255:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3f837dd000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.120@tcp at head 00000100:00100000:2.0:1790946230.101954:0:22729:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638715264 00000100:00100000:2.0:1790946230.101968:0:22729:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638715264 00000100:00100000:2.0:1790946230.102046:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790946230.102057:0:22729:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638715264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946230.102160:0:22729:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638715264:12345-0@lo:400:kworker.0 Request processed in 104us (3883us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946230.102181:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790946230.102209:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638715136 00000100:00100000:2.0:1790946230.102213:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638715136 00000100:00100000:2.0:1790946230.102239:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790946230.102245:0:22724:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1790946230.102246:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638715136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946230.102252:0:22724:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1790946230.102278:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877942638715136:12345-0@lo:400:kworker.0 Request processed in 33us (3936us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946230.102285:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1790946230.102324:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d40812e9c00 x1877942638715136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946230.102338:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877942638715136:0@lo:400:kworker.0 00000100:00100000:2.0:1790946230.102351:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638715264:0@lo:400:kworker.0 00010000:00010000:0.0:1790946230.106323:0:24255:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1790946230.106585:0:24255:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1790946230.106631:0:24255:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790946230.106660:0:24255:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xd9f4181e0d27ed5a 00000100:00080000:0.0:1790946230.106671:0:24255:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790946230.106682:0:24255:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9d3f837dd000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1790946230.106723:0:24255:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f8312f100 x1877942638715520/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790946230.106753:0:24255:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1790946230.106778:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8312f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1877942638715520:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790946230.106858:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790946230.107051:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946230.107057:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790946230.107060:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946230.107063:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790946230.107067:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946230.107070:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790946230.107073:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946230.107075:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790946230.107221:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638715520 00000100:00100000:0.0:1790946230.107229:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638715520 00000100:00100000:0.0:1790946230.107267:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790946230.107275:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1877942638715520:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790946230.107302:0:22725:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 680 last 0 00000020:00000080:0.0:1790946230.107346:0:22725:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xd9f4181e0d27ed61 00000004:00100000:0.0:1790946230.107372:0:22725:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790946230.107408:0:22725:0:(import.c:65:import_set_state_nolock()) ffff9d3f84d97800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790946230.107483:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1877942638715520:12345-0@lo:38:llog_process_th.0 Request processed in 206us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946230.107491:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790946230.107513:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3f8312f100 x1877942638715520/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790946240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946230.107525:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790946230.107541:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1790946230.107548:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790946230.107552:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1790946230.107555:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f837dd000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790946230.107561:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8312f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1877942638715520:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1790946230.108509:0:24255:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1790946230.108653:0:24228:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1790946230.108682:0:24228:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790946230.108707:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813fe800/0xd9f4181e0d27ed30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ed37 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946230.108719:0:24228:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40813fe800/0xd9f4181e0d27ed30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ed37 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790946230.108769:0:24228:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790946230.108771:0:24228:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790946230.108773:0:24228:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946230.108774:0:24228:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946230.108776:0:24228:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946230.108777:0:24228:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946230.108779:0:24228:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946230.108781:0:24228:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946230.108782:0:24228:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790946230.108787:0:24228:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1790946230.108789:0:24228:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790946230.108791:0:24228:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790946230.108792:0:24228:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946230.108793:0:24228:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946230.108794:0:24228:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946230.108795:0:24228:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946230.108797:0:24228:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946230.108798:0:24228:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946230.108799:0:24228:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790946230.108821:0:24228:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790946230.108839:0:24228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638715648:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790946230.108899:0:24228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946230.108935:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638715648 00000100:00100000:2.0:1790946230.108942:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638715648 00000100:00100000:2.0:1790946230.109006:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790946230.109023:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:24228:x1877942638715648:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790946230.109047:0:22717:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1790946230.109061:0:22717:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1790946230.109232:0:24228:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084878000 going to sleep for 11 seconds 20000000:01000000:2.0:1790946230.114899:0:22717:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790946230.114918:0:22717:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1790946230.115195:0:22740:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790946230.115200:0:22740:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790946230.115232:0:22740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d40813fec00/0xd9f4181e0d27ed68 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946230.115250:0:22740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3f83c65a00/0xd9f4181e0d27ecb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ecab expref: 21 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946230.115259:0:22740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27ecc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ecb9 expref: 21 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946230.115267:0:22740:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d40813fec00/0xd9f4181e0d27ed68 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946230.115304:0:22740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27ecc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27ecb9 expref: 21 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946230.115318:0:22740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27ecc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27ecb9 expref: 21 pid: 22719 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946230.115333:0:22740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22740:1877942638715776:0@lo:104: 00000100:00100000:1.0:1790946230.115410:0:22740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790946230.115465:0:22740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3f83c65a00/0xd9f4181e0d27ecb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27ecab expref: 21 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946230.115475:0:22740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3f83c65a00/0xd9f4181e0d27ecb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27ecab expref: 21 pid: 22717 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946230.115482:0:22740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22740:1877942638715904:0@lo:104: 00000100:00100000:1.0:1790946230.115506:0:22740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946230.115525:0:22740:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4c20c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790946230.115629:0:22707:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790946230.115648:0:22707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638715776 00000100:00100000:2.0:1790946230.115657:0:22707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638715776 00000100:00100000:2.0:1790946230.115691:0:22707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638715904 00000100:00100000:2.0:1790946230.115693:0:22707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638715904 00000100:00100000:2.0:1790946230.115706:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790946230.115714:0:22707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+4:22740:x1877942638715776:12345-0@lo:104: 00010000:00010000:2.0:1790946230.115726:0:22707:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27ecb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ecc0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946230.115778:0:22707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790946230.115798:0:22707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+4:22740:x1877942638715776:12345-0@lo:104: Request processed in 85us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946230.115805:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790946230.115820:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790946230.115826:0:22707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bd6f6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+3:22740:x1877942638715904:12345-0@lo:104: 00010000:00010000:2.0:1790946230.115834:0:22707:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65c00/0xd9f4181e0d27ecab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ecb2 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946230.115880:0:22707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790946230.115886:0:22707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bd6f6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+3:22740:x1877942638715904:12345-0@lo:104: Request processed in 60us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946230.115892:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1790946230.115930:0:23880:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790946230.115936:0:23880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27ecb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ecc0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946230.115943:0:23880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813ff000 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:2.0:1790946230.115947:0:23880:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27ecb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27ecc0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946230.115955:0:23880:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27ecb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27ecc0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946230.115962:0:23880:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27ecb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27ecc0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946230.115967:0:23880:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790946230.116009:0:23880:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27ecb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ecc0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946230.116017:0:23880:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946230.116038:0:23880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27ecb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ecc0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946230.116045:0:23880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27ecb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ecc0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946230.116156:0:23880:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946230.116161:0:23880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65c00/0xd9f4181e0d27ecab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ecb2 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946230.116193:0:23880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65c00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:2.0:1790946230.116196:0:23880:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65c00/0xd9f4181e0d27ecab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27ecb2 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946230.116202:0:23880:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65c00/0xd9f4181e0d27ecab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27ecb2 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946230.116208:0:23880:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65c00/0xd9f4181e0d27ecab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27ecb2 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946230.116213:0:23880:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790946230.116227:0:23880:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65c00/0xd9f4181e0d27ecab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ecb2 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946230.116232:0:23880:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946230.116247:0:23880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65c00/0xd9f4181e0d27ecab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ecb2 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946230.116253:0:23880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65c00/0xd9f4181e0d27ecab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ecb2 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946230.116266:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946230.116267:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946230.116269:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946230.116365:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946230.116384:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3648:1877942638716032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790946230.116385:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3649:1877942638716160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790946230.116418:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946230.116452:0:22709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638716032 00000100:00100000:3.0:1790946230.116457:0:22709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638716032 00010000:00010000:3.0:1790946230.116476:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27ecc0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ecb9 expref: 22 pid: 22719 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946230.116488:0:22740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22740:1877942638715776:0@lo:104: 00000100:00100000:2.0:1790946230.116497:0:22740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22740:1877942638715904:0@lo:104: 00000100:00100000:3.0:1790946230.116498:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790946230.116504:0:22709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+22:3648:x1877942638716032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946230.116514:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946230.116518:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27ecc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ecb9 expref: 22 pid: 22719 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946230.116518:0:22740:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d40813fec00/0xd9f4181e0d27ed68 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946230.116528:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27ecc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27ecb9 expref: 22 pid: 22719 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946230.116624:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+22:24228:x1877942638715648:12345-0@lo:253:mount.lustre.0 Request processed in 7609us (7724us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946230.116644:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790946230.116782:0:24228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:24228:1877942638715648:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790946230.116792:0:24228:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790946230.116795:0:24228:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790946230.116796:0:24228:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790946230.116798:0:24228:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946230.116799:0:24228:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946230.116800:0:24228:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946230.116802:0:24228:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946230.116803:0:24228:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946230.116805:0:24228:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946230.116806:0:24228:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790946230.116818:0:24228:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1790946230.117226:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790946230.117714:0:22709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d6800/0xd9f4181e0d27ecc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27ecb9 expref: 21 pid: 22719 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946230.117730:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946230.117781:0:22709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+20:3648:x1877942638716032:12345-0@lo:103:ldlm_bl.0 Request processed in 1276us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946230.117788:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790946230.117807:0:22709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638716160 00000100:00100000:3.0:1790946230.117811:0:22709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638716160 00010000:00010000:3.0:1790946230.117829:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3f83c65a00/0xd9f4181e0d27ecb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ecab expref: 20 pid: 22717 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946230.117857:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790946230.117864:0:22709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d408320b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+20:3649:x1877942638716160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946230.117875:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946230.117879:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3f83c65a00/0xd9f4181e0d27ecb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ecab expref: 20 pid: 22717 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946230.117888:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3f83c65a00/0xd9f4181e0d27ecb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27ecab expref: 20 pid: 22717 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946230.117897:0:22709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3f83c65a00/0xd9f4181e0d27ecb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27ecab expref: 20 pid: 22717 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946230.117906:0:22709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d40813fec00/0xd9f4181e0d27ed68 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946230.117914:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40813fec00/0xd9f4181e0d27ed68 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790946230.117927:0:22709:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006878358s 00010000:00010000:3.0:1790946230.117931:0:22709:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40813fec00/0xd9f4181e0d27ed68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946230.117938:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40813fec00/0xd9f4181e0d27ed68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946230.117944:0:22709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d40813fec00/0xd9f4181e0d27ed68 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946230.117964:0:22709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d40813fec00/0xd9f4181e0d27ed68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946230.117983:0:22709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813fec00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946230.117989:0:22709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d40813fec00/0xd9f4181e0d27ed68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946230.117998:0:22709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d40813fec00/0xd9f4181e0d27ed68 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946230.118012:0:22709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d40813fec00/0xd9f4181e0d27ed68 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946230.118032:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946230.118072:0:22709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d408320b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+19:3649:x1877942638716160:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946230.118079:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790946230.118156:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3649:1877942638716160:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946230.118194:0:22740:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d40813fec00/0xd9f4181e0d27ed68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946230.118203:0:22740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d40813fec00/0xd9f4181e0d27ed68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946230.118209:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40813fec00/0xd9f4181e0d27ed68 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946230.119602:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3648:1877942638716032:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1790946230.120636:0:24228:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1790946230.125521:0:24228:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1790946230.125536:0:24228:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1790946230.125584:0:24228:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790946230.125632:0:24228:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790946230.125659:0:24228:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1790946230.125683:0:24228:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1790946230.126850:0:24228:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790946230.127389:0:24228:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790946230.562778:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946230.625538:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8312e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638716288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790946230.625622:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946230.625680:0:22730:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638716288 00000100:00100000:0.0:1790946230.625689:0:22730:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638716288 00000100:00100000:0.0:1790946230.625733:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790946230.625742:0:22730:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8312e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638716288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790946230.625776:0:22730:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790946230.625815:0:22730:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8312e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638716288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946230.625822:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790946230.625861:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8312e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638716288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790946230.633277:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638716416:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790946230.633364:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946230.633413:0:22729:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638716416 00000100:00100000:1.0:1790946230.633422:0:22729:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638716416 00000100:00100000:1.0:1790946230.633485:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790946230.633495:0:22729:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8312e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638716416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790946230.633529:0:22729:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790946230.633589:0:22729:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8312e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638716416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946230.633597:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790946230.633638:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638716416:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1790946230.971995:0:24309:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790946230.974649:0:24309:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790946231.583358:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790946232.096267:0:22721:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790946232.096280:0:22721:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d4096c6b800 from 13 10000000:01000000:2.0:1790946232.096284:0:22721:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790946232.096336:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afdc00/0xd9f4181e0d27ed6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946232.096348:0:22721:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4092afdc00/0xd9f4181e0d27ed6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946232.096359:0:22721:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4092afdc00/0xd9f4181e0d27ed6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946232.096399:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff70a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638716544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790946232.096468:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946232.096512:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408fc76240 going to sleep for 11 seconds 00000100:00100000:0.0:1790946232.096609:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638716544 00000100:00100000:0.0:1790946232.096617:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638716544 00000100:00100000:0.0:1790946232.096670:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790946232.096681:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+19:22721:x1877942638716544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946232.096694:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946232.096708:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3f83c64800/0xd9f4181e0d27ed76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ed6f expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946232.096731:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3f83c64800/0xd9f4181e0d27ed76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ed6f expref: 20 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946232.096742:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3f83c64800/0xd9f4181e0d27ed76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ed6f expref: 20 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946232.096759:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64800, rc 0) 00000100:00100000:0.0:1790946232.096804:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+20:22721:x1877942638716544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946232.096811:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790946232.096856:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff70a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638716544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946232.096871:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4092afdc00/0xd9f4181e0d27ed6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ed76 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946232.096879:0:22721:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4092afdc00/0xd9f4181e0d27ed6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ed76 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946232.096925:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8312c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638716672:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790946232.096955:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946232.096971:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790946232.096985:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638716672 00000100:00100000:0.0:1790946232.096989:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638716672 00000100:00100000:0.0:1790946232.097012:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790946232.097018:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+20:22721:x1877942638716672:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790946232.097033:0:22717:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790946232.097049:0:22717:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790946232.097052:0:22717:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1790946232.097140:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+20:22721:x1877942638716672:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946232.097148:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790946232.097203:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8312c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638716672:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790946232.097282:0:22721:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790946232.097289:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afdc00/0xd9f4181e0d27ed6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ed76 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946232.097298:0:22721:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4092afdc00/0xd9f4181e0d27ed6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ed76 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946232.097307:0:22721:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790946232.097309:0:22721:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d3f83705800 from 13 10000000:01000000:0.0:1790946232.097311:0:22721:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790946232.097337:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27ed7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946232.097345:0:22721:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27ed7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946232.097352:0:22721:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27ed7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946232.097571:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8312c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638716800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790946232.097606:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946232.097639:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790946232.098893:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638716800 00000100:00100000:3.0:1790946232.098905:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638716800 00000100:00100000:3.0:1790946232.098959:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790946232.098968:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+20:22721:x1877942638716800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946232.098989:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946232.099007:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27ed84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ed7d expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946232.099036:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27ed84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ed7d expref: 21 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946232.099047:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27ed84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ed7d expref: 21 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946232.099055:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef1800, rc 0) 00000100:00100000:1.0:1790946232.099960:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:22721:x1877942638716800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 990us (2349us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946232.099971:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790946232.100038:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8312c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638716800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946232.100061:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27ed7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ed84 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946232.100071:0:22721:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27ed7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ed84 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946232.100162:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8312c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638716928:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790946232.100242:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946232.100270:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790946232.100396:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638716928 00000100:00100000:2.0:1790946232.100402:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638716928 00000100:00100000:2.0:1790946232.100441:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790946232.100450:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:22721:x1877942638716928:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790946232.100467:0:22719:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790946232.100491:0:22719:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790946232.100494:0:22719:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1790946232.100594:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:22721:x1877942638716928:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946232.100601:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790946232.100726:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8312c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638716928:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790946232.100784:0:22721:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790946232.100791:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27ed7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ed84 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946232.100800:0:22721:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27ed7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ed84 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946232.607385:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790946233.121587:0:22760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790946233.631431:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946234.656375:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790946235.231419:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946235.231427:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790946235.231430:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946235.231433:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790946235.231449:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946235.231452:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790946235.231455:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946235.231457:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790946235.231507:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638717184:0@lo:400:kworker.0 00000100:00100000:1.0:1790946235.231575:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946235.231620:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638717696:0@lo:400:kworker.0 00000100:00100000:1.0:1790946235.231652:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946235.231681:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790946235.231688:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638717312:0@lo:400:kworker.0 00000100:00100000:1.0:1790946235.231708:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946235.231725:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638717824:0@lo:400:kworker.0 00000100:00100000:1.0:1790946235.231747:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946235.231778:0:23467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638717184 00000100:00100000:1.0:1790946235.231786:0:23467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638717184 00000100:00100000:1.0:1790946235.231834:0:23467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790946235.231842:0:23467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638717184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946235.231896:0:23467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638717184:12345-0@lo:400:kworker.0 Request processed in 54us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946235.231903:0:23467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790946235.231923:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638717696 00000100:00100000:1.0:1790946235.231927:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638717696 00000100:00100000:1.0:1790946235.231957:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638717312 00000100:00100000:1.0:1790946235.231960:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638717312 00000100:00100000:1.0:1790946235.231971:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638717824 00000100:00100000:1.0:1790946235.231974:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638717824 00000100:00100000:1.0:1790946235.231987:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790946235.231992:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638717696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946235.232022:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638717696:12345-0@lo:400:kworker.0 Request processed in 29us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946235.232028:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790946235.232048:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790946235.232054:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638717312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946235.232080:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638717312:12345-0@lo:400:kworker.0 Request processed in 26us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946235.232086:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790946235.232097:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790946235.232104:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638717824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946235.232129:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638717824:12345-0@lo:400:kworker.0 Request processed in 26us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946235.232135:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790946235.232279:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638717440:0@lo:400:kworker.0 00000100:00100000:2.0:1790946235.232313:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946235.232336:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790946235.232341:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3647:1877942638717056:0@lo:400:kworker.0 00000100:00100000:2.0:1790946235.232379:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946235.232409:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1877942638717568:0@lo:400:kworker.0 00000100:00100000:2.0:1790946235.232432:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790946235.232468:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790946235.232472:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790946235.236016:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f8441ea00 x1877942638717312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946235.236038:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638717312:0@lo:400:kworker.0 00010000:00080000:1.0:1790946235.236052:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f8441df80 x1877942638717824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946235.236061:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638717824:0@lo:400:kworker.0 00000100:00100000:1.0:1790946235.236073:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638717184:0@lo:400:kworker.0 00010000:00080000:1.0:1790946235.236083:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f8441ed80 x1877942638717696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946235.236090:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638717696:0@lo:400:kworker.0 00000100:00100000:1.0:1790946235.236138:0:22729:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638717440 00000100:00100000:1.0:1790946235.236145:0:22729:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638717440 00000100:00100000:1.0:1790946235.236218:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790946235.236227:0:22729:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638717440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946235.236338:0:22729:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638717440:12345-0@lo:400:kworker.0 Request processed in 112us (4023us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946235.236345:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790946235.236370:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638717056 00000100:00100000:1.0:1790946235.236375:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638717056 00000100:00100000:1.0:1790946235.236401:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790946235.236407:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4090317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:3647:x1877942638717056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946235.236438:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4090317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:3647:x1877942638717056:12345-0@lo:400:kworker.0 Request processed in 31us (4058us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946235.236444:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790946235.236486:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3647:1877942638717056:0@lo:400:kworker.0 00000100:00100000:1.0:1790946235.236497:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638717440:0@lo:400:kworker.0 00000100:00100000:1.0:1790946235.236516:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638717568 00000100:00100000:1.0:1790946235.236519:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638717568 00000100:00100000:1.0:1790946235.236543:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790946235.236548:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1877942638717568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946235.236579:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1877942638717568:12345-0@lo:400:kworker.0 Request processed in 31us (4147us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946235.236584:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1790946235.236609:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f8441c700 x1877942638717568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946235.236618:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1877942638717568:0@lo:400:kworker.0 00000001:02000400:3.0:1790946235.522485:0:24599:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790946235.682557:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946235.745228:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8312f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638717952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790946235.745329:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946235.745817:0:22730:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638717952 00000100:00100000:1.0:1790946235.745826:0:22730:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638717952 00000100:00100000:1.0:1790946235.745877:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790946235.746101:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638718080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790946235.746143:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946235.746205:0:23467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638718080 00000100:00100000:3.0:1790946235.746210:0:23467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638718080 00000100:00100000:1.0:1790946235.747063:0:22730:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638717952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790946235.747109:0:22730:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790946235.747181:0:22730:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638717952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (1838us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946235.752496:0:23467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790946235.752516:0:23467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638718080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790946235.752556:0:23467:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1790946235.752665:0:23467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638718080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 154us (6519us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946235.752673:0:23467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790946235.752790:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638718080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790946235.756006:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790946235.756118:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8312f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638717952:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1790946236.445306:0:24653:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790946236.445552:0:24653:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790946236.705137:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790946237.358943:0:24703:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790946237.359356:0:24703:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790946237.728037:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790946237.794319:0:23480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790946238.751541:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946239.783374:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946240.353003:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946225/real 1790946225] req@ffff9d3f84e24380 x1877942638711296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946240 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946240.353043:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3f84e24380 x1877942638711296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946240 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946240.353053:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946225/real 1790946225] req@ffff9d3f84415f80 x1877942638711424/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946240 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946240.353064:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3f84415f80 x1877942638711424/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946240 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790946240.353093:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f83c3e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790946240.353103:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790946240.353107:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638711296:0@lo:8:kworker.0 00000100:00080000:2.0:1790946240.353112:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bc9b9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790946240.353116:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790946240.353119:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638711424:0@lo:8:kworker.0 00000100:00080000:3.0:1790946240.353380:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946240.353385:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790946240.353387:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946240.353390:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790946240.353426:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946240.353429:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790946240.353431:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d3f83c3e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790946240.353436:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 676 00000100:00080000:3.0:1790946240.353441:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790946240.353452:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9d3f83c3e000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790946240.353470:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f84414700 x1877942638718720/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790946240.353483:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946240.353485:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790946240.353487:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d40bc9b9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790946240.353490:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 676 00000100:00080000:3.0:1790946240.353492:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790946240.353496:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d40bc9b9000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790946240.353523:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f84414e00 x1877942638718848/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790946240.353528:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3649:1877942638718208:0@lo:400:kworker.0 00000100:00100000:3.0:1790946240.353559:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638718592:0@lo:400:kworker.0 00000100:00100000:1.0:1790946240.353590:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946240.353622:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638718464:0@lo:400:kworker.0 00000100:00100000:0.0:1790946240.353653:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638718336:0@lo:400:kworker.0 00000100:00100000:3.0:1790946240.363067:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946240.364707:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946240.364861:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946240.364879:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638718976:0@lo:400:kworker.0 00000100:00100000:0.0:1790946240.364888:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638719104:0@lo:400:kworker.0 00000100:00100000:0.0:1790946240.364941:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638718208 00000100:00100000:0.0:1790946240.364951:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638718208 00000100:00100000:0.0:1790946240.365051:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790946240.365061:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4090317050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:3649:x1877942638718208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946240.365437:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4090317050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:3649:x1877942638718208:12345-0@lo:400:kworker.0 Request processed in 377us (11846us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946240.365446:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790946240.365483:0:22730:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638718592 00000100:00100000:0.0:1790946240.365488:0:22730:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638718592 00000100:00100000:0.0:1790946240.365513:0:22730:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638718336 00000100:00100000:0.0:1790946240.365516:0:22730:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638718336 00000100:00100000:0.0:1790946240.365529:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790946240.365536:0:22730:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638718592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946240.365639:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638719232:0@lo:400:kworker.0 00000100:00100000:2.0:1790946240.365664:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946240.365696:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638718464 00000100:00100000:2.0:1790946240.365699:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638718464 00000100:00100000:2.0:1790946240.365727:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638719232 00000100:00100000:2.0:1790946240.365730:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638719232 00000100:00100000:2.0:1790946240.365759:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790946240.365766:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638718464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946240.365804:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638718464:12345-0@lo:400:kworker.0 Request processed in 39us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946240.365811:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790946240.365822:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790946240.365829:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638719232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946240.365846:0:22730:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638718592:12345-0@lo:400:kworker.0 Request processed in 309us (2788us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946240.365853:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638719232:12345-0@lo:400:kworker.0 Request processed in 26us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946240.365853:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790946240.365858:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790946240.365866:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1790946240.365879:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790946240.365883:0:22730:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8312ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638718336:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1790946240.365911:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f84414000 x1877942638718464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946240.365917:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638718720:0@lo:8:kworker.0 00000100:00100000:0.0:1790946240.365917:0:22730:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8312ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638718336:12345-0@lo:400:kworker.0 Request processed in 32us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946240.365929:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638718464:0@lo:400:kworker.0 00000100:00100000:0.0:1790946240.365929:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1790946240.365947:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f84414380 x1877942638719232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946240.365954:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946240.365964:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946240.365987:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3649:1877942638718208:0@lo:400:kworker.0 00000100:00100000:3.0:1790946240.366006:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638718848:0@lo:8:kworker.0 00000100:00100000:0.0:1790946240.366030:0:24233:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638718720 00000100:00100000:0.0:1790946240.366035:0:24233:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638718720 00000100:00100000:3.0:1790946240.366036:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946240.366067:0:24233:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638718848 00000100:00100000:0.0:1790946240.366071:0:24233:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638718848 00000100:00100000:0.0:1790946240.366085:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790946240.366088:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638718592:0@lo:400:kworker.0 00000100:00100000:0.0:1790946240.366094:0:24233:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1877942638718720:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1790946240.366276:0:24233:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:0.0:1790946240.366308:0:24233:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd9f4181e0d27ed8b 00000100:00100000:1.0:1790946240.366319:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946240.366356:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638718336:0@lo:400:kworker.0 00002000:00100000:0.0:1790946240.366418:0:24233:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9d3f84d95000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00000100:00100000:2.0:1790946240.366421:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638719232:0@lo:400:kworker.0 00002000:00080000:0.0:1790946240.366422:0:24233:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1790946240.366425:0:24233:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790946240.366613:0:24233:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1790946240.366640:0:24233:0:(import.c:65:import_set_state_nolock()) ffff9d3f84d96800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790946240.366729:0:24233:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1877942638718720:12345-0@lo:8:kworker.0 Request processed in 636us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946240.366736:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790946240.366751:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790946240.366759:0:24233:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1877942638718848:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1790946240.366772:0:24233:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1790946240.366871:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f84414700 x1877942638718720/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790946260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946240.366893:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790946240.366900:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1790946240.366908:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790946240.366914:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1790946240.366917:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f83c3e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790946240.366982:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790946240.366988:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638718720:0@lo:8:kworker.0 00000004:00080000:1.0:1790946240.367067:0:23469:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1790946240.367087:0:23469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23469:1877942638719488:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1790946240.367224:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638719360:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790946240.367252:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946240.367474:0:23469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946240.367490:0:23469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096c2b180 going to sleep for 11 seconds 00000100:00100000:1.0:1790946240.367512:0:24236:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638719360 00000100:00100000:1.0:1790946240.367516:0:24236:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638719360 00000100:00100000:1.0:1790946240.367552:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790946240.367560:0:24236:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1877942638719360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790946240.367589:0:24236:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790946240.367626:0:24236:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1877942638719360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946240.367633:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790946240.367921:0:24235:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1790946240.367929:0:24235:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:2.0:1790946240.367952:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790946240.368260:0:24235:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638719488 00000100:00100000:2.0:1790946240.368267:0:24235:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638719488 00010000:00080000:2.0:1790946240.368310:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f84e24a80 x1877942638719360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946240.368570:0:24832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790946240.368579:0:24832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23469:x1877942638719488:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1790946240.368980:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638719360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790946240.369264:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638718976 00000100:00100000:1.0:1790946240.369270:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638718976 00000100:00100000:1.0:1790946240.369305:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638719104 00000100:00100000:1.0:1790946240.369309:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638719104 00000100:00100000:2.0:1790946240.369329:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790946240.369557:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790946240.373360:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877942638719104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946240.373499:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877942638719104:12345-0@lo:400:kworker.0 Request processed in 3933us (7454us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946240.373511:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1790946240.373581:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f84415f80 x1877942638719104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946240.373597:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638719104:0@lo:400:kworker.0 00000100:00100000:2.0:1790946240.373765:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8312d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638718976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946240.373896:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8312d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638718976:12345-0@lo:400:kworker.0 Request processed in 4559us (7940us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946240.373903:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1790946240.373929:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:1.0:1790946240.378983:0:24832:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1790946240.378996:0:24832:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1790946240.379108:0:24832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23469:x1877942638719488:12345-0@lo:7:osp-pre-0-1.0 Request processed in 10526us (11629us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946240.379120:0:24832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790946240.379258:0:23469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f84e24380 x1877942638719488/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790946256 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946240.379285:0:23469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84e24380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23469:1877942638719488:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1790946240.379301:0:23469:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:2.0:1790946240.379349:0:23469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23469:1877942638719616:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1790946240.379403:0:23469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946240.379437:0:23469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f830dc180 going to sleep for 11 seconds 00000100:00100000:1.0:1790946240.379653:0:24235:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638719616 00000100:00100000:1.0:1790946240.379660:0:24235:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638719616 00000100:00100000:1.0:1790946240.379711:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790946240.379721:0:24235:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23469:x1877942638719616:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1790946240.379754:0:24235:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1790946240.379790:0:24235:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23469:x1877942638719616:12345-0@lo:5:osp-pre-0-1.0 Request processed in 71us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946240.379796:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790946240.379922:0:23469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40bff71c00 x1877942638719616/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790946256 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946240.379933:0:23469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23469:1877942638719616:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1790946240.379943:0:23469:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1790946240.379981:0:23469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23469:1877942638719744:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1790946240.380008:0:23469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946240.380033:0:23469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f830dc180 going to sleep for 11 seconds 00000100:00100000:1.0:1790946240.380114:0:24832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638719744 00000100:00100000:1.0:1790946240.380118:0:24832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638719744 00000100:00100000:1.0:1790946240.380147:0:24832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790946240.380165:0:24832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23469:x1877942638719744:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1790946240.380211:0:24832:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000004:00080000:1.0:1790946240.394228:0:23468:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790946240.394330:0:23468:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 691210161539ns, next at 0ns, rc = 0 00080000:00080000:1.0:1790946240.394339:0:23468:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1790946240.397941:0:23459:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00080000:0.0:1790946240.401976:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f84416680 x1877942638718976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946240.402008:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638718976:0@lo:400:kworker.0 00000100:00100000:0.0:1790946240.402312:0:24233:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1877942638718848:12345-0@lo:8:kworker.0 Request processed in 35553us (36274us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790946240.402324:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1790946240.405812:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bc9b9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790946240.405822:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790946240.405826:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638718848:0@lo:8:kworker.0 00000001:00080000:3.0:1790946240.419326:0:24229:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:3.0:1790946240.419342:0:24229:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1790946240.420463:0:24832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23469:x1877942638719744:12345-0@lo:5:osp-pre-0-1.0 Request processed in 40302us (40448us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1790946240.420478:0:24832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790946240.420523:0:23469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40bff71c00 x1877942638719744/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790946256 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946240.420536:0:23469:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1790946240.420541:0:23469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23469:1877942638719744:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1790946240.420557:0:23469:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:2.0:1790946240.420603:0:23469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23469:1877942638719872:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1790946240.420644:0:23469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946240.420676:0:23469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f830dc180 going to sleep for 11 seconds 00000100:00100000:3.0:1790946240.420773:0:22736:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638719872 00000100:00100000:3.0:1790946240.420780:0:22736:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638719872 00000100:00100000:3.0:1790946240.420833:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790946240.420842:0:22736:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23469:x1877942638719872:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1790946240.420898:0:22736:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23469:x1877942638719872:12345-0@lo:900:osp-pre-0-1.0 Request processed in 57us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946240.420905:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790946240.421199:0:23469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d40bff71c00 x1877942638719872/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790946256 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946240.421212:0:23469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23469:1877942638719872:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1790946240.806431:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946240.864437:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8312c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638720000:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790946240.864507:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946240.864583:0:23467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638720000 00000100:00100000:0.0:1790946240.864591:0:23467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638720000 00000100:00100000:0.0:1790946240.864643:0:23467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790946240.864653:0:23467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638720000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790946240.864685:0:23467:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790946240.864729:0:23467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638720000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946240.864736:0:23467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790946240.864811:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8312c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638720000:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790946240.869308:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790946240.869332:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638720128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790946240.869403:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946240.869454:0:22729:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638720128 00000100:00100000:1.0:1790946240.869462:0:22729:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638720128 00000100:00100000:1.0:1790946240.869510:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790946240.869519:0:22729:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638720128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790946240.869566:0:22729:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790946240.869673:0:22729:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638720128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 155us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946240.869681:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790946240.872986:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638720128:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790946241.831059:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946242.851241:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790946243.361538:0:22760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790946243.875948:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790946244.871268:0:25049:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790946244.871273:0:25049:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1790946244.871275:0:25049:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1790946244.871386:0:25049:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d3f826b5000 00000020:01000004:1.0:1790946244.871402:0:25049:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1790946244.871417:0:25049:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1790946244.871432:0:25049:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9d40bc9e4d40) 00000020:00000080:1.0:1790946244.871449:0:25049:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00010000:00010000:2.0:1790946244.895432:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1790946244.978156:0:25049:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790946244.979410:0:25049:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1790946244.979817:0:25049:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1790946244.980830:0:25049:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1790946244.985553:0:25049:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1790946244.985989:0:25049:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1790946244.986241:0:25049:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1790946244.991916:0:25049:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790946244.992232:0:25049:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790946244.992247:0:25049:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790946244.992445:0:25049:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd9f4181e0d27ed99 00000020:01000004:2.0:1790946244.992455:0:25049:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1790946244.992481:0:25049:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.120@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790946244.992484:0:25049:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790946244.992492:0:25049:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790946244.992524:0:25049:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1790946244.992529:0:25049:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1790946245.006982:0:25049:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790946245.007028:0:25049:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.120@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1790946245.007034:0:25049:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790946245.007036:0:25049:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790946245.007037:0:25049:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790946245.007038:0:25049:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790946245.007040:0:25049:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790946245.007041:0:25049:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790946245.007042:0:25049:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790946245.007044:0:25049:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790946245.007045:0:25049:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790946245.007049:0:25049:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1790946245.007051:0:25049:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790946245.007052:0:25049:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790946245.007054:0:25049:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790946245.007055:0:25049:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790946245.007056:0:25049:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790946245.007057:0:25049:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790946245.007058:0:25049:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790946245.007059:0:25049:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790946245.007075:0:25049:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790946245.007107:0:25049:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1790946245.007131:0:25049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638720256:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790946245.007252:0:25049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946245.007837:0:25049:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af69af00 going to sleep for 11 seconds 00000100:00100000:2.0:1790946245.009819:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638720256 00000100:00100000:2.0:1790946245.009836:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638720256 00000100:00100000:2.0:1790946245.009901:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790946245.009928:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4090314c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:25049:x1877942638720256:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790946245.009973:0:22719:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1790946245.009976:0:22719:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1790946245.009981:0:22719:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1790946245.011001:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4090314c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:25049:x1877942638720256:12345-0@lo:253:mount.lustre.0 Request processed in 1071us (3744us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946245.011014:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790946245.011754:0:25049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638720256:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790946245.011772:0:25049:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1790946245.011775:0:25049:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790946245.011777:0:25049:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790946245.011778:0:25049:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790946245.011779:0:25049:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790946245.011780:0:25049:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790946245.011781:0:25049:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790946245.011783:0:25049:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790946245.011785:0:25049:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790946245.011786:0:25049:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790946245.011818:0:25049:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d3f826b5000 from lustre-OST0001 10000000:01000000:1.0:1790946245.011853:0:25049:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1790946245.011857:0:25049:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790946245.011866:0:25049:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d40accf4d40 local copy 00010000:00010000:1.0:1790946245.011877:0:25049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27eab3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eaba expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946245.012004:0:25049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638720384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946245.012050:0:25049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946245.012110:0:25049:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af69a540 going to sleep for 11 seconds 00000100:00100000:2.0:1790946245.012283:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638720384 00000100:00100000:2.0:1790946245.012290:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638720384 00000100:00100000:2.0:1790946245.012333:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790946245.012342:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4090315450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:25049:x1877942638720384:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946245.012422:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4090315450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:25049:x1877942638720384:12345-0@lo:501:mount.lustre.0 Request processed in 81us (372us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790946245.012429:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790946245.012475:0:25049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638720384:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790946245.012490:0:25049:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790946245.012508:0:25049:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790946245.012515:0:25049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27eab3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eaba expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946245.012525:0:25049:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40baef0800/0xd9f4181e0d27eab3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eaba expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946245.012558:0:25049:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d3f826b5000 10000000:01000000:1.0:1790946245.012563:0:25049:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790946245.012568:0:25049:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790946245.012570:0:25049:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790946245.012575:0:25049:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1790946245.012578:0:25049:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1790946245.012600:0:25049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813fec00/0xd9f4181e0d27eda0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946245.012609:0:25049:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40813fec00/0xd9f4181e0d27eda0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946245.012618:0:25049:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40813fec00/0xd9f4181e0d27eda0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946245.012630:0:25049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638720512:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790946245.012656:0:25049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946245.012683:0:25049:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af69a540 going to sleep for 11 seconds 00000100:00100000:0.0:1790946245.012731:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638720512 00000100:00100000:0.0:1790946245.012736:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638720512 00000100:00100000:0.0:1790946245.012768:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790946245.012775:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4090315c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:25049:x1877942638720512:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790946245.012784:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946245.012798:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3f83c64600/0xd9f4181e0d27eda7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27eda0 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946245.012821:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3f83c64600/0xd9f4181e0d27eda7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27eda0 expref: 22 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946245.012831:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3f83c64600/0xd9f4181e0d27eda7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27eda0 expref: 22 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946245.012840:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64600, rc 0) 00000100:00100000:0.0:1790946245.012883:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4090315c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+22:25049:x1877942638720512:12345-0@lo:101:mount.lustre.0 Request processed in 109us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946245.012889:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790946245.013043:0:25049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638720512:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946245.013056:0:25049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40813fec00/0xd9f4181e0d27eda0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eda7 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946245.013075:0:25049:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40813fec00/0xd9f4181e0d27eda0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27eda7 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790946245.014259:0:25049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1790946245.014896:0:25049:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790946245.020203:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1790946245.020270:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1790946245.020288:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1790946245.020303:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1790946245.020317:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1790946245.020342:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1790946245.020358:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1790946245.020374:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1790946245.020389:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1790946245.020415:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1790946245.020420:0:25049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1790946245.020532:0:25049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638720640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946245.020610:0:25049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946245.020652:0:25049:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83f7c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946245.021526:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638720640 00000100:00100000:2.0:1790946245.021536:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638720640 00000100:00100000:2.0:1790946245.021596:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790946245.021607:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40929a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+22:25049:x1877942638720640:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946245.022442:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40929a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+22:25049:x1877942638720640:12345-0@lo:501:mount.lustre.0 Request processed in 833us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946245.022453:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790946245.022661:0:25049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638720640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946245.024080:0:25049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638720768:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790946245.025233:0:25049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946245.025287:0:25049:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83f7c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946245.025353:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638720768 00000100:00100000:1.0:1790946245.025361:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638720768 00000100:00100000:1.0:1790946245.025417:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790946245.025426:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40929a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+22:25049:x1877942638720768:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790946245.026483:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40929a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+22:25049:x1877942638720768:12345-0@lo:503:mount.lustre.0 Request processed in 1054us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946245.026494:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790946245.026579:0:25049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638720768:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790946245.027033:0:25049:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790946245.027142:0:25049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638720896:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946245.027226:0:25049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946245.027276:0:25049:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83f7c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946245.027289:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638720896 00000100:00100000:2.0:1790946245.027300:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638720896 00000100:00100000:2.0:1790946245.027356:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790946245.027365:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40929a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+22:25049:x1877942638720896:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946245.028355:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40929a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+22:25049:x1877942638720896:12345-0@lo:502:mount.lustre.0 Request processed in 975us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946245.028376:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790946245.028453:0:25049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638720896:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790946245.028723:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1790946245.028756:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1790946245.028772:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1790946245.028787:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1790946245.028801:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1790946245.028813:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1790946245.028826:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1790946245.028839:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1790946245.028864:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1790946245.028894:0:25049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638721024:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946245.028939:0:25049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946245.028978:0:25049:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83f7c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946245.029030:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638721024 00000100:00100000:1.0:1790946245.029037:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638721024 00000100:00100000:1.0:1790946245.029133:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790946245.029141:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+22:25049:x1877942638721024:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946245.029264:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+22:25049:x1877942638721024:12345-0@lo:502:mount.lustre.0 Request processed in 123us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946245.029271:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790946245.030138:0:25049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638721024:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790946245.030233:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1790946245.030245:0:25049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1790946245.032090:0:25053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790946245.032103:0:25053:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1790946245.032111:0:25053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946245.032113:0:25053:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1790946245.032119:0:25053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790946245.032137:0:25053:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9d4084804d40) 00000020:00000080:2.0:1790946245.032163:0:25053:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790946245.032187:0:25053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790946245.032276:0:25053:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3f826b5000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1790946245.032285:0:25053:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790946245.032293:0:25053:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd9f4181e0d27edb5 00010000:00010000:3.0:1790946245.038147:0:25053:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1790946245.039104:0:25053:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:3.0:1790946245.041752:0:25053:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1790946245.043551:0:25053:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1790946245.044513:0:25053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946245.044524:0:25053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946245.044526:0:25053:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1790946245.044530:0:25053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946245.044534:0:25053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946245.044535:0:25053:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790946245.044538:0:25053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790946245.044540:0:25053:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790946245.044543:0:25053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946245.044545:0:25053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946245.044546:0:25053:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790946245.044548:0:25053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946245.046381:0:25053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946245.046383:0:25053:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790946245.046394:0:25053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790946245.046423:0:25053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946245.046425:0:25053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946245.046427:0:25053:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790946245.046430:0:25053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1790946245.049129:0:25049:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1790946245.049482:0:25049:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1790946245.049507:0:25049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813fec00/0xd9f4181e0d27eda0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eda7 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946245.049519:0:25049:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40813fec00/0xd9f4181e0d27eda0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27eda7 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946245.049527:0:25049:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3f826b5000 from 1 10000000:01000000:1.0:1790946245.049529:0:25049:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790946245.049567:0:25049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27edbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946245.049576:0:25049:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27edbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946245.049587:0:25049:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27edbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946245.049612:0:25049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638721152:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790946245.049781:0:25049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946245.050872:0:25049:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4096c2b480 going to sleep for 11 seconds 00000100:00100000:2.0:1790946245.051910:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638721152 00000100:00100000:2.0:1790946245.051922:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638721152 00000100:00100000:1.0:1790946245.052681:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790946245.052693:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+22:25049:x1877942638721152:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790946245.052710:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946245.052728:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40813ff200/0xd9f4181e0d27edc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27edbc expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946245.052759:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40813ff200/0xd9f4181e0d27edc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27edbc expref: 23 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946245.052772:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40813ff200/0xd9f4181e0d27edc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27edbc expref: 23 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946245.052781:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40813ff200, rc 0) 00000100:00100000:1.0:1790946245.052876:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+23:25049:x1877942638721152:12345-0@lo:101:mount.lustre.0 Request processed in 185us (3097us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946245.052883:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790946245.052967:0:25049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638721152:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946245.052987:0:25049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27edbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27edc3 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946245.052996:0:25049:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27edbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27edc3 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790946245.054076:0:25049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1790946245.054504:0:25049:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790946245.054878:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1790946245.054905:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1790946245.054921:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1790946245.054935:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1790946245.054949:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1790946245.054963:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1790946245.054976:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1790946245.054991:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1790946245.055020:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1790946245.055035:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1790946245.055046:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1790946245.055077:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1790946245.055083:0:25049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1790946245.055331:0:25049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638721280:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946245.055402:0:25049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946245.055484:0:25049:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408fc769c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946245.055532:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638721280 00000100:00100000:1.0:1790946245.055539:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638721280 00000100:00100000:1.0:1790946245.055677:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790946245.055689:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+23:25049:x1877942638721280:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946245.055823:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+23:25049:x1877942638721280:12345-0@lo:501:mount.lustre.0 Request processed in 136us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946245.055830:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790946245.055908:0:25049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638721280:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946245.055947:0:25049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638721408:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790946245.055987:0:25049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946245.056598:0:25049:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408fc769c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946245.056719:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638721408 00000100:00100000:0.0:1790946245.056726:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638721408 00000100:00100000:0.0:1790946245.056756:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790946245.056764:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+23:25049:x1877942638721408:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790946245.056870:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+23:25049:x1877942638721408:12345-0@lo:503:mount.lustre.0 Request processed in 107us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946245.056878:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790946245.056980:0:25049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638721408:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790946245.057464:0:25049:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790946245.057534:0:25049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638721536:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790946245.057638:0:25049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946245.057707:0:25049:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408fc76840 going to sleep for 11 seconds 00000100:00100000:3.0:1790946245.058450:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638721536 00000100:00100000:3.0:1790946245.058460:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638721536 00000100:00100000:0.0:1790946245.059427:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790946245.059440:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+23:25049:x1877942638721536:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790946245.059778:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+23:25049:x1877942638721536:12345-0@lo:502:mount.lustre.0 Request processed in 341us (2138us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946245.059785:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790946245.059877:0:25049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638721536:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790946245.060111:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1790946245.060143:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1790946245.060159:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1790946245.060297:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1790946245.060316:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1790946245.060330:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1790946245.060345:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1790946245.060360:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1790946245.060374:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1790946245.060388:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1790946245.060401:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1790946245.060449:0:25049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638721664:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790946245.060497:0:25049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946245.060787:0:25049:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408fc76840 going to sleep for 11 seconds 00000100:00100000:1.0:1790946245.060834:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638721664 00000100:00100000:1.0:1790946245.060841:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638721664 00000100:00100000:1.0:1790946245.060918:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790946245.060932:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+23:25049:x1877942638721664:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946245.061028:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+23:25049:x1877942638721664:12345-0@lo:502:mount.lustre.0 Request processed in 96us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946245.061035:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790946245.061114:0:25049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638721664:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790946245.061158:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1790946245.061192:0:25049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1790946245.061852:0:25057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946245.061862:0:25057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946245.061864:0:25057:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790946245.061872:0:25057:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3f826b5000 00000020:00000080:2.0:1790946245.061874:0:25057:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790946245.061881:0:25057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946245.061884:0:25057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946245.061885:0:25057:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1790946245.061888:0:25057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946245.061890:0:25057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946245.061891:0:25057:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790946245.061895:0:25057:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3f826b5000 00000020:00000080:2.0:1790946245.061896:0:25057:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790946245.061955:0:25057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946245.061959:0:25057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946245.061960:0:25057:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1790946245.061963:0:25057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946245.061965:0:25057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946245.061967:0:25057:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790946245.061970:0:25057:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d3f826b5000 00000020:00000080:2.0:1790946245.061972:0:25057:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790946245.061990:0:25057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946245.061993:0:25057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946245.061994:0:25057:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790946245.061996:0:25057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946245.061998:0:25057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946245.062000:0:25057:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1790946245.062003:0:25057:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d3f826b5000 00000020:00000080:2.0:1790946245.062005:0:25057:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790946245.062035:0:25057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946245.062038:0:25057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946245.062040:0:25057:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1790946245.062042:0:25057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1790946245.065301:0:25049:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1790946245.065357:0:25049:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790946245.065413:0:25049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27edbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27edc3 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946245.065427:0:25049:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27edbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27edc3 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946245.065489:0:25049:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790946245.065492:0:25049:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d3f826b5000 10000000:01000000:0.0:1790946245.065495:0:25049:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d3f826b5000 10000000:01000000:0.0:1790946245.065500:0:25049:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790946245.065505:0:25049:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d3f826b5000 from 1 10000000:01000000:0.0:1790946245.065512:0:25049:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790946245.065548:0:25049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64a00/0xd9f4181e0d27edca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946245.065556:0:25049:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64a00/0xd9f4181e0d27edca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946245.065577:0:25049:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64a00/0xd9f4181e0d27edca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946245.065603:0:25049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8312fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638721792:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790946245.065676:0:25049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946245.065721:0:25049:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4088c20240 going to sleep for 11 seconds 00000100:00100000:2.0:1790946245.067438:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638721792 00000100:00100000:2.0:1790946245.067454:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638721792 00000100:00100000:2.0:1790946245.067518:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790946245.067528:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+23:25049:x1877942638721792:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946245.067544:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946245.067562:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4092afd600/0xd9f4181e0d27edd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27edca expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946245.067588:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4092afd600/0xd9f4181e0d27edd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27edca expref: 24 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946245.067599:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4092afd600/0xd9f4181e0d27edd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27edca expref: 24 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946245.067607:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afd600, rc 0) 00000100:00100000:2.0:1790946245.067681:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:25049:x1877942638721792:12345-0@lo:101:mount.lustre.0 Request processed in 155us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946245.067687:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790946245.067809:0:25049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8312fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638721792:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790946245.067827:0:25049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64a00/0xd9f4181e0d27edca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27edd1 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946245.067837:0:25049:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64a00/0xd9f4181e0d27edca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27edd1 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790946245.069429:0:25049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1790946245.069713:0:25049:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790946245.069942:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1790946245.069967:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1790946245.069981:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1790946245.069992:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1790946245.070004:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1790946245.070018:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1790946245.070031:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1790946245.070044:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1790946245.070083:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1790946245.070099:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1790946245.070112:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1790946245.070126:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1790946245.070139:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1790946245.070152:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1790946245.070184:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1790946245.070203:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1790946245.070216:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1790946245.070230:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1790946245.070244:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1790946245.070257:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1790946245.070271:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1790946245.070300:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1790946245.070316:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1790946245.070331:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1790946245.070346:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1790946245.070361:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1790946245.070376:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1790946245.070391:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1790946245.070405:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1790946245.070418:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1790946245.070430:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1790946245.070442:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1790946245.070452:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1790946245.070463:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1790946245.070475:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1790946245.070486:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1790946245.070500:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1790946245.070527:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1790946245.070543:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1790946245.070556:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1790946245.070571:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1790946245.073737:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1790946245.073834:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1790946245.073852:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1790946245.073867:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1790946245.073878:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1790946245.073890:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1790946245.073903:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1790946245.075602:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1790946245.075661:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1790946245.075688:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1790946245.075693:0:25049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1790946245.075890:0:25049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8312fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638721920:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946245.075959:0:25049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946245.076002:0:25049:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af69af00 going to sleep for 11 seconds 00000100:00100000:1.0:1790946245.076719:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638721920 00000100:00100000:1.0:1790946245.076730:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638721920 00000100:00100000:1.0:1790946245.076794:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790946245.076805:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:25049:x1877942638721920:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946245.076978:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:25049:x1877942638721920:12345-0@lo:501:mount.lustre.0 Request processed in 174us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946245.076985:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790946245.077889:0:25049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8312fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638721920:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946245.077945:0:25049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8312fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638722048:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790946245.078004:0:25049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946245.078045:0:25049:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40af69af00 going to sleep for 11 seconds 00000100:00100000:1.0:1790946245.078097:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638722048 00000100:00100000:1.0:1790946245.078104:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638722048 00000100:00100000:1.0:1790946245.078150:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790946245.078350:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:25049:x1877942638722048:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790946245.078454:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:25049:x1877942638722048:12345-0@lo:503:mount.lustre.0 Request processed in 297us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946245.078462:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790946245.079925:0:25049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8312fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638722048:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790946245.080392:0:25049:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790946245.080485:0:25049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8312fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638722176:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790946245.080547:0:25049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946245.080601:0:25049:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f81b386c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946245.080858:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638722176 00000100:00100000:1.0:1790946245.080865:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638722176 00000100:00100000:1.0:1790946245.080918:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790946245.080927:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:25049:x1877942638722176:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946245.081036:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:25049:x1877942638722176:12345-0@lo:502:mount.lustre.0 Request processed in 110us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946245.081044:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790946245.081101:0:25049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8312fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638722176:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790946245.081319:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1790946245.081344:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1790946245.081358:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1790946245.081373:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1790946245.081386:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1790946245.081399:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1790946245.081415:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1790946245.081430:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1790946245.081444:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1790946245.081456:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1790946245.081468:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1790946245.081481:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1790946245.081494:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1790946245.081506:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1790946245.081518:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1790946245.081531:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1790946245.081544:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1790946245.081557:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1790946245.081570:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1790946245.081583:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1790946245.081596:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1790946245.081608:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1790946245.081620:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1790946245.081634:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1790946245.081660:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1790946245.081674:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1790946245.081685:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1790946245.081696:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1790946245.081709:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1790946245.081722:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1790946245.081734:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1790946245.081748:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1790946245.081772:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1790946245.081786:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1790946245.081799:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1790946245.081813:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1790946245.081827:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1790946245.081837:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1790946245.081848:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1790946245.081860:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1790946245.081880:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1790946245.081892:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1790946245.081903:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1790946245.081914:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1790946245.081924:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1790946245.081935:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1790946245.081946:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1790946245.081957:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1790946245.081993:0:25049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638722304:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946245.082038:0:25049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946245.082082:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638722304 00000100:00100000:1.0:1790946245.082087:0:25049:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f827a59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946245.082087:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638722304 00000100:00100000:0.0:1790946245.082120:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790946245.082128:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:25049:x1877942638722304:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790946245.082249:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:25049:x1877942638722304:12345-0@lo:502:mount.lustre.0 Request processed in 122us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946245.082256:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790946245.082935:0:25049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638722304:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790946245.083112:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1790946245.083137:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1790946245.083330:0:25049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638722432:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946245.083373:0:25049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946245.083399:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638722432 00000100:00100000:1.0:1790946245.083403:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638722432 00000100:00100000:1.0:1790946245.083437:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790946245.083443:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:25049:x1877942638722432:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946245.083522:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:25049:x1877942638722432:12345-0@lo:502:mount.lustre.0 Request processed in 78us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946245.083534:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790946245.083671:0:25049:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f827a59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946245.083686:0:25049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638722432:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790946245.083724:0:25049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1790946245.083732:0:25049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1790946245.084476:0:25062:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1790946245.084491:0:25062:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9d40bc9e3380) 00000020:00000080:1.0:1790946245.084514:0:25062:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1790946245.084736:0:25062:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3f826b5000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790946245.084741:0:25062:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3f826b5000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790946245.084743:0:25062:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d3f826b5000 3 00010000:00080000:1.0:1790946245.084772:0:25062:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3f84548000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.120@tcp at head 00010000:00010000:1.0:1790946245.092541:0:25062:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1790946245.094281:0:25062:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1790946245.094333:0:25062:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790946245.094344:0:25062:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd9f4181e0d27eddf 00000100:00080000:1.0:1790946245.094355:0:25062:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790946245.094366:0:25062:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d3f84548000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1790946245.094405:0:25062:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f8441ea00 x1877942638722560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790946245.094446:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1877942638722560:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790946245.094523:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946245.094635:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638722560 00000100:00100000:2.0:1790946245.094643:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638722560 00000100:00100000:2.0:1790946245.094679:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790946245.094687:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1877942638722560:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790946245.095122:0:22725:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 695 last 0 00000020:00000080:2.0:1790946245.095152:0:22725:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd9f4181e0d27ede6 00000004:00100000:2.0:1790946245.095182:0:22725:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790946245.095221:0:22725:0:(import.c:65:import_set_state_nolock()) ffff9d3f82759800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790946245.095275:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1877942638722560:12345-0@lo:38:llog_process_th.0 Request processed in 587us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946245.095283:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790946245.095994:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f8441ea00 x1877942638722560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790946255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946245.096008:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790946245.096017:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1790946245.096030:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790946245.096035:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790946245.096037:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f84548000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790946245.096043:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1877942638722560:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1790946245.096094:0:25062:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:0.0:1790946245.099567:0:25062:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1790946245.099596:0:25062:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9d3f822e8000) 00000020:00000080:0.0:1790946245.099625:0:25062:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1790946245.099712:0:25062:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3f826b5000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790946245.099716:0:25062:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3f826b5000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790946245.099719:0:25062:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d3f826b5000 3 00010000:00080000:0.0:1790946245.099749:0:25062:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3f84d96000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.120@tcp at head 00010000:00010000:0.0:1790946245.101846:0:25062:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1790946245.102109:0:25062:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1790946245.102153:0:25062:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790946245.102196:0:25062:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xd9f4181e0d27edf4 00000100:00080000:0.0:1790946245.102207:0:25062:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790946245.102220:0:25062:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9d3f84d96000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1790946245.102256:0:25062:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f8312f480 x1877942638722688/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790946245.102297:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8312f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1877942638722688:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790946245.102375:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946245.102442:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638722688 00000100:00100000:0.0:1790946245.102449:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638722688 00000100:00100000:0.0:1790946245.102479:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790946245.102486:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8312df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1877942638722688:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790946245.102511:0:22724:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 695 last 0 00000020:00000080:0.0:1790946245.102550:0:22724:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xd9f4181e0d27edfb 00000004:00100000:0.0:1790946245.102575:0:22724:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790946245.102612:0:22724:0:(import.c:65:import_set_state_nolock()) ffff9d3f827e1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790946245.102661:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8312df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1877942638722688:12345-0@lo:38:llog_process_th.0 Request processed in 174us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946245.102669:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1790946245.102718:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f8312f480 x1877942638722688/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790946255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946245.102728:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790946245.102735:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1790946245.102741:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790946245.102745:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1790946245.102747:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f84d96000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790946245.102753:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8312f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1877942638722688:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1790946245.102773:0:25062:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1790946245.105412:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946245.105420:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790946245.105423:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946245.105425:0:15915:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790946245.105456:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946245.105459:0:15915:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790946245.105463:0:15915:0:(import.c:65:import_set_state_nolock()) ffff9d40bc9b9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790946245.105471:0:15915:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 691 00000100:00080000:3.0:1790946245.105476:0:15915:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1790946245.105487:0:15915:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d40bc9b9000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1790946245.105510:0:15915:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f84414700 x1877942638723328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790946245.106264:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638723200:0@lo:400:kworker.0 00000100:00100000:0.0:1790946245.106336:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946245.106416:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790946245.106423:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638723072:0@lo:400:kworker.0 00000100:00100000:0.0:1790946245.106450:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946245.106485:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638722944:0@lo:400:kworker.0 00000100:00100000:0.0:1790946245.106515:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946245.106534:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638723584:0@lo:400:kworker.0 00000100:00100000:0.0:1790946245.106555:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946245.106584:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790946245.106590:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638722816:0@lo:400:kworker.0 00000100:00100000:0.0:1790946245.106613:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946245.106641:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638723456:0@lo:400:kworker.0 00000100:00100000:0.0:1790946245.106664:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946245.106708:0:22730:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638723072 00000100:00100000:0.0:1790946245.106715:0:22730:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638723072 00000100:00100000:0.0:1790946245.106759:0:22730:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638722816 00000100:00100000:0.0:1790946245.106762:0:22730:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638722816 00000100:00100000:0.0:1790946245.106780:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790946245.106788:0:22730:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8312dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638723072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946245.106844:0:22730:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8312dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638723072:12345-0@lo:400:kworker.0 Request processed in 56us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946245.106851:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790946245.106868:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790946245.106874:0:22730:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8312ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638722816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946245.106905:0:22730:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8312ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638722816:12345-0@lo:400:kworker.0 Request processed in 32us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946245.106910:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790946245.106927:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638722944 00000100:00100000:0.0:1790946245.106931:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638722944 00000100:00100000:0.0:1790946245.106951:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638723584 00000100:00100000:0.0:1790946245.106955:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638723584 00000100:00100000:0.0:1790946245.106982:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638723456 00000100:00100000:0.0:1790946245.106985:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638723456 00000100:00100000:0.0:1790946245.106997:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790946245.107002:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8312d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638722944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946245.107030:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8312d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877942638722944:12345-0@lo:400:kworker.0 Request processed in 28us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946245.107035:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790946245.107046:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790946245.107069:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8312ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638723584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946245.107099:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8312ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877942638723584:12345-0@lo:400:kworker.0 Request processed in 41us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946245.107104:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790946245.107115:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790946245.107120:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8312d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638723456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946245.107144:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8312d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638723456:12345-0@lo:400:kworker.0 Request processed in 24us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946245.107150:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790946245.107191:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638723712:0@lo:400:kworker.0 00000100:00080000:0.0:1790946245.107191:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946245.107219:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638723072:0@lo:400:kworker.0 00000100:00100000:3.0:1790946245.107227:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946245.107247:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638722816:0@lo:400:kworker.0 00000100:00100000:3.0:1790946245.107253:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638723712 00000100:00100000:3.0:1790946245.107255:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638723712 00010000:00080000:0.0:1790946245.107258:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f84414380 x1877942638723456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946245.107269:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638723456:0@lo:400:kworker.0 00010000:00080000:0.0:1790946245.107279:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f84414e00 x1877942638722944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946245.107287:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877942638722944:0@lo:400:kworker.0 00000100:00100000:3.0:1790946245.107294:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1790946245.107295:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f84414000 x1877942638723584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946245.107300:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638723712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946245.107304:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1877942638723584:0@lo:400:kworker.0 00000100:00100000:3.0:1790946245.107330:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638723712:12345-0@lo:400:kworker.0 Request processed in 30us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946245.107335:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1790946245.107360:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f84417480 x1877942638723712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946245.107368:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638723712:0@lo:400:kworker.0 00000100:00080000:3.0:1790946245.107383:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790946245.107394:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638723328:0@lo:8:kworker.0 00000100:00100000:3.0:1790946245.107419:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946245.115091:0:24234:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638723200 00000100:00100000:1.0:1790946245.115109:0:24234:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638723200 00000100:00100000:1.0:1790946245.115361:0:24234:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638723328 00000100:00100000:1.0:1790946245.115366:0:24234:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638723328 00000100:00100000:1.0:1790946245.115391:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790946245.115402:0:24234:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8312f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638723200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946245.115494:0:24234:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8312f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638723200:12345-0@lo:400:kworker.0 Request processed in 95us (9158us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946245.115503:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790946245.115521:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790946245.115524:0:24234:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1877942638723328:12345-0@lo:8:kworker.0 00000100:00080000:3.0:1790946245.115717:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790946245.115857:0:24234:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1877942638723328:12345-0@lo:8:kworker.0 Request processed in 330us (8436us total) trans 0 rc -11/-11 00000100:00100000:1.0:1790946245.115864:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790946245.115911:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f84415f80 x1877942638723200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946245.115927:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638723200:0@lo:400:kworker.0 00000040:00080000:2.0:1790946245.117329:0:25062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1790946245.118671:0:25049:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1790946245.118730:0:25049:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790946245.118759:0:25049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64a00/0xd9f4181e0d27edca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27edd1 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946245.118771:0:25049:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d3f83c64a00/0xd9f4181e0d27edca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27edd1 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790946245.118826:0:25049:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790946245.118828:0:25049:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790946245.118830:0:25049:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790946245.118831:0:25049:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790946245.118832:0:25049:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790946245.118834:0:25049:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790946245.118835:0:25049:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790946245.118837:0:25049:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790946245.118839:0:25049:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790946245.118844:0:25049:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1790946245.118846:0:25049:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790946245.118848:0:25049:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790946245.118849:0:25049:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790946245.118850:0:25049:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790946245.118851:0:25049:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790946245.118852:0:25049:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790946245.118853:0:25049:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790946245.118855:0:25049:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790946245.118856:0:25049:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790946245.118885:0:25049:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790946245.118907:0:25049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8312fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638723840:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790946245.118976:0:25049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946245.119136:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790946245.119146:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bc9b9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790946245.119151:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1790946245.119155:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638723328:0@lo:8:kworker.0 00000100:00100000:0.0:1790946245.119618:0:25049:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83f7ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1790946245.120370:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638723840 00000100:00100000:0.0:1790946245.120378:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638723840 00000100:00100000:0.0:1790946245.120465:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790946245.120474:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:25049:x1877942638723840:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790946245.120503:0:22717:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1790946245.120524:0:22717:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790946245.123917:0:22717:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790946245.123964:0:22717:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1790946245.124072:0:22740:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790946245.124078:0:22740:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790946245.124099:0:22740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d40baef1600/0xd9f4181e0d27ee02 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.124119:0:22740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3f83c64800/0xd9f4181e0d27ed76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ed6f expref: 24 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.124144:0:22740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27ed84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ed7d expref: 24 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.124152:0:22740:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d40baef1600/0xd9f4181e0d27ee02 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.124296:0:22740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27ed84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27ed7d expref: 24 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.124311:0:22740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27ed84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27ed7d expref: 24 pid: 22717 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946245.124326:0:22740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22740:1877942638723968:0@lo:104: 00000100:00100000:3.0:1790946245.124397:0:22740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946245.124446:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:25049:x1877942638723840:12345-0@lo:253:mount.lustre.0 Request processed in 3971us (5468us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946245.124458:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790946245.124481:0:25049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8312fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32dbedc5-819a-4eba-958c-cd7c205dd6c7:25049:1877942638723840:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790946245.124494:0:25049:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1790946245.124497:0:25049:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790946245.124504:0:25049:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790946245.124506:0:25049:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790946245.124507:0:25049:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790946245.124508:0:25049:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790946245.124509:0:25049:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790946245.124511:0:25049:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790946245.124513:0:25049:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790946245.124515:0:25049:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790946245.124532:0:25049:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1790946245.124876:0:22740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3f83c64800/0xd9f4181e0d27ed76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27ed6f expref: 23 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.124887:0:22740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3f83c64800/0xd9f4181e0d27ed76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27ed6f expref: 23 pid: 22718 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946245.124896:0:22740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22740:1877942638724096:0@lo:104: 00000100:00100000:3.0:1790946245.124918:0:22740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946245.127903:0:22740:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084352cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946245.127987:0:22708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638723968 00000100:00100000:2.0:1790946245.128002:0:22708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638723968 00000100:00100000:2.0:1790946245.128075:0:22708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638724096 00000100:00100000:2.0:1790946245.128080:0:22708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638724096 00000100:00100000:2.0:1790946245.128101:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790946245.128112:0:22708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84415f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+4:22740:x1877942638723968:12345-0@lo:104: 00010000:00010000:2.0:1790946245.128134:0:22708:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27ed7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ed84 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946245.128245:0:22708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790946245.128252:0:22708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84415f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+4:22740:x1877942638723968:12345-0@lo:104: Request processed in 143us (3855us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946245.128259:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790946245.128276:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790946245.128283:0:22708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84414e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+3:22740:x1877942638724096:12345-0@lo:104: 00010000:00010000:2.0:1790946245.128290:0:22708:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d4092afdc00/0xd9f4181e0d27ed6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ed76 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946245.128325:0:22708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790946245.128329:0:22708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84414e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+3:22740:x1877942638724096:12345-0@lo:104: Request processed in 48us (3411us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946245.128336:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000001:00000004:1.0:1790946245.128403:0:25049:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:3.0:1790946245.128501:0:22713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790946245.128509:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27ed7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ed84 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.128516:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65800 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:3.0:1790946245.128520:0:22713:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27ed7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27ed84 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.128546:0:22713:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27ed7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27ed84 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946245.128552:0:22713:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27ed7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27ed84 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946245.128679:0:22713:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790946245.128824:0:22713:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27ed7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ed84 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.128832:0:22713:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790946245.128857:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27ed7d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ed84 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.128864:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d3f83c65800/0xd9f4181e0d27ed7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ed84 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.128878:0:22713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946245.128881:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d4092afdc00/0xd9f4181e0d27ed6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ed76 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.128887:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afdc00 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:3.0:1790946245.128890:0:22713:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d4092afdc00/0xd9f4181e0d27ed6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27ed76 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.128897:0:22713:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d4092afdc00/0xd9f4181e0d27ed6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27ed76 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946245.128903:0:22713:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d4092afdc00/0xd9f4181e0d27ed6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27ed76 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946245.128914:0:22713:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790946245.129008:0:22713:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d4092afdc00/0xd9f4181e0d27ed6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ed76 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.129015:0:22713:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790946245.129031:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d4092afdc00/0xd9f4181e0d27ed6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ed76 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.129037:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d4092afdc00/0xd9f4181e0d27ed6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ed76 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.129051:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946245.129052:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946245.129053:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946245.129072:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946245.129088:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3650:1877942638724224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790946245.129134:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946245.129209:0:22710:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638724224 00000100:00100000:3.0:1790946245.129215:0:22710:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638724224 00010000:00010000:3.0:1790946245.129234:0:22710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27ed84 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ed7d expref: 24 pid: 22717 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946245.129377:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790946245.129387:0:22710:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84416680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:3650:x1877942638724224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946245.129400:0:22710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946245.129406:0:22710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27ed84 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ed7d expref: 24 pid: 22717 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.129428:0:22710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27ed84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27ed7d expref: 24 pid: 22717 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.129446:0:22710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946245.129477:0:22710:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84416680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:3650:x1877942638724224:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946245.129484:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790946245.129522:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3650:1877942638724224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946245.129549:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27ed84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27ed7d expref: 23 pid: 22717 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946245.129789:0:22740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22740:1877942638723968:0@lo:104: 00000100:00100000:3.0:1790946245.129803:0:22740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22740:1877942638724096:0@lo:104: 00010000:00010000:3.0:1790946245.129818:0:22740:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d40baef1600/0xd9f4181e0d27ee02 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946245.129968:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3647:1877942638724352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790946245.130003:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946245.130132:0:22711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638724352 00000100:00100000:3.0:1790946245.130137:0:22711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638724352 00010000:00010000:3.0:1790946245.130153:0:22711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3f83c64800/0xd9f4181e0d27ed76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ed6f expref: 23 pid: 22718 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946245.130437:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790946245.130446:0:22711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8312c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+23:3647:x1877942638724352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946245.130457:0:22711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946245.130462:0:22711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3f83c64800/0xd9f4181e0d27ed76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ed6f expref: 23 pid: 22718 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.130486:0:22711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3f83c64800/0xd9f4181e0d27ed76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27ed6f expref: 23 pid: 22718 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.130497:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3f83c64800/0xd9f4181e0d27ed76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27ed6f expref: 23 pid: 22718 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.130508:0:22711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d40baef1600/0xd9f4181e0d27ee02 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.130516:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef1600/0xd9f4181e0d27ee02 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790946245.130530:0:22711:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006878358s 00010000:00010000:3.0:1790946245.130534:0:22711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40baef1600/0xd9f4181e0d27ee02 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.130541:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40baef1600/0xd9f4181e0d27ee02 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.130548:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d40baef1600/0xd9f4181e0d27ee02 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.130554:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d40baef1600/0xd9f4181e0d27ee02 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.130694:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1600 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946245.130698:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d40baef1600/0xd9f4181e0d27ee02 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.130707:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d40baef1600/0xd9f4181e0d27ee02 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946245.130800:0:22740:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d40baef1600/0xd9f4181e0d27ee02 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946245.130807:0:22740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d40baef1600/0xd9f4181e0d27ee02 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.130841:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d40baef1600/0xd9f4181e0d27ee02 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.130850:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef1600/0xd9f4181e0d27ee02 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946245.130863:0:22711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946245.130949:0:22711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8312c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+22:3647:x1877942638724352:12345-0@lo:103:ldlm_bl.0 Request processed in 504us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946245.130957:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790946245.131010:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3647:1877942638724352:0@lo:103:ldlm_bl.0 00002000:00080000:0.0:1790946245.133683:0:25049:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1790946245.133694:0:25049:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1790946245.133726:0:25049:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790946245.133773:0:25049:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790946245.133791:0:25049:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1790946245.133813:0:25049:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1790946245.134587:0:25049:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790946245.134822:0:25049:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1790946245.473705:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8312f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638724480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790946245.473775:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946245.473904:0:24236:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638724480 00000100:00100000:1.0:1790946245.473913:0:24236:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638724480 00000100:00100000:1.0:1790946245.473958:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790946245.473968:0:24236:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638724480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790946245.474012:0:24236:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790946245.474067:0:24236:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638724480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946245.474075:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790946245.474117:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3f8312f800 x1877942638724480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946245.474138:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8312f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638724480:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1790946245.919390:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946245.984205:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638724608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790946245.984308:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946245.984530:0:22730:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638724608 00000100:00100000:0.0:1790946245.984541:0:22730:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638724608 00000100:00100000:2.0:1790946245.984597:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790946245.984602:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790946245.984610:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638724736:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790946245.984617:0:22730:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638724608:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790946245.984646:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1790946245.984664:0:22730:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790946245.984783:0:22729:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638724736 00000100:00100000:0.0:1790946245.984788:0:22730:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638724608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 175us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946245.984789:0:22729:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638724736 00000100:00100000:0.0:1790946245.984807:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790946245.984828:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790946245.984839:0:22729:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638724736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790946245.984860:0:22729:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790946245.984897:0:22729:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638724736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946245.984910:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790946245.992079:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638724608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790946245.992128:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638724736:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1790946246.151647:0:25115:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790946246.151889:0:25115:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1790946246.181876:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946226/real 1790946226] req@ffff9d3f84417800 x1877942638711936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946246 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946246.181907:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3f84417800 x1877942638711936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946246 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946246.181916:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946226/real 1790946226] req@ffff9d3f84415180 x1877942638712064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946246 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946246.181938:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3f84415180 x1877942638712064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946246 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790946246.181961:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d4096c61000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790946246.181982:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790946246.181985:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638711936:0@lo:8:kworker.0 00000100:00080000:0.0:1790946246.181990:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f81bb0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790946246.181996:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790946246.181998:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638712064:0@lo:8:kworker.0 00000100:00080000:0.0:1790946246.182235:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946246.182239:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1790946246.182241:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d4096c61000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790946246.182246:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 677 00000100:00080000:0.0:1790946246.182251:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1790946246.182262:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d4096c61000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1790946246.182282:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f8312f100 x1877942638724992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790946246.182309:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946246.182312:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790946246.182314:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d3f81bb0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790946246.182318:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 677 00000100:00080000:0.0:1790946246.182321:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1790946246.182326:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d3f81bb0800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1790946246.182339:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3f8312f800 x1877942638725120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790946246.182355:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946246.182358:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790946246.182359:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d40bc9b9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790946246.182364:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d40bc9b9000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1790946246.182374:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d40812e8a80 x1877942638725376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790946246.182436:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8312c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3647:1877942638724864:0@lo:400:kworker.0 00000100:00100000:0.0:1790946246.182504:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946246.182539:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638725760:0@lo:400:kworker.0 00000100:00100000:0.0:1790946246.182569:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946246.182592:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790946246.182598:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8312fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638725248:0@lo:400:kworker.0 00000100:00100000:0.0:1790946246.182619:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946246.182639:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638725888:0@lo:400:kworker.0 00000100:00100000:0.0:1790946246.182660:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946246.189285:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638724864 00000100:00100000:2.0:1790946246.189305:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638724864 00000100:00100000:0.0:1790946246.190724:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638725760 00000100:00100000:0.0:1790946246.190736:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638725760 00000100:00100000:0.0:1790946246.190792:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638725248 00000100:00100000:0.0:1790946246.190796:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638725248 00000100:00100000:0.0:1790946246.190809:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638725888 00000100:00100000:0.0:1790946246.190812:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638725888 00000100:00100000:0.0:1790946246.190843:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790946246.190853:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638725760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946246.191442:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638725760:12345-0@lo:400:kworker.0 Request processed in 588us (8869us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946246.191451:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790946246.191484:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790946246.191493:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638725248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946246.191530:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638725248:12345-0@lo:400:kworker.0 Request processed in 40us (8909us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946246.191536:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790946246.191548:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790946246.191554:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638725888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946246.191583:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638725888:12345-0@lo:400:kworker.0 Request processed in 30us (8922us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946246.191589:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1790946246.191619:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790946246.191652:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8312fb80 x1877942638725248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946246.191666:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8312fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638725248:0@lo:400:kworker.0 00010000:00080000:0.0:1790946246.191819:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40812e9500 x1877942638725888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946246.191847:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638725888:0@lo:400:kworker.0 00010000:00080000:0.0:1790946246.191861:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40812ead80 x1877942638725760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946246.191869:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638725760:0@lo:400:kworker.0 00000100:00100000:0.0:1790946246.191906:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8312f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638724992:0@lo:8:kworker.0 00000100:00100000:0.0:1790946246.192145:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946246.192203:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8312f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638725120:0@lo:8:kworker.0 00000100:00100000:0.0:1790946246.192229:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946246.192245:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638725376:0@lo:8:kworker.0 00000100:00100000:0.0:1790946246.192270:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946246.192563:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790946246.192574:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+22:3647:x1877942638724864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946246.192623:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+22:3647:x1877942638724864:12345-0@lo:400:kworker.0 Request processed in 53us (10120us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946246.192631:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790946246.192800:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638725632:0@lo:400:kworker.0 00000100:00100000:2.0:1790946246.192834:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946246.192856:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790946246.192863:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638725504:0@lo:400:kworker.0 00000100:00100000:2.0:1790946246.192886:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946246.192901:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638726016:0@lo:400:kworker.0 00000100:00100000:2.0:1790946246.192925:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946246.193272:0:24234:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638724992 00000100:00100000:1.0:1790946246.193281:0:24234:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638724992 00000100:00100000:1.0:1790946246.193311:0:24234:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638725120 00000100:00100000:1.0:1790946246.193313:0:24234:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638725120 00000100:00100000:1.0:1790946246.193320:0:24234:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638725376 00000100:00100000:1.0:1790946246.193322:0:24234:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638725376 00000100:00100000:1.0:1790946246.193330:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790946246.193335:0:24234:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1877942638724992:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1790946246.193363:0:24234:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 697 last 0 00000020:00000080:1.0:1790946246.193410:0:24234:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd9f4181e0d27ee09 00002000:00100000:1.0:1790946246.193424:0:24234:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9d3f8454a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1790946246.193428:0:24234:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1790946246.193430:0:24234:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1790946246.196199:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8312c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3647:1877942638724864:0@lo:400:kworker.0 00000100:00100000:0.0:1790946246.196251:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638725632 00000100:00100000:0.0:1790946246.196259:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638725632 00000100:00100000:0.0:1790946246.196306:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638725504 00000100:00100000:0.0:1790946246.196310:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638725504 00000100:00100000:0.0:1790946246.196322:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638726016 00000100:00100000:0.0:1790946246.196325:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638726016 00000100:00100000:0.0:1790946246.196353:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790946246.196361:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877942638725632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946246.196457:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877942638725632:12345-0@lo:400:kworker.0 Request processed in 96us (3621us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946246.196464:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790946246.196482:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790946246.196488:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638725504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946246.196528:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638725504:12345-0@lo:400:kworker.0 Request processed in 40us (3640us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946246.196533:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790946246.196545:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790946246.196552:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84e24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638726016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946246.196578:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84e24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638726016:12345-0@lo:400:kworker.0 Request processed in 28us (3652us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946246.196584:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1790946246.196606:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790946246.196643:0:24832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790946246.196649:0:24832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1877942638725120:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1790946246.196694:0:24832:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 697 last 0 00000020:00000080:0.0:1790946246.196721:0:24832:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd9f4181e0d27ee10 00002000:00100000:0.0:1790946246.196734:0:24832:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9d3f827e6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1790946246.196739:0:24832:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1790946246.196742:0:24832:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790946246.196916:0:24832:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00010000:00080000:2.0:1790946246.197148:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40812e8000 x1877942638725504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946246.197162:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638725504:0@lo:400:kworker.0 00010000:00080000:2.0:1790946246.197190:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40812e8e00 x1877942638726016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946246.197207:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638726016:0@lo:400:kworker.0 00010000:00080000:2.0:1790946246.197222:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40812ea300 x1877942638725632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946246.197230:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1877942638725632:0@lo:400:kworker.0 00002000:00080000:1.0:1790946246.197432:0:24234:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790946246.197457:0:24234:0:(import.c:65:import_set_state_nolock()) ffff9d3f8454c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790946246.197526:0:24234:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1877942638724992:12345-0@lo:8:kworker.0 Request processed in 4188us (5380us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946246.197535:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790946246.197558:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790946246.197564:0:24234:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8312fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1877942638725376:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1790946246.197583:0:24234:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 697 last 0 00000020:00000080:1.0:1790946246.197602:0:24234:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd9f4181e0d27ee17 00002000:00100000:1.0:1790946246.197610:0:24234:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9d3f8454d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1790946246.197613:0:24234:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1790946246.197616:0:24234:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790946246.197651:0:24234:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1790946246.197665:0:24234:0:(import.c:65:import_set_state_nolock()) ffff9d3f8454b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790946246.198193:0:24234:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8312fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1877942638725376:12345-0@lo:8:kworker.0 Request processed in 144us (5438us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946246.198202:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1790946246.198315:0:24832:0:(import.c:65:import_set_state_nolock()) ffff9d3f827e2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790946246.198353:0:24832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1877942638725120:12345-0@lo:8:kworker.0 Request processed in 1702us (6122us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946246.198360:0:24832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1790946246.199113:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8312f100 x1877942638724992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790946271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946246.199124:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790946246.199132:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1790946246.199140:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790946246.199145:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1790946246.199148:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d4096c61000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790946246.199164:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790946246.199186:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8312f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638724992:0@lo:8:kworker.0 00000004:00080000:2.0:1790946246.199199:0:22748:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790946246.199281:0:22748:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 697015112360ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790946246.199287:0:22748:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:2.0:1790946246.199324:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8312f800 x1877942638725120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790946271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946246.199332:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790946246.199336:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1790946246.199341:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790946246.199343:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1790946246.199346:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d3f81bb0800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790946246.199356:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790946246.199366:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8312f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1877942638725120:0@lo:8:kworker.0 00000004:00080000:2.0:1790946246.199410:0:22751:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1790946246.199429:0:22751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22751:1877942638726272:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1790946246.199472:0:22751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946246.199495:0:22751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcac8900 going to sleep for 11 seconds 00000100:00100000:2.0:1790946246.199506:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638726144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790946246.199529:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790946246.199572:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40812e8a80 x1877942638725376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790946271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790946246.199583:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1790946246.199588:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790946246.199591:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1790946246.199593:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9d40bc9b9000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790946246.199603:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790946246.199607:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1877942638725376:0@lo:8:kworker.0 00000004:00080000:0.0:1790946246.200579:0:22749:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:0.0:1790946246.200599:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8312f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22749:1877942638726528:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1790946246.200639:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946246.200660:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4099661480 going to sleep for 11 seconds 00000004:00080000:0.0:1790946246.200693:0:22750:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790946246.200757:0:22750:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 697016587941ns, next at 0ns, rc = 0 00080000:00080000:0.0:1790946246.200763:0:22750:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1790946246.200806:0:23471:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1790946246.200819:0:23471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5c26a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23471:1877942638726784:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1790946246.200843:0:23471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946246.200857:0:23471:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40996613c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946246.200869:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638726656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790946246.200892:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946246.200912:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790946246.200918:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8312c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638726400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790946246.200951:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946246.200975:0:24832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638726272 00000100:00100000:0.0:1790946246.200981:0:24832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638726272 00000100:00100000:0.0:1790946246.201160:0:24832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638726528 00000100:00100000:0.0:1790946246.201165:0:24832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638726528 00000100:00100000:0.0:1790946246.201212:0:24832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638726784 00000100:00100000:0.0:1790946246.201215:0:24832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638726784 00000100:00100000:0.0:1790946246.201229:0:24832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790946246.201236:0:24832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22751:x1877942638726272:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:0.0:1790946246.201929:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790946246.201934:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790946246.201949:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790946246.201958:0:24233:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8312f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22749:x1877942638726528:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790946246.208259:0:24236:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638726144 00000100:00100000:1.0:1790946246.208279:0:24236:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638726144 00000100:00100000:1.0:1790946246.208333:0:24236:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638726656 00000100:00100000:1.0:1790946246.208337:0:24236:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638726656 00000100:00100000:1.0:1790946246.208350:0:24236:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638726400 00000100:00100000:1.0:1790946246.208352:0:24236:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638726400 00000100:00100000:1.0:1790946246.208376:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790946246.208387:0:24236:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1877942638726144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790946246.208425:0:24236:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1790946246.208545:0:24236:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1877942638726144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (9014us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946246.208553:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790946246.208572:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790946246.208580:0:24236:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1877942638726656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790946246.208590:0:24236:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1790946246.208625:0:24236:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1877942638726656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (7731us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946246.208631:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790946246.208643:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790946246.208650:0:24236:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1877942638726400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790946246.208660:0:24236:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790946246.208694:0:24236:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1877942638726400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (7742us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946246.208722:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1790946246.208748:0:23470:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790946246.208837:0:23470:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 697024668553ns, next at 0ns, rc = 0 00080000:00080000:1.0:1790946246.208844:0:23470:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:1.0:1790946246.208908:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40812ea300 x1877942638726144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946246.208931:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638726144:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1790946246.208978:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8312c380 x1877942638726400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946246.208990:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8312c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638726400:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1790946246.209002:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b5c25880 x1877942638726656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946246.209013:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638726656:0@lo:13:osp-pre-1-1.0 00002000:00080000:0.0:1790946246.210549:0:24233:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1790946246.210565:0:24233:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:0.0:1790946246.210572:0:24233:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00002000:00080000:1.0:1790946246.223974:0:24832:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1790946246.223986:0:24832:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1790946246.223993:0:24832:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00010000:0.0:1790946246.237851:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.237873:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a9ba27d/0xd9f4181e0d27ee1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.237891:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.237897:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.237903:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a9ba27d/0xd9f4181e0d27ee1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.237921:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a9ba27d/0xd9f4181e0d27ee1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.237932:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a9ba27d/0xd9f4181e0d27ee1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.237939:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a9ba27d/0xd9f4181e0d27ee1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.237961:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790946246.238559:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.238566:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d24e564d/0xd9f4181e0d27ee25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.238576:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.238580:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.238584:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d24e564d/0xd9f4181e0d27ee25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.238594:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d24e564d/0xd9f4181e0d27ee25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.238607:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d24e564d/0xd9f4181e0d27ee25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.238615:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d24e564d/0xd9f4181e0d27ee25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.238632:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1790946246.239625:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.239636:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf6b031e/0xd9f4181e0d27ee2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.239647:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.239650:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.239655:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf6b031e/0xd9f4181e0d27ee2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.239666:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf6b031e/0xd9f4181e0d27ee2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.240003:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf6b031e/0xd9f4181e0d27ee2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.240024:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf6b031e/0xd9f4181e0d27ee2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.240071:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1790946246.240464:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.240484:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a4d9b79/0xd9f4181e0d27ee33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.240494:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.240498:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.240503:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a4d9b79/0xd9f4181e0d27ee33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.240514:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a4d9b79/0xd9f4181e0d27ee33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.240523:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a4d9b79/0xd9f4181e0d27ee33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.240531:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a4d9b79/0xd9f4181e0d27ee33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.240543:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1790946246.241228:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.241236:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094b2af7a/0xd9f4181e0d27ee3a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.241245:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.241256:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.241260:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094b2af7a/0xd9f4181e0d27ee3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.241270:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094b2af7a/0xd9f4181e0d27ee3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.241279:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094b2af7a/0xd9f4181e0d27ee3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.241286:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094b2af7a/0xd9f4181e0d27ee3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.241294:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1790946246.241640:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.241647:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5e80877/0xd9f4181e0d27ee41 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.241656:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.241659:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.241663:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5e80877/0xd9f4181e0d27ee41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.241673:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5e80877/0xd9f4181e0d27ee41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.241694:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5e80877/0xd9f4181e0d27ee41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.241717:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5e80877/0xd9f4181e0d27ee41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.241727:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1790946246.241900:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1790946246.241909:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a9ba27d/0xd9f4181e0d27ee1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.241916:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65c00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.241921:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a9ba27d/0xd9f4181e0d27ee1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.241930:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a9ba27d/0xd9f4181e0d27ee1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.241963:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a9ba27d/0xd9f4181e0d27ee1e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.241971:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a9ba27d/0xd9f4181e0d27ee1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.241993:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1790946246.241997:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d24e564d/0xd9f4181e0d27ee25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.242004:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64c00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.242019:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d24e564d/0xd9f4181e0d27ee25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.242027:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d24e564d/0xd9f4181e0d27ee25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.242045:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d24e564d/0xd9f4181e0d27ee25 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.242053:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d24e564d/0xd9f4181e0d27ee25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.242067:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790946246.242070:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf6b031e/0xd9f4181e0d27ee2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.242082:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65a00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.242085:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf6b031e/0xd9f4181e0d27ee2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.242092:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf6b031e/0xd9f4181e0d27ee2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.242102:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf6b031e/0xd9f4181e0d27ee2c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.242109:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf6b031e/0xd9f4181e0d27ee2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.242124:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790946246.242128:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a4d9b79/0xd9f4181e0d27ee33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.242134:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64000 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.242137:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a4d9b79/0xd9f4181e0d27ee33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.242144:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a4d9b79/0xd9f4181e0d27ee33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.242153:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a4d9b79/0xd9f4181e0d27ee33 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.242165:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a4d9b79/0xd9f4181e0d27ee33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.242195:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790946246.242198:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094b2af7a/0xd9f4181e0d27ee3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.242205:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.242208:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094b2af7a/0xd9f4181e0d27ee3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.242215:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094b2af7a/0xd9f4181e0d27ee3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.242225:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094b2af7a/0xd9f4181e0d27ee3a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.242231:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094b2af7a/0xd9f4181e0d27ee3a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.242241:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946246.242243:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5e80877/0xd9f4181e0d27ee41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.242249:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.242257:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5e80877/0xd9f4181e0d27ee41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.242265:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5e80877/0xd9f4181e0d27ee41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.242274:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5e80877/0xd9f4181e0d27ee41 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.242280:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5e80877/0xd9f4181e0d27ee41 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.242292:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.242294:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.242295:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790946246.244435:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.244450:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a795762/0xd9f4181e0d27ee48 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.244467:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.244485:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.244492:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a795762/0xd9f4181e0d27ee48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.244506:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a795762/0xd9f4181e0d27ee48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.244515:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a795762/0xd9f4181e0d27ee48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.244524:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a795762/0xd9f4181e0d27ee48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.244588:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946246.245915:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946246.245927:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a795762/0xd9f4181e0d27ee48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.245939:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65000 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.245944:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a795762/0xd9f4181e0d27ee48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.245955:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a795762/0xd9f4181e0d27ee48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.245973:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a795762/0xd9f4181e0d27ee48 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.245992:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a795762/0xd9f4181e0d27ee48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.246103:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.246105:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.246107:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946246.246398:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946246.246407:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790946246.259999:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946246.260267:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9b655dc/0xd9f4181e0d27ee4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.260287:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1790946246.260292:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946246.260299:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9b655dc/0xd9f4181e0d27ee4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.260313:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9b655dc/0xd9f4181e0d27ee4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.260324:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9b655dc/0xd9f4181e0d27ee4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.260332:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9b655dc/0xd9f4181e0d27ee4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.260410:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1790946246.262495:0:23459:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:1.0:1790946246.262606:0:22704:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1790946246.262621:0:22704:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1790946246.262893:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946246.262904:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9b655dc/0xd9f4181e0d27ee4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.262920:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afd800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790946246.262925:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9b655dc/0xd9f4181e0d27ee4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.262937:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9b655dc/0xd9f4181e0d27ee4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.262958:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9b655dc/0xd9f4181e0d27ee4f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.262967:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9b655dc/0xd9f4181e0d27ee4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.262994:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946246.262996:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946246.262998:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790946246.263416:0:22721:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790946246.263427:0:22721:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d4096c6b800 from 14 10000000:01000000:2.0:1790946246.263431:0:22721:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790946246.263476:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afc000/0xd9f4181e0d27ee56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.263487:0:22721:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4092afc000/0xd9f4181e0d27ee56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.263500:0:22721:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4092afc000/0xd9f4181e0d27ee56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946246.263534:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638726912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790946246.263608:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946246.263656:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcac8180 going to sleep for 11 seconds 00002000:00010000:2.0:1790946246.263756:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946246.263763:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27ee5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.263775:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1790946246.263780:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946246.263785:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27ee5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.263798:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27ee5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.263808:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27ee5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.263827:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27ee5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.263854:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946246.264642:0:22713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946246.264652:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27ee5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.264661:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afc400 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946246.264666:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27ee5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.264691:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27ee5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.264722:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27ee5d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.264730:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27ee5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.264829:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946246.264831:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946246.264833:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946246.265460:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638726912 00000100:00100000:0.0:1790946246.265485:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638726912 00000100:00100000:0.0:1790946246.265555:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790946246.265565:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+22:22721:x1877942638726912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946246.265584:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946246.265596:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27ee6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ee56 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790946246.265600:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946246.265606:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b1a0802/0xd9f4181e0d27ee64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.265620:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1790946246.265624:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946246.265629:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b1a0802/0xd9f4181e0d27ee64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.265635:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27ee6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ee56 expref: 23 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.265643:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b1a0802/0xd9f4181e0d27ee64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.265645:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4086a4c800/0xd9f4181e0d27ee6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ee56 expref: 23 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.265653:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b1a0802/0xd9f4181e0d27ee64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.265653:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4086a4c800, rc 0) 00010000:00010000:1.0:1790946246.265664:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b1a0802/0xd9f4181e0d27ee64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.265680:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790946246.265719:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+23:22721:x1877942638726912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (2112us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946246.265726:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00010000:0.0:1790946246.265757:0:23880:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946246.265763:0:23880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b1a0802/0xd9f4181e0d27ee64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.265770:0:23880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813ffe00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790946246.265775:0:23880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b1a0802/0xd9f4181e0d27ee64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.265783:0:23880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b1a0802/0xd9f4181e0d27ee64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.265797:0:23880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b1a0802/0xd9f4181e0d27ee64 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.265805:0:23880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b1a0802/0xd9f4181e0d27ee64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.265836:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946246.265838:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946246.265840:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946246.266890:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638726912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790946246.266915:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4092afc000/0xd9f4181e0d27ee56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ee6b expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.266925:0:22721:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4092afc000/0xd9f4181e0d27ee56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ee6b expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946246.266994:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638727040:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790946246.267072:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946246.267105:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcac8180 going to sleep for 11 seconds 00000100:00100000:2.0:1790946246.267121:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638727040 00000100:00100000:2.0:1790946246.267126:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638727040 00000100:00100000:2.0:1790946246.267159:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00002000:00010000:1.0:1790946246.267163:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1790946246.267181:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+23:22721:x1877942638727040:12345-0@lo:256:ll_cfg_requeue.0 00010000:00010000:1.0:1790946246.267187:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27ee72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.267198:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=697s v=(0 0) 20000000:01000000:2.0:1790946246.267199:0:22718:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 00010000:00010000:1.0:1790946246.267202:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946246.267206:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27ee72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790946246.267214:0:22718:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790946246.267217:0:22718:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00010000:00010000:1.0:1790946246.267217:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27ee72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.267224:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27ee72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.267231:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27ee72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.267244:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790946246.267288:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+23:22721:x1877942638727040:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946246.267295:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790946246.267330:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638727040:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790946246.267388:0:22721:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790946246.267396:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afc000/0xd9f4181e0d27ee56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ee6b expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.267403:0:22721:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4092afc000/0xd9f4181e0d27ee56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ee6b expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946246.267412:0:22721:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790946246.267415:0:22721:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d3f83705800 from 14 10000000:01000000:2.0:1790946246.267417:0:22721:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790946246.267434:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afd000/0xd9f4181e0d27ee79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.267441:0:22721:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4092afd000/0xd9f4181e0d27ee79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.267449:0:22721:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4092afd000/0xd9f4181e0d27ee79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946246.267463:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638727168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790946246.267487:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946246.267517:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcac8180 going to sleep for 11 seconds 00010000:00010000:0.0:1790946246.267642:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946246.267649:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27ee72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.267657:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813fea00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790946246.267661:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27ee72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.267670:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27ee72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.267686:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27ee72 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.267693:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a7d99fb/0xd9f4181e0d27ee72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.267711:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946246.267714:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946246.267715:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790946246.267767:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.267773:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007369837a/0xd9f4181e0d27ee80 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.267793:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.267796:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.267800:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007369837a/0xd9f4181e0d27ee80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.267809:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007369837a/0xd9f4181e0d27ee80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.267817:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007369837a/0xd9f4181e0d27ee80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.267825:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007369837a/0xd9f4181e0d27ee80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.267839:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790946246.267847:0:22713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946246.267852:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007369837a/0xd9f4181e0d27ee80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.267859:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4d800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790946246.267862:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007369837a/0xd9f4181e0d27ee80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.267869:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007369837a/0xd9f4181e0d27ee80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.267890:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007369837a/0xd9f4181e0d27ee80 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.267896:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007369837a/0xd9f4181e0d27ee80 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.267912:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946246.267914:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946246.267915:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946246.268518:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638727168 00000100:00100000:1.0:1790946246.268525:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638727168 00000100:00100000:1.0:1790946246.268577:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790946246.268585:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+23:22721:x1877942638727168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946246.268596:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946246.268607:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4080031800/0xd9f4181e0d27ee87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27ee79 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.268626:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4080031800/0xd9f4181e0d27ee87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27ee79 expref: 24 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.268636:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4080031800/0xd9f4181e0d27ee87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ee79 expref: 24 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.268643:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080031800, rc 0) 00002000:00010000:0.0:1790946246.268687:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1790946246.268692:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:22721:x1877942638727168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (1203us total) trans 0 rc 0/0 00010000:00010000:0.0:1790946246.268693:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f8140ef/0xd9f4181e0d27ee8e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946246.268698:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00010000:0.0:1790946246.268702:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.268705:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.268709:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f8140ef/0xd9f4181e0d27ee8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.268719:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f8140ef/0xd9f4181e0d27ee8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.268728:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f8140ef/0xd9f4181e0d27ee8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.268736:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f8140ef/0xd9f4181e0d27ee8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.268766:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790946246.268966:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638727168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790946246.268981:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4092afd000/0xd9f4181e0d27ee79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ee87 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.268990:0:22721:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4092afd000/0xd9f4181e0d27ee79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27ee87 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946246.269132:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638727296:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790946246.269198:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946246.269226:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40bcac8180 going to sleep for 11 seconds 00000100:00100000:0.0:1790946246.269432:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638727296 00000100:00100000:0.0:1790946246.269438:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638727296 00000100:00100000:0.0:1790946246.269468:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790946246.269573:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:22721:x1877942638727296:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790946246.269588:0:22717:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 00010000:00010000:1.0:1790946246.269590:0:23880:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946246.269596:0:23880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f8140ef/0xd9f4181e0d27ee8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790946246.269602:0:22717:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 00010000:00010000:1.0:1790946246.269604:0:23880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4d400 already unused, calling callback (ffffffffc0d4cac0) 20000000:01000000:0.0:1790946246.269605:0:22717:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00010000:00010000:1.0:1790946246.269609:0:23880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f8140ef/0xd9f4181e0d27ee8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.269617:0:23880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f8140ef/0xd9f4181e0d27ee8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.269631:0:23880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f8140ef/0xd9f4181e0d27ee8e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.269644:0:23880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f8140ef/0xd9f4181e0d27ee8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.269660:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946246.269662:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946246.269664:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946246.269675:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:22721:x1877942638727296:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946246.269682:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00002000:00010000:0.0:1790946246.269754:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.269760:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c72025c/0xd9f4181e0d27ee95 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.269770:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.269773:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.269777:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c72025c/0xd9f4181e0d27ee95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.269787:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c72025c/0xd9f4181e0d27ee95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.269795:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c72025c/0xd9f4181e0d27ee95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.269814:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c72025c/0xd9f4181e0d27ee95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.270100:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946246.270231:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946246.270236:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c72025c/0xd9f4181e0d27ee95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.270244:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4c600 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946246.270247:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c72025c/0xd9f4181e0d27ee95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.270256:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c72025c/0xd9f4181e0d27ee95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.270269:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c72025c/0xd9f4181e0d27ee95 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.270276:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c72025c/0xd9f4181e0d27ee95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.270290:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946246.270292:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946246.270295:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946246.270328:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638727296:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790946246.270395:0:22721:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790946246.270402:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afd000/0xd9f4181e0d27ee79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ee87 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.270410:0:22721:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4092afd000/0xd9f4181e0d27ee79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27ee87 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790946246.270475:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946246.270482:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27ee9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.270501:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1790946246.270505:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946246.270509:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27ee9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.270520:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27ee9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.270527:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27ee9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790946246.270543:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946246.270545:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27ee9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.270548:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de9e6c8b/0xd9f4181e0d27eea3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.270556:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.270559:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.270563:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de9e6c8b/0xd9f4181e0d27eea3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.270568:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790946246.270572:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de9e6c8b/0xd9f4181e0d27eea3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.270579:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de9e6c8b/0xd9f4181e0d27eea3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.270585:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de9e6c8b/0xd9f4181e0d27eea3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.270600:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790946246.270607:0:23880:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790946246.270611:0:23880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27ee9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.270626:0:23880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afd200 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790946246.270629:0:23880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27ee9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.270637:0:23880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27ee9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.270648:0:23880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27ee9c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.270655:0:23880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27ee9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.270669:0:23880:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946246.270679:0:23880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de9e6c8b/0xd9f4181e0d27eea3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.270689:0:23880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4de00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790946246.270692:0:23880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de9e6c8b/0xd9f4181e0d27eea3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.270699:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946246.270700:0:23880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de9e6c8b/0xd9f4181e0d27eea3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.270719:0:23880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de9e6c8b/0xd9f4181e0d27eea3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.270733:0:23880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de9e6c8b/0xd9f4181e0d27eea3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.270745:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946246.270747:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946246.270759:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790946246.271362:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.271369:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f3a7c95/0xd9f4181e0d27eeaa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.271378:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.271382:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.271386:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f3a7c95/0xd9f4181e0d27eeaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.271394:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f3a7c95/0xd9f4181e0d27eeaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.271402:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f3a7c95/0xd9f4181e0d27eeaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.271409:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f3a7c95/0xd9f4181e0d27eeaa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.271431:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790946246.271469:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946246.271476:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007aabb7ae/0xd9f4181e0d27eeb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.271483:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1790946246.271496:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946246.271500:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007aabb7ae/0xd9f4181e0d27eeb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.271509:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007aabb7ae/0xd9f4181e0d27eeb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.271516:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007aabb7ae/0xd9f4181e0d27eeb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.271523:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007aabb7ae/0xd9f4181e0d27eeb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.271537:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790946246.271545:0:22713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790946246.271550:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f3a7c95/0xd9f4181e0d27eeaa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.271556:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4c400 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946246.271560:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f3a7c95/0xd9f4181e0d27eeaa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.271580:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f3a7c95/0xd9f4181e0d27eeaa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.271594:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f3a7c95/0xd9f4181e0d27eeaa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.271601:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f3a7c95/0xd9f4181e0d27eeaa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.271616:0:22713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946246.271620:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007aabb7ae/0xd9f4181e0d27eeb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.271626:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031400 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946246.271630:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007aabb7ae/0xd9f4181e0d27eeb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.271637:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007aabb7ae/0xd9f4181e0d27eeb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.271647:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007aabb7ae/0xd9f4181e0d27eeb1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.271654:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007aabb7ae/0xd9f4181e0d27eeb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.271681:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946246.271683:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946246.271685:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.271868:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946246.272233:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1790946246.272233:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946246.272239:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e11b6e1/0xd9f4181e0d27eebf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.272243:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090773e7e/0xd9f4181e0d27eeb8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.272249:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.272250:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1790946246.272252:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.272253:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946246.272257:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e11b6e1/0xd9f4181e0d27eebf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.272257:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090773e7e/0xd9f4181e0d27eeb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.272268:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e11b6e1/0xd9f4181e0d27eebf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.272268:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090773e7e/0xd9f4181e0d27eeb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.272278:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e11b6e1/0xd9f4181e0d27eebf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.272278:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090773e7e/0xd9f4181e0d27eeb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.272286:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090773e7e/0xd9f4181e0d27eeb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.272287:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e11b6e1/0xd9f4181e0d27eebf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.272302:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1790946246.272684:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.272691:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023ee331e/0xd9f4181e0d27eec6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.272700:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.272703:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.272714:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023ee331e/0xd9f4181e0d27eec6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.272724:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023ee331e/0xd9f4181e0d27eec6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.272739:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023ee331e/0xd9f4181e0d27eec6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.272745:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790946246.272747:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023ee331e/0xd9f4181e0d27eec6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.272753:0:22713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790946246.272758:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090773e7e/0xd9f4181e0d27eeb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.272770:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790946246.272776:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4d000 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946246.272780:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090773e7e/0xd9f4181e0d27eeb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.272788:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090773e7e/0xd9f4181e0d27eeb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.272801:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090773e7e/0xd9f4181e0d27eeb8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.272808:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090773e7e/0xd9f4181e0d27eeb8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.272822:0:22713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790946246.272826:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e11b6e1/0xd9f4181e0d27eebf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.272832:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030200 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946246.272835:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e11b6e1/0xd9f4181e0d27eebf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.272842:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e11b6e1/0xd9f4181e0d27eebf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.272852:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e11b6e1/0xd9f4181e0d27eebf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.272866:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e11b6e1/0xd9f4181e0d27eebf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.272881:0:22713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946246.272884:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023ee331e/0xd9f4181e0d27eec6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.272890:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4c200 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946246.272893:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023ee331e/0xd9f4181e0d27eec6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.272901:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023ee331e/0xd9f4181e0d27eec6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.272911:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023ee331e/0xd9f4181e0d27eec6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.272918:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023ee331e/0xd9f4181e0d27eec6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.272928:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946246.272930:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946246.272931:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.273137:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.273197:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946246.273286:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946246.273292:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000942bd168/0xd9f4181e0d27eecd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.273306:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1790946246.273309:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946246.273312:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000942bd168/0xd9f4181e0d27eecd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.273321:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000942bd168/0xd9f4181e0d27eecd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.273328:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000942bd168/0xd9f4181e0d27eecd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.273336:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000942bd168/0xd9f4181e0d27eecd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.273360:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946246.273418:0:22713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946246.273424:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000942bd168/0xd9f4181e0d27eecd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.273431:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031600 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.273435:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000942bd168/0xd9f4181e0d27eecd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.273443:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000942bd168/0xd9f4181e0d27eecd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.273456:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000942bd168/0xd9f4181e0d27eecd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.273463:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000942bd168/0xd9f4181e0d27eecd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.273479:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.273486:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.273500:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790946246.273647:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.273653:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011aa29a/0xd9f4181e0d27eed4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.273661:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.273664:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.273667:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000011aa29a/0xd9f4181e0d27eed4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.273682:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000011aa29a/0xd9f4181e0d27eed4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.273689:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011aa29a/0xd9f4181e0d27eed4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.273696:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000011aa29a/0xd9f4181e0d27eed4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.273734:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790946246.274346:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.274359:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000541844e0/0xd9f4181e0d27eedb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.274369:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.274373:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.274377:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000541844e0/0xd9f4181e0d27eedb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.274387:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000541844e0/0xd9f4181e0d27eedb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.274396:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000541844e0/0xd9f4181e0d27eedb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.274405:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000541844e0/0xd9f4181e0d27eedb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.274417:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1790946246.274884:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.274891:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087760eb3/0xd9f4181e0d27eee2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.274900:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.274906:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.274911:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087760eb3/0xd9f4181e0d27eee2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.274920:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087760eb3/0xd9f4181e0d27eee2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.274928:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087760eb3/0xd9f4181e0d27eee2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.274936:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087760eb3/0xd9f4181e0d27eee2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.274947:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1790946246.275215:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.275221:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a30b60ed/0xd9f4181e0d27eee9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.275229:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.275231:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.275235:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a30b60ed/0xd9f4181e0d27eee9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.275243:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a30b60ed/0xd9f4181e0d27eee9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.275250:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a30b60ed/0xd9f4181e0d27eee9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.275262:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a30b60ed/0xd9f4181e0d27eee9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.275269:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1790946246.275602:0:23880:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790946246.275611:0:23880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000011aa29a/0xd9f4181e0d27eed4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.275618:0:23880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4d600 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.275623:0:23880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000011aa29a/0xd9f4181e0d27eed4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.275632:0:23880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000011aa29a/0xd9f4181e0d27eed4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.275648:0:23880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000011aa29a/0xd9f4181e0d27eed4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.275655:0:23880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000011aa29a/0xd9f4181e0d27eed4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.275673:0:23880:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790946246.275677:0:23880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000541844e0/0xd9f4181e0d27eedb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.275683:0:23880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4ce00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.275686:0:23880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000541844e0/0xd9f4181e0d27eedb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.275706:0:23880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000541844e0/0xd9f4181e0d27eedb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.275717:0:23880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000541844e0/0xd9f4181e0d27eedb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.276250:0:23880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000541844e0/0xd9f4181e0d27eedb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.276270:0:23880:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790946246.276274:0:23880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087760eb3/0xd9f4181e0d27eee2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.276281:0:23880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4dc00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.276285:0:23880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087760eb3/0xd9f4181e0d27eee2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.276292:0:23880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087760eb3/0xd9f4181e0d27eee2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.276304:0:23880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087760eb3/0xd9f4181e0d27eee2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.276310:0:23880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087760eb3/0xd9f4181e0d27eee2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.276336:0:23880:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946246.276340:0:23880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a30b60ed/0xd9f4181e0d27eee9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.276346:0:23880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4da00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.276349:0:23880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a30b60ed/0xd9f4181e0d27eee9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.276357:0:23880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a30b60ed/0xd9f4181e0d27eee9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.276366:0:23880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a30b60ed/0xd9f4181e0d27eee9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.276373:0:23880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a30b60ed/0xd9f4181e0d27eee9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.276384:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.276386:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.276388:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.276397:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.276402:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790946246.277668:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.277679:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df3e836e/0xd9f4181e0d27eef0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.277695:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.277699:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.277704:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df3e836e/0xd9f4181e0d27eef0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.277717:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df3e836e/0xd9f4181e0d27eef0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.277726:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df3e836e/0xd9f4181e0d27eef0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.277733:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df3e836e/0xd9f4181e0d27eef0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.277757:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946246.277859:0:23880:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946246.277866:0:23880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df3e836e/0xd9f4181e0d27eef0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.277887:0:23880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4c000 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.277891:0:23880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df3e836e/0xd9f4181e0d27eef0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.277899:0:23880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df3e836e/0xd9f4181e0d27eef0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.277912:0:23880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df3e836e/0xd9f4181e0d27eef0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.277919:0:23880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df3e836e/0xd9f4181e0d27eef0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.277936:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.277937:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.277939:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790946246.279263:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.279276:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5d01de2/0xd9f4181e0d27eef7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.279303:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.279307:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.279313:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5d01de2/0xd9f4181e0d27eef7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.279324:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5d01de2/0xd9f4181e0d27eef7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.279333:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5d01de2/0xd9f4181e0d27eef7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.279340:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5d01de2/0xd9f4181e0d27eef7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.279363:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946246.279495:0:22713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946246.279502:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5d01de2/0xd9f4181e0d27eef7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.279510:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4ca00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.279515:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5d01de2/0xd9f4181e0d27eef7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.279525:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5d01de2/0xd9f4181e0d27eef7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.279547:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5d01de2/0xd9f4181e0d27eef7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.279555:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5d01de2/0xd9f4181e0d27eef7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.279575:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.279576:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.279578:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790946246.281118:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.281132:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045d3d9ee/0xd9f4181e0d27eefe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.281147:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.281151:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.281156:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045d3d9ee/0xd9f4181e0d27eefe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.281186:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045d3d9ee/0xd9f4181e0d27eefe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.281214:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045d3d9ee/0xd9f4181e0d27eefe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.281221:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045d3d9ee/0xd9f4181e0d27eefe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.281237:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946246.281251:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946246.281257:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045d3d9ee/0xd9f4181e0d27eefe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.281265:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4cc00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.281269:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045d3d9ee/0xd9f4181e0d27eefe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.281278:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045d3d9ee/0xd9f4181e0d27eefe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.281294:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045d3d9ee/0xd9f4181e0d27eefe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.281301:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045d3d9ee/0xd9f4181e0d27eefe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.281333:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.281335:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.281337:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790946246.284406:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946246.284421:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d261f598/0xd9f4181e0d27ef05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.284439:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1790946246.284443:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946246.284448:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d261f598/0xd9f4181e0d27ef05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.284462:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d261f598/0xd9f4181e0d27ef05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.284472:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d261f598/0xd9f4181e0d27ef05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.284480:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d261f598/0xd9f4181e0d27ef05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.284517:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790946246.284871:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946246.284878:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27ef0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.284887:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1790946246.284891:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946246.284894:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27ef0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.284905:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27ef0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.284925:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27ef0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.284932:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27ef0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.284957:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790946246.285325:0:22713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790946246.285332:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d261f598/0xd9f4181e0d27ef05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.285352:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afce00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.285357:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d261f598/0xd9f4181e0d27ef05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.285366:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d261f598/0xd9f4181e0d27ef05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.285382:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d261f598/0xd9f4181e0d27ef05 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.285390:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d261f598/0xd9f4181e0d27ef05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.285409:0:22713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946246.285413:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27ef0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.285419:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.285422:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27ef0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.285430:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27ef0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.285441:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27ef0c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.285464:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27ef0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.285483:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.285485:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.285494:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946246.285666:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946246.285886:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946246.285892:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037fd6a81/0xd9f4181e0d27ef13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.285901:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1790946246.285904:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946246.285908:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037fd6a81/0xd9f4181e0d27ef13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.285917:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037fd6a81/0xd9f4181e0d27ef13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.285925:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037fd6a81/0xd9f4181e0d27ef13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.285932:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037fd6a81/0xd9f4181e0d27ef13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.285952:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946246.286144:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946246.286150:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037fd6a81/0xd9f4181e0d27ef13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.286159:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030c00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.286163:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037fd6a81/0xd9f4181e0d27ef13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.286201:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037fd6a81/0xd9f4181e0d27ef13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.286213:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037fd6a81/0xd9f4181e0d27ef13 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.286221:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037fd6a81/0xd9f4181e0d27ef13 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.286236:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.286238:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.286239:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946246.286288:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946246.286293:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb9e8e10/0xd9f4181e0d27ef1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.286302:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1790946246.286305:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946246.286309:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb9e8e10/0xd9f4181e0d27ef1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.286319:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb9e8e10/0xd9f4181e0d27ef1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.286327:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb9e8e10/0xd9f4181e0d27ef1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.286334:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb9e8e10/0xd9f4181e0d27ef1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.286353:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946246.286732:0:22713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946246.286737:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb9e8e10/0xd9f4181e0d27ef1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.286746:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030400 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.286750:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb9e8e10/0xd9f4181e0d27ef1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.286758:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb9e8e10/0xd9f4181e0d27ef1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.286772:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb9e8e10/0xd9f4181e0d27ef1a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.286779:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb9e8e10/0xd9f4181e0d27ef1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.286794:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.286795:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.286797:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946246.286899:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946246.286905:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6e5e74d/0xd9f4181e0d27ef21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.286913:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=697s v=(0 0) 00002000:00010000:0.0:1790946246.286918:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946246.286922:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.286923:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad4b8332/0xd9f4181e0d27ef28 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.286926:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6e5e74d/0xd9f4181e0d27ef21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.286931:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.286934:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946246.286937:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6e5e74d/0xd9f4181e0d27ef21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.286938:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad4b8332/0xd9f4181e0d27ef28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.286945:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6e5e74d/0xd9f4181e0d27ef21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.286947:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad4b8332/0xd9f4181e0d27ef28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.286954:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6e5e74d/0xd9f4181e0d27ef21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.286956:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad4b8332/0xd9f4181e0d27ef28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.286963:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad4b8332/0xd9f4181e0d27ef28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.286977:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790946246.286986:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790946246.287208:0:23880:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790946246.287214:0:23880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6e5e74d/0xd9f4181e0d27ef21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.287222:0:23880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031e00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.287226:0:23880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6e5e74d/0xd9f4181e0d27ef21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.287245:0:23880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6e5e74d/0xd9f4181e0d27ef21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.287257:0:23880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6e5e74d/0xd9f4181e0d27ef21 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.287264:0:23880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6e5e74d/0xd9f4181e0d27ef21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.287280:0:23880:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946246.287283:0:23880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad4b8332/0xd9f4181e0d27ef28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.287289:0:23880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4086a4d200 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.287292:0:23880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad4b8332/0xd9f4181e0d27ef28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.287298:0:23880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad4b8332/0xd9f4181e0d27ef28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.287307:0:23880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad4b8332/0xd9f4181e0d27ef28 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.287313:0:23880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad4b8332/0xd9f4181e0d27ef28 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.287338:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.287340:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.287342:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.287348:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946246.287395:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946246.287400:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27ef2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.287409:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1790946246.287412:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946246.287415:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27ef2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.287424:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27ef2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.287432:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27ef2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790946246.287439:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946246.287445:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27ef2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.287445:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fb77916/0xd9f4181e0d27ef36 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.287453:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.287456:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.287460:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fb77916/0xd9f4181e0d27ef36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.287469:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fb77916/0xd9f4181e0d27ef36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.287475:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790946246.287477:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fb77916/0xd9f4181e0d27ef36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.287495:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fb77916/0xd9f4181e0d27ef36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.287507:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790946246.287602:0:23880:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790946246.287607:0:23880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27ef2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.287614:0:23880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030a00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.287618:0:23880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27ef2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.287625:0:23880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27ef2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.287635:0:23880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27ef2f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.287642:0:23880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6f1c9eb/0xd9f4181e0d27ef2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.287657:0:23880:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946246.287660:0:23880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fb77916/0xd9f4181e0d27ef36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.287667:0:23880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630be00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.287683:0:23880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fb77916/0xd9f4181e0d27ef36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.287691:0:23880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fb77916/0xd9f4181e0d27ef36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.287701:0:23880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fb77916/0xd9f4181e0d27ef36 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.287708:0:23880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fb77916/0xd9f4181e0d27ef36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.287723:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.287724:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.287726:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.287732:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946246.289996:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946246.290010:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e11b6e1/0xd9f4181e0d27ef3d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.290045:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1790946246.290050:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946246.290055:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e11b6e1/0xd9f4181e0d27ef3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.290067:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e11b6e1/0xd9f4181e0d27ef3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.290076:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e11b6e1/0xd9f4181e0d27ef3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.290083:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e11b6e1/0xd9f4181e0d27ef3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790946246.290221:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.290228:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.290237:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.290245:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.290250:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.290260:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.290268:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.290275:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.290317:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1790946246.293392:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946246.293408:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aabb7ae/0xd9f4181e0d27ef4b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.293442:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1790946246.293448:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946246.293455:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aabb7ae/0xd9f4181e0d27ef4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.293469:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007aabb7ae/0xd9f4181e0d27ef4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.293478:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aabb7ae/0xd9f4181e0d27ef4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.293486:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007aabb7ae/0xd9f4181e0d27ef4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.295648:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790946246.295667:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e11b6e1/0xd9f4181e0d27ef3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.295681:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030200 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946246.295686:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e11b6e1/0xd9f4181e0d27ef3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.295698:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e11b6e1/0xd9f4181e0d27ef3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.295725:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e11b6e1/0xd9f4181e0d27ef3d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.295733:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e11b6e1/0xd9f4181e0d27ef3d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.295783:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790946246.295788:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.295796:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630b800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946246.295799:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.295806:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.295818:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef44 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.295827:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946246.295831:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007aabb7ae/0xd9f4181e0d27ef4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.295837:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031400 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946246.295839:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007aabb7ae/0xd9f4181e0d27ef4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.295846:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007aabb7ae/0xd9f4181e0d27ef4b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.295866:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007aabb7ae/0xd9f4181e0d27ef4b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.295874:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946246.295875:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946246.295877:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946246.297741:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790946246.297767:0:24832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790946246.298420:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.298430:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa003bc4/0xd9f4181e0d27ef52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.298446:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.298451:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.298457:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa003bc4/0xd9f4181e0d27ef52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.298470:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa003bc4/0xd9f4181e0d27ef52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.298663:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa003bc4/0xd9f4181e0d27ef52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.298735:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa003bc4/0xd9f4181e0d27ef52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.298763:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790946246.298781:0:22713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946246.298797:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa003bc4/0xd9f4181e0d27ef52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.298804:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630b000 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:0.0:1790946246.298808:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa003bc4/0xd9f4181e0d27ef52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.298817:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa003bc4/0xd9f4181e0d27ef52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.298832:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa003bc4/0xd9f4181e0d27ef52 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.298838:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa003bc4/0xd9f4181e0d27ef52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.298855:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946246.298862:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946246.298864:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790946246.299742:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.299752:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006208d802/0xd9f4181e0d27ef59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.299999:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1790946246.300275:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946246.301247:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.301260:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006208d802/0xd9f4181e0d27ef59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.301278:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006208d802/0xd9f4181e0d27ef59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.301290:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006208d802/0xd9f4181e0d27ef59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.301297:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006208d802/0xd9f4181e0d27ef59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.301316:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946246.301782:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946246.301792:0:24233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007aabb7ae/0xd9f4181e0d27ef4b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.301976:0:22713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946246.301983:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006208d802/0xd9f4181e0d27ef59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.301992:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630a800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.301997:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006208d802/0xd9f4181e0d27ef59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.302007:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006208d802/0xd9f4181e0d27ef59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.302043:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006208d802/0xd9f4181e0d27ef59 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.302057:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006208d802/0xd9f4181e0d27ef59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.302073:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.302075:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.302077:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.302225:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946246.302253:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946246.302259:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27ef60 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.302269:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1790946246.302273:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946246.302277:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27ef60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.302296:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27ef60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.302304:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27ef60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.302311:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27ef60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.302333:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946246.303156:0:23880:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1790946246.303162:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946246.303164:0:23880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27ef60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.303186:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008527980b/0xd9f4181e0d27ef67 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.303191:0:23880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.303195:0:23880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27ef60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.303196:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.303200:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.303204:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008527980b/0xd9f4181e0d27ef67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.303205:0:23880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27ef60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.303220:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008527980b/0xd9f4181e0d27ef67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.303223:0:23880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27ef60 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.303230:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008527980b/0xd9f4181e0d27ef67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.303232:0:23880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012d65554/0xd9f4181e0d27ef60 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.303238:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008527980b/0xd9f4181e0d27ef67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.303251:0:23880:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946246.303254:0:23880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008527980b/0xd9f4181e0d27ef67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.303256:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790946246.303265:0:23880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630a400 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.303268:0:23880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008527980b/0xd9f4181e0d27ef67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.303275:0:23880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008527980b/0xd9f4181e0d27ef67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.303285:0:23880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008527980b/0xd9f4181e0d27ef67 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.303292:0:23880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008527980b/0xd9f4181e0d27ef67 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.303304:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.303306:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.303308:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946246.303579:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790946246.304272:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.304281:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa003bc4/0xd9f4181e0d27ef6e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.304293:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.304296:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.304301:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa003bc4/0xd9f4181e0d27ef6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.304312:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa003bc4/0xd9f4181e0d27ef6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.304320:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa003bc4/0xd9f4181e0d27ef6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.304339:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa003bc4/0xd9f4181e0d27ef6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.304400:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790946246.304849:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946246.304857:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000942bd168/0xd9f4181e0d27ef75 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.304866:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1790946246.304870:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946246.304873:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000942bd168/0xd9f4181e0d27ef75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.304882:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000942bd168/0xd9f4181e0d27ef75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.304889:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000942bd168/0xd9f4181e0d27ef75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.304908:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000942bd168/0xd9f4181e0d27ef75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790946246.307382:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.307396:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.307413:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.307417:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.307423:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.307435:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.307443:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.307451:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.307554:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790946246.307562:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa003bc4/0xd9f4181e0d27ef6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.307570:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630b000 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946246.307574:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa003bc4/0xd9f4181e0d27ef6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.307583:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa003bc4/0xd9f4181e0d27ef6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.307602:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa003bc4/0xd9f4181e0d27ef6e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.307609:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa003bc4/0xd9f4181e0d27ef6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.307630:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790946246.307635:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000942bd168/0xd9f4181e0d27ef75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.307652:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031600 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946246.307655:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000942bd168/0xd9f4181e0d27ef75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.307662:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000942bd168/0xd9f4181e0d27ef75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.307685:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000942bd168/0xd9f4181e0d27ef75 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.307695:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946246.307698:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.307704:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630b800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946246.307707:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.307714:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.307722:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef7c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.307729:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946246.307737:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946246.307739:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946246.311465:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790946246.311481:0:24832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000942bd168/0xd9f4181e0d27ef75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.312291:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946246.312449:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946246.312458:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007aabb7ae/0xd9f4181e0d27ef83 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.312474:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1790946246.312478:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946246.312485:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007aabb7ae/0xd9f4181e0d27ef83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.312499:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007aabb7ae/0xd9f4181e0d27ef83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.312514:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007aabb7ae/0xd9f4181e0d27ef83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.312523:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007aabb7ae/0xd9f4181e0d27ef83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.312557:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790946246.312953:0:22713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946246.312960:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007aabb7ae/0xd9f4181e0d27ef83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.312968:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031400 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946246.312972:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007aabb7ae/0xd9f4181e0d27ef83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.312981:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007aabb7ae/0xd9f4181e0d27ef83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.312997:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007aabb7ae/0xd9f4181e0d27ef83 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.313003:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007aabb7ae/0xd9f4181e0d27ef83 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.313022:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946246.313024:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946246.313026:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946246.313107:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790946246.313113:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e11b6e1/0xd9f4181e0d27ef8a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.313121:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1790946246.313125:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946246.313129:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e11b6e1/0xd9f4181e0d27ef8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.313139:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e11b6e1/0xd9f4181e0d27ef8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.313147:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e11b6e1/0xd9f4181e0d27ef8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.313154:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e11b6e1/0xd9f4181e0d27ef8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.313207:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790946246.313297:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790946246.313304:0:24233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.313472:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946246.313477:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e11b6e1/0xd9f4181e0d27ef8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.313485:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030200 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946246.313494:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e11b6e1/0xd9f4181e0d27ef8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.313502:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e11b6e1/0xd9f4181e0d27ef8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.313513:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e11b6e1/0xd9f4181e0d27ef8a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.313519:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e11b6e1/0xd9f4181e0d27ef8a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.313533:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946246.313535:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946246.313536:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.313677:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790946246.315280:0:24233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.315291:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032c69eed/0xd9f4181e0d27ef91 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.315305:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.315309:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.315314:0:24233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032c69eed/0xd9f4181e0d27ef91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.315325:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032c69eed/0xd9f4181e0d27ef91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.315334:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032c69eed/0xd9f4181e0d27ef91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.315342:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032c69eed/0xd9f4181e0d27ef91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.315356:0:24233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1790946246.315631:0:24233:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00010000:00010000:3.0:1790946246.315645:0:22713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946246.315650:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032c69eed/0xd9f4181e0d27ef91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.315658:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630aa00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946246.315662:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032c69eed/0xd9f4181e0d27ef91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.315681:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032c69eed/0xd9f4181e0d27ef91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.315696:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032c69eed/0xd9f4181e0d27ef91 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.315710:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032c69eed/0xd9f4181e0d27ef91 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946246.315725:0:24233:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8312f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22749:x1877942638726528:12345-0@lo:5:osp-pre-0-0.0 Request processed in 113766us (115082us total) trans 0 rc 0/0 00010000:00010000:3.0:1790946246.315730:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946246.315731:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946246.315733:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946246.315735:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790946246.315791:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8312f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22749:1877942638726528:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1790946246.315808:0:22749:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:0.0:1790946246.315862:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5c24000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22749:1877942638727424:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1790946246.315897:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946246.315932:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40854c9000 going to sleep for 11 seconds 00000100:00100000:0.0:1790946246.315946:0:24233:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638727424 00000100:00100000:0.0:1790946246.315952:0:24233:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638727424 00000100:00100000:0.0:1790946246.315987:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790946246.315996:0:24234:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1790946246.315996:0:24233:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23471:x1877942638726784:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1790946246.316002:0:24234:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1790946246.316259:0:25123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790946246.316417:0:25123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:22749:x1877942638727424:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1790946246.316451:0:25123:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00002000:00010000:0.0:1790946246.323102:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.323115:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef98 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.323133:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.323138:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.323145:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.323193:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.323204:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.323212:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.323230:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790946246.323284:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946246.323293:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.323301:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630b800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946246.323305:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.323314:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.323331:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef98 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.323339:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c59658d8/0xd9f4181e0d27ef98 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.323361:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946246.323363:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946246.323365:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1790946246.323939:0:24233:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1790946246.323946:0:24233:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1790946246.324059:0:24233:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23471:x1877942638726784:12345-0@lo:7:osp-pre-1-1.0 Request processed in 8060us (123210us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946246.324069:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790946246.324313:0:23471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5c26a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23471:1877942638726784:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1790946246.324329:0:23471:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1790946246.324369:0:23471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23471:1877942638727552:0@lo:5:osp-pre-1-1.0 00002000:00010000:0.0:1790946246.324371:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.324377:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e42bc127/0xd9f4181e0d27ef9f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.324387:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.324391:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.324396:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e42bc127/0xd9f4181e0d27ef9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946246.324404:0:23471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790946246.324407:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e42bc127/0xd9f4181e0d27ef9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.324415:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e42bc127/0xd9f4181e0d27ef9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.324422:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e42bc127/0xd9f4181e0d27ef9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946246.324426:0:23471:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40996613c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790946246.324433:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790946246.324449:0:24234:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638727552 00000100:00100000:3.0:1790946246.324455:0:24234:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638727552 00000100:00100000:3.0:1790946246.324497:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790946246.324506:0:24234:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23471:x1877942638727552:12345-0@lo:5:osp-pre-1-1.0 00010000:00010000:2.0:1790946246.324540:0:23880:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00080000:3.0:1790946246.324543:0:24234:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00010000:00010000:2.0:1790946246.324545:0:23880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e42bc127/0xd9f4181e0d27ef9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.324566:0:23880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630b400 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.324570:0:23880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e42bc127/0xd9f4181e0d27ef9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946246.324574:0:24234:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23471:x1877942638727552:12345-0@lo:5:osp-pre-1-1.0 Request processed in 70us (169us total) trans 0 rc 0/0 00010000:00010000:2.0:1790946246.324580:0:23880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e42bc127/0xd9f4181e0d27ef9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.324594:0:23880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e42bc127/0xd9f4181e0d27ef9f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.324601:0:23880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e42bc127/0xd9f4181e0d27ef9f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.324617:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.324618:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.324620:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790946246.324913:0:24229:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:2.0:1790946246.324976:0:24229:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1790946246.325238:0:25123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:22749:x1877942638727424:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8970us (9339us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1790946246.325247:0:25123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790946246.325338:0:22749:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1790946246.325345:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5c24000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22749:1877942638727424:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1790946246.325360:0:22749:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00002000:00010000:0.0:1790946246.325599:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.325606:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb9ed1b3/0xd9f4181e0d27efa6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.325617:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.325629:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.325634:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb9ed1b3/0xd9f4181e0d27efa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.325646:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb9ed1b3/0xd9f4181e0d27efa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.325655:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb9ed1b3/0xd9f4181e0d27efa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.325661:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb9ed1b3/0xd9f4181e0d27efa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.325739:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946246.326000:0:22713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946246.326006:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb9ed1b3/0xd9f4181e0d27efa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.326026:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630b600 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.326030:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb9ed1b3/0xd9f4181e0d27efa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.326050:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb9ed1b3/0xd9f4181e0d27efa6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.326066:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb9ed1b3/0xd9f4181e0d27efa6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.326072:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb9ed1b3/0xd9f4181e0d27efa6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.326090:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.326091:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.326093:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790946246.326194:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790946246.326200:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4f96949/0xd9f4181e0d27efad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.326208:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1790946246.326212:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946246.326216:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4f96949/0xd9f4181e0d27efad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.326224:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4f96949/0xd9f4181e0d27efad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.326230:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4f96949/0xd9f4181e0d27efad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.326244:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4f96949/0xd9f4181e0d27efad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946246.326259:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946246.326422:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946246.326427:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4f96949/0xd9f4181e0d27efad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.326435:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630ac00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.326438:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4f96949/0xd9f4181e0d27efad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.326447:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4f96949/0xd9f4181e0d27efad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.326466:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4f96949/0xd9f4181e0d27efad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.326472:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4f96949/0xd9f4181e0d27efad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.326485:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.326487:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.326489:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790946246.326771:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946246.326778:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d261f598/0xd9f4181e0d27efb4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.326786:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1790946246.326790:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946246.326794:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d261f598/0xd9f4181e0d27efb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.326803:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d261f598/0xd9f4181e0d27efb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.326812:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d261f598/0xd9f4181e0d27efb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.326819:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d261f598/0xd9f4181e0d27efb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.326844:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946246.326852:0:23880:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946246.326857:0:23880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d261f598/0xd9f4181e0d27efb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.326864:0:23880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afce00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.326868:0:23880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d261f598/0xd9f4181e0d27efb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.326876:0:23880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d261f598/0xd9f4181e0d27efb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.326887:0:23880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d261f598/0xd9f4181e0d27efb4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.326894:0:23880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d261f598/0xd9f4181e0d27efb4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.326907:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.326908:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.326910:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946246.327297:0:23471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23471:1877942638727552:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1790946246.327312:0:23471:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1790946246.327355:0:23471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23471:1877942638727680:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1790946246.327422:0:23471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946246.327495:0:23471:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4090cc2900 going to sleep for 11 seconds 00002000:00010000:2.0:1790946246.327543:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946246.327549:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d6ea928/0xd9f4181e0d27efbb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.327558:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1790946246.327562:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946246.327567:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d6ea928/0xd9f4181e0d27efbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.327577:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d6ea928/0xd9f4181e0d27efbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.327586:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d6ea928/0xd9f4181e0d27efbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.327593:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d6ea928/0xd9f4181e0d27efbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.327608:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946246.327615:0:22713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946246.327620:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d6ea928/0xd9f4181e0d27efbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.327627:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afc800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.327630:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d6ea928/0xd9f4181e0d27efbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.327645:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d6ea928/0xd9f4181e0d27efbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.327658:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d6ea928/0xd9f4181e0d27efbb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.327665:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d6ea928/0xd9f4181e0d27efbb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.327693:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.327695:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.327696:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790946246.328045:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946246.328051:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27efc2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328059:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1790946246.328063:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946246.328066:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27efc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328075:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27efc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328083:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27efc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328097:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27efc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328111:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946246.328119:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946246.328123:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27efc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328129:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afc400 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.328133:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27efc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328140:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27efc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328153:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27efc2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328159:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce0b49eb/0xd9f4181e0d27efc2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328200:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.328201:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.328203:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790946246.328479:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946246.328493:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27efc9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328501:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1790946246.328504:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946246.328508:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27efc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328518:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27efc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328526:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27efc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328532:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27efc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328546:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946246.328554:0:23880:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946246.328558:0:23880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27efc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328566:0:23880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afd200 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.328570:0:23880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27efc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328578:0:23880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27efc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328597:0:23880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27efc9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328604:0:23880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081ca4e47/0xd9f4181e0d27efc9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328617:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.328619:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.328621:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790946246.328916:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946246.328922:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9b655dc/0xd9f4181e0d27efd0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328930:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1790946246.328933:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946246.328937:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9b655dc/0xd9f4181e0d27efd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328945:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9b655dc/0xd9f4181e0d27efd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328952:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9b655dc/0xd9f4181e0d27efd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328959:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9b655dc/0xd9f4181e0d27efd0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328982:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946246.328989:0:22713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946246.328993:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9b655dc/0xd9f4181e0d27efd0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.328999:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afd800 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.329002:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9b655dc/0xd9f4181e0d27efd0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.329009:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9b655dc/0xd9f4181e0d27efd0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.329019:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9b655dc/0xd9f4181e0d27efd0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.329027:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9b655dc/0xd9f4181e0d27efd0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.329048:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.329049:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.329051:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790946246.329379:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946246.329385:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef242e9c/0xd9f4181e0d27efd7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.329394:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1790946246.329404:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946246.329408:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef242e9c/0xd9f4181e0d27efd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.329417:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef242e9c/0xd9f4181e0d27efd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.329425:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef242e9c/0xd9f4181e0d27efd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.329431:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef242e9c/0xd9f4181e0d27efd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.329445:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946246.329452:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946246.329456:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef242e9c/0xd9f4181e0d27efd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.329463:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afc600 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.329466:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef242e9c/0xd9f4181e0d27efd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.329474:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef242e9c/0xd9f4181e0d27efd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.329485:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef242e9c/0xd9f4181e0d27efd7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.329507:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef242e9c/0xd9f4181e0d27efd7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.329522:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.329524:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.329525:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790946246.329795:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946246.329802:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a6454a0/0xd9f4181e0d27efde lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.329810:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1790946246.329813:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946246.329817:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a6454a0/0xd9f4181e0d27efde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.329827:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a6454a0/0xd9f4181e0d27efde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.329835:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a6454a0/0xd9f4181e0d27efde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.329843:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a6454a0/0xd9f4181e0d27efde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.329857:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946246.329864:0:23880:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946246.329874:0:23880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a6454a0/0xd9f4181e0d27efde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.329881:0:23880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afde00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946246.329884:0:23880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a6454a0/0xd9f4181e0d27efde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.329891:0:23880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a6454a0/0xd9f4181e0d27efde lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.329901:0:23880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a6454a0/0xd9f4181e0d27efde lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.329908:0:23880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a6454a0/0xd9f4181e0d27efde lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.329921:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.329923:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946246.329924:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790946246.330225:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790946246.330231:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc7c984/0xd9f4181e0d27efe5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.330239:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1790946246.330242:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946246.330246:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc7c984/0xd9f4181e0d27efe5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.330265:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acc7c984/0xd9f4181e0d27efe5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.330274:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc7c984/0xd9f4181e0d27efe5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.330281:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acc7c984/0xd9f4181e0d27efe5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946246.330302:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946246.330325:0:22713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946246.330331:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acc7c984/0xd9f4181e0d27efe5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.330338:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afca00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946246.330347:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc7c984/0xd9f4181e0d27efe5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.330355:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc7c984/0xd9f4181e0d27efe5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.330367:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acc7c984/0xd9f4181e0d27efe5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.330374:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acc7c984/0xd9f4181e0d27efe5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.330389:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946246.330391:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946246.330393:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946246.330446:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790946246.330533:0:24234:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638727680 00000100:00100000:2.0:1790946246.330543:0:24234:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638727680 00002000:00010000:3.0:1790946246.330565:0:24832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790946246.330571:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bf5599c/0xd9f4181e0d27efec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.330579:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1790946246.330582:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946246.330585:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bf5599c/0xd9f4181e0d27efec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.330594:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bf5599c/0xd9f4181e0d27efec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.330609:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bf5599c/0xd9f4181e0d27efec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946246.330617:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bf5599c/0xd9f4181e0d27efec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946246.330630:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1790946246.330639:0:24832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1790946246.330672:0:24832:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:0.0:1790946246.330802:0:24233:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23471:x1877942638727680:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1790946246.330848:0:24233:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00010000:00010000:1.0:1790946246.330960:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946246.330965:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bf5599c/0xd9f4181e0d27efec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.330973:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1600 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:1.0:1790946246.330977:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bf5599c/0xd9f4181e0d27efec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.330985:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bf5599c/0xd9f4181e0d27efec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946246.330996:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bf5599c/0xd9f4181e0d27efec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946246.331000:0:22751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22751:1877942638726272:0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1790946246.331008:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bf5599c/0xd9f4181e0d27efec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790946246.331015:0:22751:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00010000:00010000:1.0:1790946246.331044:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946246.331047:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946246.331048:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946246.331067:0:22751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22751:1877942638727808:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1790946246.331105:0:22751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946246.331130:0:22751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40a71f8180 going to sleep for 11 seconds 00000100:00100000:2.0:1790946246.331144:0:24234:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638727808 00000100:00100000:2.0:1790946246.331148:0:24234:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638727808 00000100:00100000:2.0:1790946246.331434:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790946246.331531:0:24832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:22751:x1877942638726272:12345-0@lo:5:osp-pre-1-0.0 Request processed in 130294us (132056us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946246.331538:0:24832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790946246.331833:0:24234:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22751:x1877942638727808:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1790946246.331858:0:24234:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000001:00080000:1.0:1790946246.342000:0:25050:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1790946246.342063:0:25050:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1790946246.342068:0:25050:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1790946246.342329:0:24234:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22751:x1877942638727808:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10881us (11218us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1790946246.342343:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790946246.342535:0:22751:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1790946246.342545:0:22751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22751:1877942638727808:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1790946246.342570:0:22751:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000100:00100000:1.0:1790946246.369196:0:24233:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23471:x1877942638727680:12345-0@lo:5:osp-pre-1-1.0 Request processed in 38525us (41743us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1790946246.369209:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790946246.371145:0:23471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23471:1877942638727680:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1790946246.371185:0:23471:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:3.0:1790946246.371236:0:23471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23471:1877942638727936:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1790946246.371286:0:23471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946246.371313:0:23471:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4091069240 going to sleep for 11 seconds 00000100:00100000:3.0:1790946246.371334:0:22736:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638727936 00000100:00100000:3.0:1790946246.371340:0:22736:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638727936 00000100:00100000:3.0:1790946246.371385:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790946246.371392:0:22736:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23471:x1877942638727936:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1790946246.371441:0:22736:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23471:x1877942638727936:12345-0@lo:900:osp-pre-1-1.0 Request processed in 49us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946246.371456:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790946246.371493:0:23471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f84414380 x1877942638727936/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790946262 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946246.371503:0:23471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23471:1877942638727936:0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1790946246.944783:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790946247.007756:0:23480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790946247.972405:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946248.996926:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946250.015394:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946250.593875:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790946250.594511:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5c26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638728064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790946250.594593:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946250.594822:0:24236:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638728064 00000100:00100000:0.0:1790946250.594831:0:24236:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638728064 00000100:00100000:0.0:1790946250.594943:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790946250.594967:0:24236:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638728064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790946250.594999:0:24236:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790946250.595051:0:24236:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638728064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946250.595057:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790946250.595102:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5c26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638728064:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1790946250.595220:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790946251.039447:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946251.109268:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638728192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790946251.109510:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946251.109605:0:22730:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638728192 00000100:00100000:2.0:1790946251.109613:0:22730:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638728192 00000100:00100000:2.0:1790946251.109677:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790946251.109686:0:22730:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638728192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790946251.109723:0:22730:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790946251.109784:0:22730:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638728192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946251.109793:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790946251.109844:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638728192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790946251.112543:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5c26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638728320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790946251.112618:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946251.112798:0:22729:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638728320 00000100:00100000:0.0:1790946251.112807:0:22729:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638728320 00000100:00100000:0.0:1790946251.112861:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790946251.112871:0:22729:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638728320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790946251.112907:0:22729:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790946251.112968:0:22729:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638728320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946251.112988:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790946251.113036:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5c26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638728320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790946251.616486:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790946251.616508:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638728448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790946251.616580:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946251.616625:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8312f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638728576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790946251.616665:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946251.616699:0:24236:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638728448 00000100:00100000:1.0:1790946251.616706:0:24236:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638728448 00000100:00100000:1.0:1790946251.616747:0:24236:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638728576 00000100:00100000:1.0:1790946251.616763:0:24236:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638728576 00000100:00100000:1.0:1790946251.616790:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790946251.616801:0:24236:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8312c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1877942638728448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790946251.616830:0:24236:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1790946251.616874:0:24236:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8312c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1877942638728448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946251.616881:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790946251.616896:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790946251.616902:0:24236:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638728576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790946251.616911:0:24236:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790946251.616953:0:24236:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638728576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946251.616959:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1790946251.616978:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790946251.616982:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790946251.617013:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8312f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638728576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790946251.617042:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638728448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790946251.618213:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638728704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790946251.618260:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946251.618305:0:24236:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638728704 00000100:00100000:1.0:1790946251.618311:0:24236:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638728704 00000100:00100000:1.0:1790946251.618352:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790946251.618360:0:24236:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638728704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790946251.618373:0:24236:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1790946251.618404:0:24236:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638728704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946251.618417:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1790946251.618436:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790946251.618459:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638728704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790946251.622451:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638728960:0@lo:400:kworker.0 00000100:00100000:3.0:1790946251.622528:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946251.622565:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638729472:0@lo:400:kworker.0 00000100:00100000:3.0:1790946251.622586:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946251.622601:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638729984:0@lo:400:kworker.0 00000100:00100000:3.0:1790946251.622621:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946251.622640:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1790946251.622644:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3648:1877942638728832:0@lo:400:kworker.0 00000100:00100000:3.0:1790946251.622665:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946251.622682:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638729344:0@lo:400:kworker.0 00000100:00100000:3.0:1790946251.622701:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946251.622714:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638729856:0@lo:400:kworker.0 00000100:00100000:3.0:1790946251.622733:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946251.622768:0:23467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638728960 00000100:00100000:3.0:1790946251.622776:0:23467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638728960 00000100:00100000:3.0:1790946251.622819:0:23467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790946251.622828:0:23467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638728960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946251.622880:0:23467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638728960:12345-0@lo:400:kworker.0 Request processed in 53us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946251.622900:0:23467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790946251.622924:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638729472 00000100:00100000:3.0:1790946251.622927:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638729472 00000100:00100000:3.0:1790946251.622964:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638729984 00000100:00100000:3.0:1790946251.622967:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638729984 00000100:00100000:3.0:1790946251.622987:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638729856 00000100:00100000:3.0:1790946251.622989:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638729856 00000100:00100000:3.0:1790946251.623000:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790946251.623005:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638729472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946251.623034:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877942638729472:12345-0@lo:400:kworker.0 Request processed in 29us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946251.623039:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790946251.623050:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790946251.623055:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638729984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946251.623080:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877942638729984:12345-0@lo:400:kworker.0 Request processed in 25us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946251.623085:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790946251.623095:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790946251.623100:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638729856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946251.623120:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877942638729856:12345-0@lo:400:kworker.0 Request processed in 20us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946251.623124:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790946251.623142:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638728832 00000100:00100000:3.0:1790946251.623145:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638728832 00000100:00100000:3.0:1790946251.623164:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790946251.623193:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:3648:x1877942638728832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946251.623229:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:3648:x1877942638728832:12345-0@lo:400:kworker.0 Request processed in 36us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946251.623234:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790946251.623259:0:24832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638729344 00000100:00100000:3.0:1790946251.623262:0:24832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638729344 00000100:00100000:3.0:1790946251.623290:0:24832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790946251.623297:0:24832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638729344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946251.623323:0:24832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638729344:12345-0@lo:400:kworker.0 Request processed in 27us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946251.623328:0:24832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1790946251.623354:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790946251.623359:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790946251.623369:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638729088:0@lo:400:kworker.0 00000100:00100000:3.0:1790946251.623392:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946251.623411:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638729600:0@lo:400:kworker.0 00000100:00100000:3.0:1790946251.623434:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946251.623459:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790946251.623465:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638729216:0@lo:400:kworker.0 00000100:00100000:3.0:1790946251.623487:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946251.623508:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638729728:0@lo:400:kworker.0 00000100:00100000:3.0:1790946251.623529:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946251.623559:0:22730:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638729216 00000100:00100000:3.0:1790946251.623563:0:22730:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638729216 00000100:00100000:3.0:1790946251.623583:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790946251.623588:0:22730:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638729216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946251.623619:0:22730:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638729216:12345-0@lo:400:kworker.0 Request processed in 31us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946251.623630:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790946251.623650:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638729088 00000100:00100000:3.0:1790946251.623654:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638729088 00000100:00100000:1.0:1790946251.623660:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638729600 00000100:00100000:1.0:1790946251.623667:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638729600 00000100:00100000:3.0:1790946251.623678:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638729728 00000100:00100000:3.0:1790946251.623682:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638729728 00000100:00100000:3.0:1790946251.623707:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790946251.623713:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638729088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946251.623785:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790946251.623795:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638729600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946251.623833:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638729600:12345-0@lo:400:kworker.0 Request processed in 41us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946251.623839:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790946251.623852:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790946251.623859:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638729728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946251.623892:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638729728:12345-0@lo:400:kworker.0 Request processed in 34us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946251.623898:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790946251.624092:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877942638729088:12345-0@lo:400:kworker.0 Request processed in 379us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946251.624098:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1790946251.624115:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790946251.624118:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790946251.624149:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638729216:0@lo:400:kworker.0 00010000:00080000:3.0:1790946251.624161:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8265e300 x1877942638729728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946251.624233:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3648:1877942638728832:0@lo:400:kworker.0 00000100:00100000:2.0:1790946251.624245:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638729344:0@lo:400:kworker.0 00010000:00080000:2.0:1790946251.624258:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8265ca80 x1877942638729856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946251.624266:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1877942638729856:0@lo:400:kworker.0 00000100:00100000:2.0:1790946251.624276:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638728960:0@lo:400:kworker.0 00010000:00080000:2.0:1790946251.624286:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8265ce00 x1877942638729472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946251.624304:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877942638729472:0@lo:400:kworker.0 00010000:00080000:2.0:1790946251.624314:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8265dc00 x1877942638729984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946251.624321:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1877942638729984:0@lo:400:kworker.0 00000100:00100000:3.0:1790946251.624445:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638729728:0@lo:400:kworker.0 00010000:00080000:3.0:1790946251.624459:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f84417800 x1877942638729088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946251.624514:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877942638729088:0@lo:400:kworker.0 00010000:00080000:3.0:1790946251.624525:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f8265f800 x1877942638729600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946251.624532:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638729600:0@lo:400:kworker.0 00000001:02000400:2.0:1790946251.859804:0:25406:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790946252.067367:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790946252.151406:0:25050:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000020:00000004:2.0:1790946252.780446:0:25458:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790946252.781129:0:25458:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790946253.088839:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790946253.600224:0:22760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1790946253.754972:0:25508:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790946253.755714:0:25508:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1790946253.975255:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946253.977554:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616601600 00000100:00100000:0.0:1790946253.977570:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616601600 00000100:00100000:0.0:1790946253.977627:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 114 00000100:00100000:0.0:1790946253.977635:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2400:x1877942616601600:12345-192.168.204.20@tcp:250:mount.lustre.0 00010000:00080000:0.0:1790946253.977665:0:22719:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 2bd124a6-b6bd-4e62-987b-f878bfee98e2@192.168.204.20@tcp t0 exp 0000000000000000 cur 704 last 0 00000020:00000080:0.0:1790946253.977699:0:22719:0:(genops.c:1384:class_connect()) connect: client 2bd124a6-b6bd-4e62-987b-f878bfee98e2, cookie 0xd9f4181e0d27eff3 00000100:00080000:0.0:1790946253.977841:0:22719:0:(import.c:65:import_set_state_nolock()) ffff9d3f827e0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790946253.978108:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bd124a6-b6bd-4e62-987b-f878bfee98e2+5:2400:x1877942616601600:12345-192.168.204.20@tcp:250:mount.lustre.0 Request processed in 471us (2862us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946253.978118:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 114 00000100:00100000:1.0:1790946253.983067:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946253.983146:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616601728 00000100:00100000:3.0:1790946253.983212:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616601728 00000100:00100000:2.0:1790946253.983288:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 115 00000100:00100000:2.0:1790946253.983309:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+5:18024:x1877942616601728:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790946253.983327:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946253.983345:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4092afc200/0xd9f4181e0d27effa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c22233107d expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946253.983375:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4092afc200/0xd9f4181e0d27effa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233107d expref: 6 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946253.983387:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4092afc200/0xd9f4181e0d27effa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233107d expref: 6 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946253.983397:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afc200, rc 0) 00000100:00100000:2.0:1790946253.983577:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+6:18024:x1877942616601728:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 278us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946253.983585:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 115 00000100:00100000:0.0:1790946253.985368:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946253.985476:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616601856 00000100:00100000:2.0:1790946253.985485:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616601856 00000100:00100000:2.0:1790946253.985653:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 116 00000100:00100000:2.0:1790946253.985663:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bd124a6-b6bd-4e62-987b-f878bfee98e2+6:18024:x1877942616601856:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790946253.985784:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bd124a6-b6bd-4e62-987b-f878bfee98e2+6:18024:x1877942616601856:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 122us (423us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790946253.985793:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 116 00000100:00100000:3.0:1790946253.988250:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946253.988516:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616601984 00000100:00100000:2.0:1790946253.988525:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616601984 00000100:00100000:2.0:1790946253.988577:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 117 00000100:00100000:2.0:1790946253.988586:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+6:18024:x1877942616601984:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790946253.988604:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946253.988626:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4092afcc00/0xd9f4181e0d27f001 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331084 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946253.988658:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4092afcc00/0xd9f4181e0d27f001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331084 expref: 7 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946253.988670:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4092afcc00/0xd9f4181e0d27f001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331084 expref: 7 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946253.988680:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afcc00, rc 0) 00000100:00100000:2.0:1790946253.988742:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+7:18024:x1877942616601984:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 157us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946253.988749:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 117 00000100:00100000:1.0:1790946253.990957:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946253.991263:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616602112 00000100:00100000:2.0:1790946253.991272:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616602112 00000100:00100000:2.0:1790946253.991318:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 118 00000100:00100000:2.0:1790946253.991329:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bd124a6-b6bd-4e62-987b-f878bfee98e2+7:18024:x1877942616602112:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790946253.991502:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bd124a6-b6bd-4e62-987b-f878bfee98e2+8:18024:x1877942616602112:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 175us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946253.991509:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 118 00000100:00100000:3.0:1790946253.993252:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946253.993325:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616602240 00000100:00100000:0.0:1790946253.993335:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616602240 00000100:00100000:0.0:1790946253.993387:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 119 00000100:00100000:0.0:1790946253.993396:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bd124a6-b6bd-4e62-987b-f878bfee98e2+8:18024:x1877942616602240:12345-192.168.204.20@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790946253.993538:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bd124a6-b6bd-4e62-987b-f878bfee98e2+8:18024:x1877942616602240:12345-192.168.204.20@tcp:503:mount.lustre.0 Request processed in 143us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946253.993547:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 119 00000100:00100000:1.0:1790946253.999575:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946253.999818:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616602368 00000100:00100000:0.0:1790946253.999831:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616602368 00000100:00100000:0.0:1790946253.999914:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 120 00000100:00100000:0.0:1790946253.999937:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+8:18042:x1877942616602368:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790946254.000107:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+8:18042:x1877942616602368:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 170us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946254.000115:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 120 00000100:00100000:3.0:1790946254.027508:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946254.029243:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616602496 00000100:00100000:2.0:1790946254.029260:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616602496 00000100:00100000:2.0:1790946254.029331:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 121 00000100:00100000:2.0:1790946254.029341:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bd124a6-b6bd-4e62-987b-f878bfee98e2+8:18042:x1877942616602496:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790946254.029529:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bd124a6-b6bd-4e62-987b-f878bfee98e2+8:18042:x1877942616602496:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 188us (2029us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946254.029537:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 121 00000100:00100000:0.0:1790946254.036694:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946254.036933:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616602624 00000100:00100000:2.0:1790946254.036943:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616602624 00000100:00100000:2.0:1790946254.037108:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 122 00000100:00100000:2.0:1790946254.037119:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+8:18042:x1877942616602624:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790946254.037547:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+8:18042:x1877942616602624:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 428us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946254.037556:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 122 00000100:00100000:1.0:1790946254.044278:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946254.044495:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616602752 00000100:00100000:0.0:1790946254.044506:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616602752 00000100:00100000:0.0:1790946254.044632:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 123 00000100:00100000:0.0:1790946254.044641:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bd124a6-b6bd-4e62-987b-f878bfee98e2+8:18024:x1877942616602752:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790946254.044659:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946254.044677:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d408630b400/0xd9f4181e0d27f008 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c2223310b5 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946254.044706:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d408630b400/0xd9f4181e0d27f008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223310b5 expref: 9 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946254.044717:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d408630b400/0xd9f4181e0d27f008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223310b5 expref: 9 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946254.044726:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d408630b400, rc 0) 00000100:00100000:0.0:1790946254.044872:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bd124a6-b6bd-4e62-987b-f878bfee98e2+9:18024:x1877942616602752:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 231us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946254.044880:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 123 00000100:00100000:0.0:1790946254.051073:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946254.051356:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616602880 00000100:00100000:2.0:1790946254.051368:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616602880 00000100:00100000:2.0:1790946254.051434:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 124 00000100:00100000:2.0:1790946254.051445:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+9:18024:x1877942616602880:12345-192.168.204.20@tcp:256:mount.lustre.0 20000000:01000000:2.0:1790946254.051471:0:22717:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790946254.051497:0:22717:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790946254.051501:0:22717:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790946254.051504:0:22717:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790946254.051511:0:22717:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1790946254.051513:0:22717:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1790946254.056278:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+9:18024:x1877942616602880:12345-192.168.204.20@tcp:256:mount.lustre.0 Request processed in 4821us (5201us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946254.056296:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 124 00000100:00100000:1.0:1790946254.059614:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946254.060158:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616603008 00000100:00100000:0.0:1790946254.060209:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616603008 00000100:00100000:0.0:1790946254.060275:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 125 00000100:00100000:0.0:1790946254.060312:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bd124a6-b6bd-4e62-987b-f878bfee98e2+9:18024:x1877942616603008:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790946254.060333:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946254.060352:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d408630ac00/0xd9f4181e0d27f00f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c2223310bc expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946254.060382:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d408630ac00/0xd9f4181e0d27f00f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223310bc expref: 10 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946254.060393:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d408630ac00/0xd9f4181e0d27f00f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223310bc expref: 10 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946254.060403:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d408630ac00, rc 0) 00000100:00100000:0.0:1790946254.060460:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bd124a6-b6bd-4e62-987b-f878bfee98e2+10:18024:x1877942616603008:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 159us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946254.060468:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 125 00000100:00100000:0.0:1790946254.062485:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946254.062638:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616603136 00000100:00100000:2.0:1790946254.062649:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616603136 00000100:00100000:2.0:1790946254.062710:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 126 00000100:00100000:2.0:1790946254.062719:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40be7f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+10:18024:x1877942616603136:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790946254.063304:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40be7f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+10:18024:x1877942616603136:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 582us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946254.063314:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 126 00000100:00100000:1.0:1790946254.065362:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946254.065524:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616603264 00000100:00100000:3.0:1790946254.065542:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616603264 00000100:00100000:3.0:1790946254.065599:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 127 00000100:00100000:3.0:1790946254.065609:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4a36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bd124a6-b6bd-4e62-987b-f878bfee98e2+10:18024:x1877942616603264:12345-192.168.204.20@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790946254.065766:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4a36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bd124a6-b6bd-4e62-987b-f878bfee98e2+10:18024:x1877942616603264:12345-192.168.204.20@tcp:503:mount.lustre.0 Request processed in 158us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946254.065775:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 127 00000100:00100000:1.0:1790946254.080364:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946254.081437:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616603392 00000100:00100000:2.0:1790946254.081453:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616603392 00000100:00100000:2.0:1790946254.081584:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 128 00000100:00100000:2.0:1790946254.081598:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+10:18047:x1877942616603392:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790946254.081797:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+10:18047:x1877942616603392:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 202us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946254.081807:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 128 00000100:00100000:1.0:1790946254.090276:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946254.090478:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616603520 00000100:00100000:0.0:1790946254.090493:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616603520 00000100:00100000:0.0:1790946254.090586:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 129 00000100:00100000:0.0:1790946254.090598:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bd124a6-b6bd-4e62-987b-f878bfee98e2+10:18047:x1877942616603520:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790946254.090780:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bd124a6-b6bd-4e62-987b-f878bfee98e2+10:18047:x1877942616603520:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 184us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946254.090788:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 129 00000100:00100000:1.0:1790946254.099117:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946254.099160:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946254.099554:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616603648 00000100:00100000:3.0:1790946254.099565:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616603648 00000100:00100000:3.0:1790946254.099618:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616603904 00000100:00100000:3.0:1790946254.099622:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616603904 00000100:00100000:3.0:1790946254.099657:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:3.0:1790946254.099668:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1877942616603648:12345-192.168.204.20@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790946254.099703:0:22725:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 93f4dfa8-f0c5-48de-82e2-232116f1669e@192.168.204.20@tcp t0 exp 0000000000000000 cur 704 last 0 00000100:00100000:0.0:1790946254.099869:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:0.0:1790946254.099876:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1877942616603904:12345-192.168.204.20@tcp:38:mount.lustre.0 00010000:00080000:0.0:1790946254.099908:0:22726:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 93f4dfa8-f0c5-48de-82e2-232116f1669e@192.168.204.20@tcp t0 exp 0000000000000000 cur 704 last 0 00000020:00000080:0.0:1790946254.099965:0:22726:0:(genops.c:1384:class_connect()) connect: client 93f4dfa8-f0c5-48de-82e2-232116f1669e, cookie 0xd9f4181e0d27f01d 00000004:00100000:0.0:1790946254.099998:0:22726:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790946254.100278:0:22726:0:(import.c:65:import_set_state_nolock()) ffff9d3f827e7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790946254.100367:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:2400:x1877942616603904:12345-192.168.204.20@tcp:38:mount.lustre.0 Request processed in 490us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946254.100374:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 8 00000020:00000080:3.0:1790946254.100604:0:22725:0:(genops.c:1384:class_connect()) connect: client 93f4dfa8-f0c5-48de-82e2-232116f1669e, cookie 0xd9f4181e0d27f016 00000004:00100000:3.0:1790946254.100625:0:22725:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790946254.100847:0:22725:0:(import.c:65:import_set_state_nolock()) ffff9d3f822f2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790946254.100890:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:2400:x1877942616603648:12345-192.168.204.20@tcp:38:mount.lustre.0 Request processed in 1216us (1777us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946254.100898:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:1.0:1790946254.106280:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946254.106324:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946254.106353:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946254.106442:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616604160 00000100:00100000:2.0:1790946254.106453:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616604160 00000100:00100000:2.0:1790946254.106529:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616604032 00000100:00100000:2.0:1790946254.106532:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616604032 00000100:00100000:2.0:1790946254.106548:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616603776 00000100:00100000:2.0:1790946254.106557:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616603776 00000100:00100000:2.0:1790946254.106579:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:2.0:1790946254.106594:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+7:18024:x1877942616604160:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790946254.106651:0:22724:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790946254.106746:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+7:18024:x1877942616604160:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 153us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946254.106753:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:2.0:1790946254.106782:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:2.0:1790946254.106789:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:0:x1877942616604032:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790946254.106808:0:22724:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790946254.106846:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:0:x1877942616604032:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 57us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946254.106853:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:2.0:1790946254.106865:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:2.0:1790946254.106871:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:0:x1877942616603776:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790946254.106892:0:22724:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790946254.106917:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:0:x1877942616603776:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 46us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946254.106923:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00080000:1.0:1790946254.107183:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790946254.107188:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790946254.111972:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946254.112866:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946254.113041:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616604288 00000100:00100000:2.0:1790946254.113053:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616604288 00000100:00100000:2.0:1790946254.113121:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:2.0:1790946254.113132:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:18024:x1877942616604288:12345-192.168.204.20@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790946254.113264:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:18024:x1877942616604288:12345-192.168.204.20@tcp:40:mount.lustre.0 Request processed in 134us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946254.113272:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:1.0:1790946254.119056:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946254.119114:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946254.119149:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946254.119292:0:25123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616604416 00000100:00100000:0.0:1790946254.119303:0:25123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616604416 00000100:00100000:0.0:1790946254.119347:0:25123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616604544 00000100:00100000:0.0:1790946254.119350:0:25123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616604544 00000100:00100000:0.0:1790946254.119369:0:25123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:0.0:1790946254.119376:0:25123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2400:x1877942616604416:12345-192.168.204.20@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790946254.119424:0:25123:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 93f4dfa8-f0c5-48de-82e2-232116f1669e@192.168.204.20@tcp t0 exp 0000000000000000 cur 704 last 0 00000020:00000080:0.0:1790946254.119464:0:25123:0:(genops.c:1384:class_connect()) connect: client 93f4dfa8-f0c5-48de-82e2-232116f1669e, cookie 0xd9f4181e0d27f024 00002000:00100000:0.0:1790946254.119479:0:25123:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 93f4dfa8-f0c5-48de-82e2-232116f1669e/ffff9d3f827e7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790946254.119498:0:25123:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790946254.120074:0:25123:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1790946254.120158:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:1.0:1790946254.120165:0:24233:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2400:x1877942616604544:12345-192.168.204.20@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790946254.120211:0:24233:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 93f4dfa8-f0c5-48de-82e2-232116f1669e@192.168.204.20@tcp t0 exp 0000000000000000 cur 704 last 0 00000020:00000080:1.0:1790946254.120242:0:24233:0:(genops.c:1384:class_connect()) connect: client 93f4dfa8-f0c5-48de-82e2-232116f1669e, cookie 0xd9f4181e0d27f02b 00002000:00100000:1.0:1790946254.120248:0:24233:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 93f4dfa8-f0c5-48de-82e2-232116f1669e/ffff9d3f8454f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790946254.120266:0:24233:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790946254.120413:0:24233:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790946254.120605:0:25123:0:(import.c:65:import_set_state_nolock()) ffff9d3f827e3000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1790946254.120625:0:24233:0:(import.c:65:import_set_state_nolock()) ffff9d3f8454b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790946254.120704:0:24233:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:2400:x1877942616604544:12345-192.168.204.20@tcp:8:mount.lustre.0 Request processed in 537us (1553us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946254.120712:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:0.0:1790946254.120947:0:25123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:2400:x1877942616604416:12345-192.168.204.20@tcp:8:mount.lustre.0 Request processed in 1570us (1835us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946254.120955:0:25123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:0.0:1790946254.126103:0:22735:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616604672 00000100:00100000:0.0:1790946254.126123:0:22735:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616604672 00000100:00100000:0.0:1790946254.126248:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:0.0:1790946254.126259:0:22735:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:18024:x1877942616604672:12345-192.168.204.20@tcp:900:mount.lustre.0 00000100:00100000:0.0:1790946254.126365:0:22735:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:18024:x1877942616604672:12345-192.168.204.20@tcp:900:mount.lustre.0 Request processed in 108us (7318us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946254.126373:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:1.0:1790946254.136395:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946254.136553:0:22727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616604800 00000100:00100000:3.0:1790946254.136567:0:22727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616604800 00000100:00100000:3.0:1790946254.136628:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:3.0:1790946254.136655:0:22727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:18024:x1877942616604800:12345-192.168.204.20@tcp:33:mount.lustre.0 00000004:00080000:1.0:1790946254.139138:0:22727:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2389us 00000004:00200000:1.0:1790946254.166629:0:22727:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1790946254.166784:0:22727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:18024:x1877942616604800:12345-192.168.204.20@tcp:33:mount.lustre.0 Request processed in 30123us (30392us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946254.166800:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:2.0:1790946254.364900:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946254.365132:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616604928 00000100:00100000:3.0:1790946254.365143:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616604928 00000100:00100000:3.0:1790946254.365242:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:3.0:1790946254.365253:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:18070:x1877942616604928:12345-192.168.204.20@tcp:101:mkdir.0 00010000:00010000:3.0:1790946254.365275:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946254.365303:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1800/0xd9f4181e0d27f032 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c2223310ed expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946254.365368:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0200/0xd9f4181e0d27f039 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946254.365381:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0200/0xd9f4181e0d27f039 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946254.365396:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0200/0xd9f4181e0d27f039 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946254.365447:0:22725:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790946254.365451:0:22725:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790946254.365494:0:22725:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0200/0xd9f4181e0d27f039 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946254.365536:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1800/0xd9f4181e0d27f032 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223310ed expref: 8 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946254.365559:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0200/0xd9f4181e0d27f039 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223310ed expref: 7 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946254.365581:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f8259fa00) 00010000:00010000:3.0:1790946254.365584:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790946254.365588:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef0200, rc 0) 00000100:00100000:3.0:1790946254.365665:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+7:18070:x1877942616604928:12345-192.168.204.20@tcp:101:mkdir.0 Request processed in 414us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946254.365672:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00010000:00010000:1.0:1790946255.135495:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946255.713524:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5c26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638730112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790946255.713601:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946255.713824:0:24236:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638730112 00000100:00100000:2.0:1790946255.713833:0:24236:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638730112 00000100:00100000:2.0:1790946255.713915:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790946255.713925:0:24236:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638730112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790946255.713959:0:24236:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790946255.714019:0:24236:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638730112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946255.714027:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790946255.714261:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5c26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638730112:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1790946255.714322:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790946256.159456:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946256.225267:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5c26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638730240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790946256.225342:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946256.225517:0:22729:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638730240 00000100:00100000:1.0:1790946256.225526:0:22729:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638730240 00000100:00100000:1.0:1790946256.225580:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790946256.225589:0:22729:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638730240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790946256.225624:0:22729:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790946256.225675:0:22729:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638730240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946256.225682:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790946256.225751:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790946256.225763:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638730368:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790946256.225792:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946256.225977:0:23467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638730368 00000100:00100000:1.0:1790946256.225982:0:23467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638730368 00000100:00100000:1.0:1790946256.226009:0:23467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790946256.226018:0:23467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638730368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790946256.226039:0:23467:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790946256.226079:0:23467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638730368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946256.226085:0:23467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790946256.226127:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638730368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790946256.226383:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5c26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638730240:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790946256.463050:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946256.463600:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616605056 00000100:00100000:2.0:1790946256.463612:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616605056 00000100:00100000:2.0:1790946256.463738:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:2.0:1790946256.463748:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+7:18122:x1877942616605056:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:2.0:1790946256.463780:0:22724:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790946256.463909:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+7:18122:x1877942616605056:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 161us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946256.463917:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00080000:1.0:1790946256.467076:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946256.477235:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946256.477417:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616605184 00000100:00100000:0.0:1790946256.477426:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616605184 00000100:00100000:0.0:1790946256.477513:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:0.0:1790946256.477523:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:18122:x1877942616605184:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:0.0:1790946256.477557:0:22726:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790946256.477683:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:18122:x1877942616605184:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 160us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946256.477690:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00080000:1.0:1790946256.478515:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790946256.492045:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946256.492146:0:24236:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616605312 00000100:00100000:2.0:1790946256.492197:0:24236:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616605312 00000100:00100000:2.0:1790946256.492288:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:2.0:1790946256.492299:0:24236:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:18122:x1877942616605312:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:2.0:1790946256.492328:0:24236:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790946256.492428:0:24236:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:18122:x1877942616605312:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 130us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946256.492453:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00080000:1.0:1790946256.493413:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790946256.495083:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946256.495197:0:24236:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616605440 00000100:00100000:1.0:1790946256.495209:0:24236:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616605440 00000100:00100000:1.0:1790946256.495302:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:1.0:1790946256.495314:0:24236:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:18122:x1877942616605440:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:1.0:1790946256.495355:0:24236:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1790946256.495457:0:24236:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:18122:x1877942616605440:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 145us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946256.495465:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00080000:3.0:1790946256.496251:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790946256.735534:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790946256.735559:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8265c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638730624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790946256.735639:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946256.735920:0:24236:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638730624 00000100:00100000:1.0:1790946256.735928:0:24236:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638730624 00000100:00100000:1.0:1790946256.735984:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790946256.735993:0:24236:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638730624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790946256.736026:0:24236:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790946256.736079:0:24236:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638730624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946256.736086:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790946256.736262:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8441fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638731136:0@lo:400:kworker.0 00000100:00100000:2.0:1790946256.736295:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946256.736327:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638731648:0@lo:400:kworker.0 00000100:00100000:2.0:1790946256.736350:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946256.736369:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1790946256.736374:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83c76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3649:1877942638730752:0@lo:400:kworker.0 00000100:00100000:2.0:1790946256.736400:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946256.736426:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8312f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638731264:0@lo:400:kworker.0 00000100:00100000:2.0:1790946256.736446:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946256.736461:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1877942638731776:0@lo:400:kworker.0 00000100:00100000:2.0:1790946256.736480:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946256.736506:0:24234:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638731136 00000100:00100000:2.0:1790946256.736510:0:24234:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638731136 00000100:00100000:2.0:1790946256.736535:0:24234:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638731264 00000100:00100000:2.0:1790946256.736538:0:24234:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638731264 00000100:00100000:2.0:1790946256.736563:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790946256.736570:0:24234:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638731136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946256.736612:0:24234:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638731136:12345-0@lo:400:kworker.0 Request processed in 42us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946256.736618:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790946256.736629:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790946256.736635:0:24234:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638731264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946256.736663:0:24234:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638731264:12345-0@lo:400:kworker.0 Request processed in 27us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946256.736676:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790946256.736723:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1790946256.736740:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8312f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638731264:0@lo:400:kworker.0 00000100:00100000:2.0:1790946256.736751:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8441fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638731136:0@lo:400:kworker.0 00000100:00100000:2.0:1790946256.736772:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638731648 00000100:00100000:2.0:1790946256.736775:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638731648 00000100:00100000:2.0:1790946256.736798:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638731776 00000100:00100000:2.0:1790946256.736885:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638731776 00000100:00100000:2.0:1790946256.736909:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790946256.736916:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638731648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946256.736953:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877942638731648:12345-0@lo:400:kworker.0 Request processed in 37us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946256.736958:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790946256.736969:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790946256.736974:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877942638731776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946256.736999:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877942638731776:12345-0@lo:400:kworker.0 Request processed in 25us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946256.737004:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790946256.737028:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1877942638731776:0@lo:400:kworker.0 00010000:00080000:2.0:1790946256.737040:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b5ccb480 x1877942638731648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946256.737051:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1877942638731648:0@lo:400:kworker.0 00000100:00100000:2.0:1790946256.737070:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638730752 00000100:00100000:2.0:1790946256.737073:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638730752 00000100:00100000:2.0:1790946256.737107:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790946256.737114:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:3649:x1877942638730752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946256.737151:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:3649:x1877942638730752:12345-0@lo:400:kworker.0 Request processed in 37us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946256.737157:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790946256.737225:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83c76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3649:1877942638730752:0@lo:400:kworker.0 00000100:00080000:3.0:1790946256.737392:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790946256.737398:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790946256.737400:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790946256.737402:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790946256.737432:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8265c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638730624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790946256.737962:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638730880:0@lo:400:kworker.0 00000100:00100000:0.0:1790946256.738007:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946256.738043:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1877942638731392:0@lo:400:kworker.0 00000100:00100000:0.0:1790946256.738068:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946256.738092:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638731904:0@lo:400:kworker.0 00000100:00100000:0.0:1790946256.738111:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946256.738135:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1790946256.738143:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638730496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790946256.738165:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946256.738206:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f83c77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638731008:0@lo:400:kworker.0 00000100:00100000:0.0:1790946256.738228:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946256.738258:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638731520:0@lo:400:kworker.0 00000100:00100000:0.0:1790946256.738278:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946256.738289:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638732032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946256.738306:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946256.738330:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638731392 00000100:00100000:0.0:1790946256.738335:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638731392 00000100:00100000:0.0:1790946256.738362:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638731904 00000100:00100000:0.0:1790946256.738365:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638731904 00000100:00100000:0.0:1790946256.738384:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638731008 00000100:00100000:0.0:1790946256.738387:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638731008 00000100:00100000:0.0:1790946256.738397:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638731520 00000100:00100000:0.0:1790946256.738399:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638731520 00000100:00100000:0.0:1790946256.738413:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790946256.738419:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1877942638731392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946256.738462:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1877942638731392:12345-0@lo:400:kworker.0 Request processed in 42us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946256.738469:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790946256.738483:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790946256.738488:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638731904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946256.738516:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1877942638731904:12345-0@lo:400:kworker.0 Request processed in 28us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946256.738521:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790946256.738533:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790946256.738538:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638731008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946256.738566:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638731008:12345-0@lo:400:kworker.0 Request processed in 28us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946256.738572:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790946256.738591:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790946256.738597:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638731520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946256.738625:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638731520:12345-0@lo:400:kworker.0 Request processed in 28us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946256.738631:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790946256.738652:0:24237:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638730496 00000100:00100000:0.0:1790946256.738655:0:24237:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638730496 00000100:00100000:0.0:1790946256.738669:0:24237:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638732032 00000100:00100000:0.0:1790946256.738671:0:24237:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638732032 00000100:00100000:0.0:1790946256.738687:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790946256.738693:0:24237:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638730496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790946256.738725:0:24237:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1790946256.738778:0:24237:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638730496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946256.738784:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790946256.738795:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790946256.738800:0:24237:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638732032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790946256.738809:0:24237:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1790946256.738846:0:24237:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638732032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946256.738852:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790946256.738900:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638730496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790946256.738912:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83c77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638731008:0@lo:400:kworker.0 00000100:00100000:0.0:1790946256.738921:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638731520:0@lo:400:kworker.0 00000100:00100000:0.0:1790946256.738936:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638732032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946256.738956:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1877942638731392:0@lo:400:kworker.0 00010000:00080000:0.0:1790946256.738967:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40b5cc9c00 x1877942638731904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946256.738976:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1877942638731904:0@lo:400:kworker.0 00000100:00100000:3.0:1790946256.739242:0:24832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638730880 00000100:00100000:3.0:1790946256.739247:0:24832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638730880 00000100:00100000:3.0:1790946256.739287:0:24832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790946256.739295:0:24832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638730880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946256.739338:0:24832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638730880:12345-0@lo:400:kworker.0 Request processed in 44us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946256.739352:0:24832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1790946256.739371:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790946256.739375:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790946256.739378:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790946256.739396:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f83c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638730880:0@lo:400:kworker.0 00000100:00100000:0.0:1790946256.745084:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946256.745200:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616605568 00000100:00100000:2.0:1790946256.745213:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616605568 00000100:00100000:2.0:1790946256.745282:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 131 00000100:00100000:2.0:1790946256.745293:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bd124a6-b6bd-4e62-987b-f878bfee98e2+10:18155:x1877942616605568:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790946256.745311:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946256.745331:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4092afc800/0xd9f4181e0d27f040 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c2223310f4 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946256.745363:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4092afc800/0xd9f4181e0d27f040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223310f4 expref: 11 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946256.745376:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4092afc800/0xd9f4181e0d27f040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223310f4 expref: 11 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946256.745384:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afc800, rc 0) 00000100:00100000:2.0:1790946256.745450:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bd124a6-b6bd-4e62-987b-f878bfee98e2+11:18155:x1877942616605568:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 159us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946256.745458:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 131 00000100:00100000:2.0:1790946256.753273:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946256.753372:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616605696 00000100:00100000:0.0:1790946256.753383:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616605696 00000100:00100000:0.0:1790946256.753437:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 132 00000100:00100000:0.0:1790946256.753446:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bd124a6-b6bd-4e62-987b-f878bfee98e2+11:18155:x1877942616605696:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790946256.753619:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bd124a6-b6bd-4e62-987b-f878bfee98e2+11:18155:x1877942616605696:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 174us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946256.753628:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 132 00000100:00100000:1.0:1790946256.763747:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946256.763988:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616605824 00000100:00100000:0.0:1790946256.764005:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616605824 00000100:00100000:0.0:1790946256.764073:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 133 00000100:00100000:0.0:1790946256.764084:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+11:18155:x1877942616605824:12345-192.168.204.20@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790946256.764337:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+11:18155:x1877942616605824:12345-192.168.204.20@tcp:503:mount.lustre.0 Request processed in 252us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946256.764345:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 133 00000100:00100000:1.0:1790946256.780245:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946256.780344:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616605952 00000100:00100000:2.0:1790946256.780357:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616605952 00000100:00100000:2.0:1790946256.780431:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 134 00000100:00100000:2.0:1790946256.780441:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bd124a6-b6bd-4e62-987b-f878bfee98e2+11:18161:x1877942616605952:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790946256.780624:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bd124a6-b6bd-4e62-987b-f878bfee98e2+11:18161:x1877942616605952:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 183us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946256.780633:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 134 00000100:00100000:3.0:1790946256.823955:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946256.824153:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616606080 00000100:00100000:2.0:1790946256.824164:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616606080 00000100:00100000:2.0:1790946256.824256:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 135 00000100:00100000:2.0:1790946256.824266:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bd124a6-b6bd-4e62-987b-f878bfee98e2+11:18161:x1877942616606080:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790946256.824422:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bd124a6-b6bd-4e62-987b-f878bfee98e2+11:18161:x1877942616606080:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 157us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946256.824429:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 135 00000100:00100000:1.0:1790946256.831597:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946256.831991:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616606208 00000100:00100000:0.0:1790946256.832003:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616606208 00000100:00100000:0.0:1790946256.832066:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 136 00000100:00100000:0.0:1790946256.832076:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8377dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+11:18161:x1877942616606208:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790946256.832279:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8377dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+11:18161:x1877942616606208:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 202us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946256.832309:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 136 00000100:00100000:1.0:1790946256.837372:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946256.837469:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616606336 00000100:00100000:3.0:1790946256.837490:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616606336 00000100:00100000:3.0:1790946256.837546:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 137 00000100:00100000:3.0:1790946256.837556:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bd124a6-b6bd-4e62-987b-f878bfee98e2+11:18155:x1877942616606336:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790946256.837574:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946256.837593:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27f047 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331125 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946256.837624:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27f047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331125 expref: 12 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946256.837635:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d40baef1800/0xd9f4181e0d27f047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331125 expref: 12 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946256.837644:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef1800, rc 0) 00000100:00100000:3.0:1790946256.837717:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bd124a6-b6bd-4e62-987b-f878bfee98e2+12:18155:x1877942616606336:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 161us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946256.837724:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 137 00000100:00100000:3.0:1790946256.841810:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946256.842020:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616606464 00000100:00100000:2.0:1790946256.842032:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616606464 00000100:00100000:2.0:1790946256.842085:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 138 00000100:00100000:2.0:1790946256.842094:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bd124a6-b6bd-4e62-987b-f878bfee98e2+12:18155:x1877942616606464:12345-192.168.204.20@tcp:256:mount.lustre.0 20000000:01000000:2.0:1790946256.842122:0:22719:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790946256.842146:0:22719:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790946256.842162:0:22719:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790946256.842166:0:22719:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790946256.842207:0:22719:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1790946256.842209:0:22719:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1790946256.847428:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bd124a6-b6bd-4e62-987b-f878bfee98e2+12:18155:x1877942616606464:12345-192.168.204.20@tcp:256:mount.lustre.0 Request processed in 5320us (5616us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946256.847446:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 138 00000100:00100000:1.0:1790946256.859946:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946256.863030:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616606592 00000100:00100000:0.0:1790946256.863048:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616606592 00000100:00100000:0.0:1790946256.863205:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 139 00000100:00100000:0.0:1790946256.863217:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+12:18155:x1877942616606592:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790946256.863236:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946256.863259:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d408630ae00/0xd9f4181e0d27f04e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c22233112c expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946256.863286:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d408630ae00/0xd9f4181e0d27f04e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233112c expref: 13 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946256.865773:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d408630ae00/0xd9f4181e0d27f04e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233112c expref: 13 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946256.865787:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d408630ae00, rc 0) 00000100:00100000:0.0:1790946256.865899:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+13:18155:x1877942616606592:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 2683us (5962us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946256.865909:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 139 00000100:00100000:3.0:1790946256.870752:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946256.871345:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616606720 00000100:00100000:2.0:1790946256.871375:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616606720 00000100:00100000:2.0:1790946256.871435:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 140 00000100:00100000:2.0:1790946256.871445:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bd124a6-b6bd-4e62-987b-f878bfee98e2+13:18155:x1877942616606720:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790946256.871624:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bd124a6-b6bd-4e62-987b-f878bfee98e2+13:18155:x1877942616606720:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 179us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946256.871632:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 140 00000100:00100000:1.0:1790946256.879331:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946256.879571:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616606848 00000100:00100000:0.0:1790946256.879583:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616606848 00000100:00100000:0.0:1790946256.879642:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 141 00000100:00100000:0.0:1790946256.879653:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+13:18155:x1877942616606848:12345-192.168.204.20@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790946256.879948:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+13:18155:x1877942616606848:12345-192.168.204.20@tcp:503:mount.lustre.0 Request processed in 296us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946256.879957:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 141 00000100:00100000:1.0:1790946256.885036:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946256.885966:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616606976 00000100:00100000:3.0:1790946256.885991:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616606976 00000100:00100000:2.0:1790946256.886226:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 142 00000100:00100000:2.0:1790946256.886239:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bd124a6-b6bd-4e62-987b-f878bfee98e2+13:18165:x1877942616606976:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790946256.886664:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bd124a6-b6bd-4e62-987b-f878bfee98e2+13:18165:x1877942616606976:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 426us (1637us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946256.886673:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 142 00000100:00100000:3.0:1790946256.898935:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946256.899132:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616607104 00000100:00100000:0.0:1790946256.899143:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616607104 00000100:00100000:0.0:1790946256.899244:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 143 00000100:00100000:0.0:1790946256.899254:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+13:18165:x1877942616607104:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790946256.899394:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+13:18165:x1877942616607104:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 141us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946256.899402:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 143 00000100:00100000:1.0:1790946256.907856:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946256.907894:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946256.907925:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946256.907970:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946256.907989:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946256.908014:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946256.908041:0:25123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616608256 00000100:00100000:1.0:1790946256.908050:0:25123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616608256 00000100:00100000:1.0:1790946256.908096:0:25123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616608128 00000100:00100000:1.0:1790946256.908100:0:25123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616608128 00000100:00100000:1.0:1790946256.908121:0:25123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:1.0:1790946256.908129:0:25123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:2404:x1877942616608256:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790946256.908234:0:25123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:2404:x1877942616608256:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 106us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946256.908242:0:25123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:1.0:1790946256.908257:0:25123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:1.0:1790946256.908263:0:25123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:2403:x1877942616608128:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790946256.908286:0:25123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:2403:x1877942616608128:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 23us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946256.908292:0:25123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:2.0:1790946256.908453:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616607232 00000100:00100000:2.0:1790946256.908458:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616607232 00000100:00100000:2.0:1790946256.908474:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616607488 00000100:00100000:2.0:1790946256.908476:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616607488 00000100:00100000:2.0:1790946256.908482:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616608000 00000100:00100000:2.0:1790946256.908484:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616608000 00000100:00100000:2.0:1790946256.908497:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616607872 00000100:00100000:2.0:1790946256.908499:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616607872 00000100:00100000:2.0:1790946256.908511:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:2.0:1790946256.908518:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:2404:x1877942616608000:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790946256.908548:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:2404:x1877942616608000:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 31us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946256.908555:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:2.0:1790946256.908565:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:2.0:1790946256.908571:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+7:2403:x1877942616607872:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790946256.908603:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+7:2403:x1877942616607872:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 32us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946256.908609:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:2.0:1790946256.908621:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:2.0:1790946256.908625:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1877942616607232:12345-192.168.204.20@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790946256.908659:0:22726:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from a9f48c6e-ea20-465c-a9e8-4a851f3ac66f@192.168.204.20@tcp t0 exp 0000000000000000 cur 707 last 0 00000020:00000080:2.0:1790946256.908694:0:22726:0:(genops.c:1384:class_connect()) connect: client a9f48c6e-ea20-465c-a9e8-4a851f3ac66f, cookie 0xd9f4181e0d27f055 00000004:00100000:2.0:1790946256.908717:0:22726:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790946256.908816:0:22726:0:(import.c:65:import_set_state_nolock()) ffff9d3f8275e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790946256.908856:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+6:2400:x1877942616607232:12345-192.168.204.20@tcp:38:mount.lustre.0 Request processed in 229us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946256.908862:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:2.0:1790946256.908875:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:2.0:1790946256.908879:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1877942616607488:12345-192.168.204.20@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790946256.908893:0:22726:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from a9f48c6e-ea20-465c-a9e8-4a851f3ac66f@192.168.204.20@tcp t0 exp 0000000000000000 cur 707 last 0 00000020:00000080:2.0:1790946256.908913:0:22726:0:(genops.c:1384:class_connect()) connect: client a9f48c6e-ea20-465c-a9e8-4a851f3ac66f, cookie 0xd9f4181e0d27f05c 00000004:00100000:2.0:1790946256.908924:0:22726:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790946256.908967:0:22726:0:(import.c:65:import_set_state_nolock()) ffff9d3f826b4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790946256.908989:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+6:2400:x1877942616607488:12345-192.168.204.20@tcp:38:mount.lustre.0 Request processed in 108us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946256.908995:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:1.0:1790946256.922849:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946256.923006:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616607616 00000100:00100000:2.0:1790946256.923017:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616607616 00000100:00100000:2.0:1790946256.923159:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:2.0:1790946256.923237:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+6:0:x1877942616607616:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790946256.923272:0:22726:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790946256.923348:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+6:0:x1877942616607616:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 124us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946256.923356:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00080000:3.0:1790946256.923415:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790946256.927361:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946256.927977:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616607360 00000100:00100000:0.0:1790946256.927988:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616607360 00000100:00100000:0.0:1790946256.928079:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:0.0:1790946256.928089:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+6:0:x1877942616607360:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790946256.928133:0:24257:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790946256.928272:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+6:0:x1877942616607360:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 183us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946256.928280:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00080000:3.0:1790946256.928403:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946256.937207:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946256.938079:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616607744 00000100:00100000:0.0:1790946256.938092:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616607744 00000100:00100000:0.0:1790946256.938165:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:0.0:1790946256.938211:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+6:18155:x1877942616607744:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790946256.938248:0:22724:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790946256.938345:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+6:18155:x1877942616607744:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 137us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946256.938357:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:2.0:1790946256.941618:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946256.941961:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616608384 00000100:00100000:0.0:1790946256.941972:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616608384 00000100:00100000:0.0:1790946256.942041:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:0.0:1790946256.942067:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+6:18155:x1877942616608384:12345-192.168.204.20@tcp:40:mount.lustre.0 00000100:00100000:0.0:1790946256.942208:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+6:18155:x1877942616608384:12345-192.168.204.20@tcp:40:mount.lustre.0 Request processed in 102us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946256.942217:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:3.0:1790946256.948076:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946256.948127:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946256.948209:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946256.948462:0:25123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616608512 00000100:00100000:1.0:1790946256.948484:0:25123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616608512 00000100:00100000:1.0:1790946256.948533:0:25123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616608640 00000100:00100000:1.0:1790946256.948537:0:25123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616608640 00000100:00100000:1.0:1790946256.948560:0:25123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:1.0:1790946256.948582:0:25123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2400:x1877942616608512:12345-192.168.204.20@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790946256.948618:0:25123:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from a9f48c6e-ea20-465c-a9e8-4a851f3ac66f@192.168.204.20@tcp t0 exp 0000000000000000 cur 707 last 0 00000020:00000080:1.0:1790946256.948666:0:25123:0:(genops.c:1384:class_connect()) connect: client a9f48c6e-ea20-465c-a9e8-4a851f3ac66f, cookie 0xd9f4181e0d27f063 00002000:00100000:1.0:1790946256.948678:0:25123:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a9f48c6e-ea20-465c-a9e8-4a851f3ac66f/ffff9d3f8454d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790946256.948688:0:25123:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790946256.948757:0:25123:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790946256.948789:0:25123:0:(import.c:65:import_set_state_nolock()) ffff9d3f8454c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790946256.948889:0:25123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+6:2400:x1877942616608512:12345-192.168.204.20@tcp:8:mount.lustre.0 Request processed in 307us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946256.948898:0:25123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:1.0:1790946256.948919:0:25123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:1.0:1790946256.948924:0:25123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2400:x1877942616608640:12345-192.168.204.20@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790946256.948939:0:25123:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from a9f48c6e-ea20-465c-a9e8-4a851f3ac66f@192.168.204.20@tcp t0 exp 0000000000000000 cur 707 last 0 00000020:00000080:1.0:1790946256.948972:0:25123:0:(genops.c:1384:class_connect()) connect: client a9f48c6e-ea20-465c-a9e8-4a851f3ac66f, cookie 0xd9f4181e0d27f06a 00002000:00100000:1.0:1790946256.948978:0:25123:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a9f48c6e-ea20-465c-a9e8-4a851f3ac66f/ffff9d40884c2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790946256.948984:0:25123:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790946256.949016:0:25123:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790946256.949032:0:25123:0:(import.c:65:import_set_state_nolock()) ffff9d40884c3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790946256.949058:0:25123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+6:2400:x1877942616608640:12345-192.168.204.20@tcp:8:mount.lustre.0 Request processed in 132us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946256.949064:0:25123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:0.0:1790946256.950107:0:22735:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616608768 00000100:00100000:0.0:1790946256.950118:0:22735:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616608768 00000100:00100000:0.0:1790946256.950201:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:0.0:1790946256.950210:0:22735:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+6:18155:x1877942616608768:12345-192.168.204.20@tcp:900:mount.lustre.0 00000100:00100000:0.0:1790946256.950267:0:22735:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+6:18155:x1877942616608768:12345-192.168.204.20@tcp:900:mount.lustre.0 Request processed in 59us (2204us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946256.950274:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:3.0:1790946256.954991:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946256.955225:0:22728:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616608896 00000100:00100000:2.0:1790946256.955235:0:22728:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616608896 00000100:00100000:2.0:1790946256.955285:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:2.0:1790946256.955403:0:22728:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+6:18155:x1877942616608896:12345-192.168.204.20@tcp:33:mount.lustre.0 00000004:00200000:2.0:1790946256.955495:0:22728:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1790946256.955710:0:22728:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+6:18155:x1877942616608896:12345-192.168.204.20@tcp:33:mount.lustre.0 Request processed in 270us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946256.955720:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:2.0:1790946257.151190:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946257.151319:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616609024 00000100:00100000:0.0:1790946257.151330:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616609024 00000100:00100000:0.0:1790946257.151393:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:0.0:1790946257.151404:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+6:18188:x1877942616609024:12345-192.168.204.20@tcp:101:mkdir.0 00010000:00010000:0.0:1790946257.151425:0:22724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946257.151447:0:22724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f071 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c22233115d expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946257.151523:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f078 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946257.151537:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946257.151551:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946257.151630:0:22724:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790946257.151634:0:22724:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790946257.151656:0:22724:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946257.151684:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f071 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233115d expref: 8 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946257.151703:0:22724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f078 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233115d expref: 7 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946257.151712:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f8259fa00) 00010000:00010000:0.0:1790946257.151716:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790946257.151719:0:22724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d408630b200, rc 0) 00000100:00100000:0.0:1790946257.151789:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+7:18188:x1877942616609024:12345-192.168.204.20@tcp:101:mkdir.0 Request processed in 386us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946257.152126:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 22 00010000:00010000:0.0:1790946257.184918:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790946257.250083:0:23480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790946258.210862:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946259.231549:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946260.258230:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790946260.331093:0:25050:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a9f48c6e-ea20-465c-a9e8-4a851f3ac66f 00000001:00100000:1.0:1790946260.331106:0:25050:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 93f4dfa8-f0c5-48de-82e2-232116f1669e 00000001:00100000:2.0:1790946260.346673:0:23459:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a9f48c6e-ea20-465c-a9e8-4a851f3ac66f 00000001:00100000:2.0:1790946260.346687:0:23459:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 93f4dfa8-f0c5-48de-82e2-232116f1669e 00000001:00100000:1.0:1790946260.347108:0:24229:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a9f48c6e-ea20-465c-a9e8-4a851f3ac66f 00000001:00100000:1.0:1790946260.347122:0:24229:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 93f4dfa8-f0c5-48de-82e2-232116f1669e 00000001:00100000:1.0:1790946260.347807:0:22704:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a9f48c6e-ea20-465c-a9e8-4a851f3ac66f 00000001:00100000:1.0:1790946260.347816:0:22704:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 93f4dfa8-f0c5-48de-82e2-232116f1669e 00000001:02000400:3.0:1790946260.704950:0:25606:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1790946260.834211:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790946260.834237:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638732160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790946260.834313:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946260.834395:0:24237:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638732160 00000100:00100000:0.0:1790946260.834404:0:24237:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638732160 00000100:00100000:0.0:1790946260.834474:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790946260.834484:0:24237:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638732160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790946260.834514:0:24237:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790946260.834572:0:24237:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638732160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946260.834579:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1790946260.834602:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790946260.834809:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638732160:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1790946261.281491:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946261.344306:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638732288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790946261.344392:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946261.344489:0:23467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638732288 00000100:00100000:1.0:1790946261.344498:0:23467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638732288 00000100:00100000:1.0:1790946261.344557:0:23467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790946261.344567:0:23467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638732288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790946261.344603:0:23467:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790946261.344755:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638732416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790946261.344788:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946261.344830:0:22730:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638732416 00000100:00100000:2.0:1790946261.344834:0:22730:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638732416 00000100:00100000:2.0:1790946261.344855:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790946261.344861:0:22730:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638732416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790946261.344880:0:22730:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790946261.344932:0:22730:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638732416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946261.344940:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790946261.344985:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638732416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790946261.345596:0:23467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638732288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1028us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946261.345603:0:23467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790946261.345877:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638732288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790946261.855473:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638732544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946261.855548:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946261.855610:0:24236:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638732544 00000100:00100000:0.0:1790946261.855617:0:24236:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638732544 00000100:00100000:0.0:1790946261.855671:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790946261.855681:0:24236:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638732544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790946261.855720:0:24236:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1790946261.855780:0:24236:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638732544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946261.855787:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1790946261.855810:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790946261.855846:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638732544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790946261.856224:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638732672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790946261.856258:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946261.856294:0:24236:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638732672 00000100:00100000:1.0:1790946261.856298:0:24236:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638732672 00000100:00100000:1.0:1790946261.856330:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790946261.856337:0:24236:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638732672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790946261.856350:0:24236:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1790946261.856396:0:24236:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638732672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946261.856402:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1790946261.856418:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790946261.856441:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638732672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790946261.858541:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5c26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638732928:0@lo:400:kworker.0 00000100:00100000:0.0:1790946261.858601:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946261.858635:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638733440:0@lo:400:kworker.0 00000100:00100000:0.0:1790946261.858660:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946261.858685:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790946261.858690:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638733056:0@lo:400:kworker.0 00000100:00100000:0.0:1790946261.858891:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946261.858914:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638733568:0@lo:400:kworker.0 00000100:00100000:0.0:1790946261.858938:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946261.858973:0:24832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638732928 00000100:00100000:0.0:1790946261.858979:0:24832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638732928 00000100:00100000:0.0:1790946261.859025:0:24832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790946261.859033:0:24832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638732928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946261.859084:0:24832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638732928:12345-0@lo:400:kworker.0 Request processed in 52us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946261.859099:0:24832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790946261.859123:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638733440 00000100:00100000:0.0:1790946261.859127:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638733440 00000100:00100000:0.0:1790946261.859154:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638733056 00000100:00100000:0.0:1790946261.859157:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638733056 00000100:00100000:0.0:1790946261.859195:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638733568 00000100:00100000:0.0:1790946261.859198:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638733568 00000100:00100000:0.0:1790946261.859214:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790946261.859221:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638733440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946261.859253:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638733440:12345-0@lo:400:kworker.0 Request processed in 33us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946261.859259:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790946261.859272:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790946261.859278:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638733056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946261.859304:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638733056:12345-0@lo:400:kworker.0 Request processed in 27us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946261.859311:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790946261.859323:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790946261.859329:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638733568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946261.859357:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638733568:12345-0@lo:400:kworker.0 Request processed in 29us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946261.859363:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790946261.859494:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3650:1877942638732800:0@lo:400:kworker.0 00000100:00100000:1.0:1790946261.859530:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946261.859570:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638733312:0@lo:400:kworker.0 00000100:00100000:1.0:1790946261.859594:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946261.859610:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638733824:0@lo:400:kworker.0 00000100:00100000:1.0:1790946261.859634:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946261.859647:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790946261.859653:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5c26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638733184:0@lo:400:kworker.0 00000100:00100000:1.0:1790946261.859673:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946261.859691:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1877942638733696:0@lo:400:kworker.0 00000100:00100000:1.0:1790946261.859724:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946261.859761:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638732800 00000100:00100000:1.0:1790946261.859766:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638732800 00000100:00100000:1.0:1790946261.859797:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790946261.859804:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:3650:x1877942638732800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946261.859839:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:3650:x1877942638732800:12345-0@lo:400:kworker.0 Request processed in 35us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946261.859844:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790946261.859870:0:24233:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638733184 00000100:00100000:1.0:1790946261.859873:0:24233:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638733184 00000100:00100000:1.0:1790946261.859896:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790946261.859902:0:24233:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638733184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946261.859928:0:24233:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638733184:12345-0@lo:400:kworker.0 Request processed in 28us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946261.859934:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790946261.859951:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638733312 00000100:00100000:1.0:1790946261.859954:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638733312 00000100:00100000:1.0:1790946261.859968:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638733824 00000100:00100000:1.0:1790946261.859970:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638733824 00000100:00100000:1.0:1790946261.859992:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638733696 00000100:00100000:1.0:1790946261.859994:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638733696 00000100:00100000:1.0:1790946261.860006:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790946261.860011:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638733312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946261.860041:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877942638733312:12345-0@lo:400:kworker.0 Request processed in 31us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946261.860046:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790946261.860057:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790946261.860062:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638733824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946261.860087:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877942638733824:12345-0@lo:400:kworker.0 Request processed in 25us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946261.860092:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790946261.860101:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790946261.860107:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877942638733696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946261.860129:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877942638733696:12345-0@lo:400:kworker.0 Request processed in 23us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946261.860134:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1790946261.860150:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790946261.860155:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790946261.860157:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790946261.860209:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5c26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638733184:0@lo:400:kworker.0 00000100:00100000:1.0:1790946261.860218:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1877942638733696:0@lo:400:kworker.0 00000100:00100000:1.0:1790946261.860226:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3650:1877942638732800:0@lo:400:kworker.0 00000100:00100000:1.0:1790946261.860234:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877942638733312:0@lo:400:kworker.0 00010000:00080000:1.0:1790946261.860244:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f84530000 x1877942638733824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946261.860261:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1877942638733824:0@lo:400:kworker.0 00000100:00100000:1.0:1790946261.860330:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638733056:0@lo:400:kworker.0 00010000:00080000:1.0:1790946261.860341:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f84531500 x1877942638733568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946261.860349:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638733568:0@lo:400:kworker.0 00000100:00100000:1.0:1790946261.860360:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5c26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638732928:0@lo:400:kworker.0 00000100:00100000:1.0:1790946261.861065:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638733440:0@lo:400:kworker.0 00000100:00100000:0.0:1790946261.865701:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790946261.865755:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8450c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638733952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790946261.865835:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946261.865997:0:24236:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638733952 00000100:00100000:2.0:1790946261.866006:0:24236:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638733952 00000100:00100000:2.0:1790946261.866065:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790946261.866074:0:24236:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638733952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790946261.866097:0:24236:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790946261.866147:0:24236:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638733952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946261.866154:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790946261.866333:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8450c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638733952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790946262.094227:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946262.094270:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946262.094301:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946262.094323:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946262.094345:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946262.094379:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946262.094402:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946262.094423:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946262.094449:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946262.094480:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616609408 00000100:00100000:2.0:1790946262.094489:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616609408 00000100:00100000:2.0:1790946262.094542:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616609920 00000100:00100000:2.0:1790946262.094546:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616609920 00000100:00100000:2.0:1790946262.094574:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616609280 00000100:00100000:2.0:1790946262.094578:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616609280 00000100:00100000:2.0:1790946262.094589:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616609792 00000100:00100000:2.0:1790946262.094601:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616609792 00000100:00100000:2.0:1790946262.094636:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:2.0:1790946262.094647:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+5:2403:x1877942616609408:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790946262.094738:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+5:2403:x1877942616609408:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 82us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946262.094747:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:2.0:1790946262.094765:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 50 00000100:00100000:2.0:1790946262.094772:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+5:2403:x1877942616609920:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790946262.094798:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+5:2403:x1877942616609920:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 27us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946262.094805:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 50 00000100:00100000:2.0:1790946262.094816:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:2.0:1790946262.094821:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:2403:x1877942616609280:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790946262.094843:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:2403:x1877942616609280:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 21us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946262.094849:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:2.0:1790946262.094861:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:2.0:1790946262.094867:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+6:2403:x1877942616609792:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790946262.094890:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+6:2403:x1877942616609792:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 24us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946262.094897:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:2.0:1790946262.094916:0:24235:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616609664 00000100:00100000:2.0:1790946262.094920:0:24235:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616609664 00000100:00100000:2.0:1790946262.094946:0:24235:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616610176 00000100:00100000:2.0:1790946262.094956:0:24235:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616610176 00000100:00100000:2.0:1790946262.094972:0:24235:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616609536 00000100:00100000:2.0:1790946262.094974:0:24235:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616609536 00000100:00100000:2.0:1790946262.094986:0:24235:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616610048 00000100:00100000:2.0:1790946262.094988:0:24235:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616610048 00000100:00100000:2.0:1790946262.095002:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:2.0:1790946262.095008:0:24235:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8450f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+5:2403:x1877942616609664:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790946262.095035:0:24235:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8450f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+5:2403:x1877942616609664:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 28us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946262.095042:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:2.0:1790946262.095053:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:2.0:1790946262.095059:0:24235:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+5:2403:x1877942616610176:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790946262.095082:0:24235:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+5:2403:x1877942616610176:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 24us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946262.095088:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:2.0:1790946262.095099:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:2.0:1790946262.095105:0:24235:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+5:2403:x1877942616609536:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790946262.095128:0:24235:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+5:2403:x1877942616609536:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 24us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946262.095134:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:2.0:1790946262.095146:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:2.0:1790946262.095152:0:24235:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8441fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+5:2403:x1877942616610048:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790946262.095209:0:24235:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8441fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+5:2403:x1877942616610048:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 56us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946262.095215:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00080000:2.0:1790946262.095259:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790946262.095264:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790946262.095266:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790946262.095269:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790946262.095904:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616609152 00000100:00100000:0.0:1790946262.095912:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616609152 00000100:00100000:0.0:1790946262.095946:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 145 00000100:00100000:0.0:1790946262.095954:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bd124a6-b6bd-4e62-987b-f878bfee98e2+13:2403:x1877942616609152:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790946262.096000:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bd124a6-b6bd-4e62-987b-f878bfee98e2+13:2403:x1877942616609152:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 46us (1784us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946262.096006:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 145 00010000:00010000:0.0:1790946262.304077:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946263.327365:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790946263.842867:0:22760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790946264.352362:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790946264.879358:0:25754:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd87dda210 20000000:00000080:0.0:1790946264.879377:0:25754:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d408f047000 uarg=0000000000000000 20000000:01000000:0.0:1790946264.879433:0:25754:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790946264.879440:0:25754:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790946264.879445:0:25754:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1790946264.880062:0:25755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1790946264.880253:0:25754:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790946264.900487:0:25754:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790946264.900907:0:25754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27f07f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946264.900930:0:25754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3f83c65400/0xd9f4181e0d27ecdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ecd5 expref: 23 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946264.900938:0:25754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27ecea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ece3 expref: 23 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946264.900945:0:25754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40c21d6e00/0xd9f4181e0d27ed29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27ed22 expref: 23 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946264.900965:0:25754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d40813ff200/0xd9f4181e0d27edc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27edbc expref: 23 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946264.900974:0:25754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d408630ac00/0xd9f4181e0d27f00f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223310bc expref: 12 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946264.900982:0:25754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d408630ae00/0xd9f4181e0d27f04e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233112c expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946264.900989:0:25754:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27f07f lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946264.901036:0:25754:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d408630ae00/0xd9f4181e0d27f04e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233112c expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946264.901053:0:25754:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d408630ae00/0xd9f4181e0d27f04e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233112c expref: 12 pid: 22717 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946264.901069:0:25754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25754:1877942638734080:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790946264.901228:0:25754:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d408630ac00/0xd9f4181e0d27f00f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223310bc expref: 12 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946264.901236:0:25754:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d408630ac00/0xd9f4181e0d27f00f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223310bc expref: 12 pid: 22719 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946264.901245:0:25754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25754:1877942638734208:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790946264.901275:0:25754:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40813ff200/0xd9f4181e0d27edc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27edbc expref: 23 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946264.901294:0:25754:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40813ff200/0xd9f4181e0d27edc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27edbc expref: 23 pid: 22717 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946264.901303:0:25754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25754:1877942638734336:0@lo:104: 00000100:00100000:3.0:1790946264.901478:0:25754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790946264.901579:0:25754:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40c21d6e00/0xd9f4181e0d27ed29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27ed22 expref: 23 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946264.901590:0:25754:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40c21d6e00/0xd9f4181e0d27ed29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27ed22 expref: 23 pid: 22718 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946264.901599:0:25754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25754:1877942638734464:0@lo:104: 00000100:00100000:3.0:1790946264.901622:0:25754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790946264.905028:0:25754:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27ecea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27ece3 expref: 23 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946264.905050:0:25754:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27ecea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27ece3 expref: 23 pid: 22717 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946264.905066:0:25754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25754:1877942638734592:0@lo:104: 00000100:00100000:3.0:1790946264.905141:0:25754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946264.905748:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946264.905819:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946264.905848:0:23881:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616610304 00000100:00100000:1.0:1790946264.905857:0:23881:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616610304 00010000:00010000:1.0:1790946264.905892:0:23881:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d408630ae00/0xd9f4181e0d27f04e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233112c expref: 13 pid: 22717 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946264.905919:0:23881:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616610432 00000100:00100000:1.0:1790946264.905922:0:23881:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616610432 00010000:00010000:1.0:1790946264.905935:0:23881:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d408630ac00/0xd9f4181e0d27f00f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223310bc expref: 14 pid: 22719 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946264.905956:0:23881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:1.0:1790946264.905965:0:23881:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bd124a6-b6bd-4e62-987b-f878bfee98e2+14:2404:x1877942616610304:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946264.905978:0:23881:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946264.905994:0:23881:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d408630ae00/0xd9f4181e0d27f04e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233112c expref: 14 pid: 22717 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946264.906006:0:23881:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d408630ae00/0xd9f4181e0d27f04e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233112c expref: 14 pid: 22717 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946264.906024:0:23881:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946264.906069:0:23881:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bd124a6-b6bd-4e62-987b-f878bfee98e2+14:2404:x1877942616610304:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 105us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946264.906078:0:23881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:1.0:1790946264.906096:0:23881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:1.0:1790946264.906103:0:23881:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bd124a6-b6bd-4e62-987b-f878bfee98e2+13:2404:x1877942616610432:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946264.906127:0:23881:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946264.906132:0:23881:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d408630ac00/0xd9f4181e0d27f00f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223310bc expref: 13 pid: 22719 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946264.906141:0:23881:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d408630ac00/0xd9f4181e0d27f00f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223310bc expref: 13 pid: 22719 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946264.906150:0:23881:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946264.906189:0:23881:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bd124a6-b6bd-4e62-987b-f878bfee98e2+13:2404:x1877942616610432:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 66us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946264.906196:0:23881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:0.0:1790946264.906628:0:22708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638734336 00000100:00100000:0.0:1790946264.906634:0:22708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638734336 00000100:00100000:1.0:1790946264.906786:0:22708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638734464 00000100:00100000:1.0:1790946264.906791:0:22708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638734464 00000100:00100000:1.0:1790946264.906806:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790946264.906812:0:22708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+4:25754:x1877942638734336:12345-0@lo:104: 00010000:00010000:1.0:1790946264.906825:0:22708:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27edbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27edc3 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946264.906914:0:22708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790946264.906920:0:22708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+4:25754:x1877942638734336:12345-0@lo:104: Request processed in 108us (5445us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946264.906928:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790946264.906942:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790946264.906948:0:22708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+3:25754:x1877942638734464:12345-0@lo:104: 00010000:00010000:1.0:1790946264.906957:0:22708:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27ed22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ed29 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946264.906992:0:22708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790946264.906997:0:22708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+3:25754:x1877942638734464:12345-0@lo:104: Request processed in 50us (5374us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946264.907002:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1790946264.907020:0:22713:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790946264.907026:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27edbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27edc3 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946264.907032:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40813ff000 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:1.0:1790946264.907037:0:22713:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27edbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27edc3 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946264.907047:0:22713:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27edbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27edc3 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790946264.907055:0:22713:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27edbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27edc3 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946264.907061:0:22713:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790946264.907100:0:22713:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27edbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27edc3 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946264.907190:0:22713:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790946264.907214:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27edbc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27edc3 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946264.907221:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40813ff000/0xd9f4181e0d27edbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27edc3 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946264.907307:0:23880:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946264.907371:0:23880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27ed22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ed29 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946264.907378:0:23880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d7600 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790946264.907381:0:23880:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27ed22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27ed29 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946264.907388:0:23880:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27ed22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27ed29 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946264.907394:0:23880:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27ed22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27ed29 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946264.907416:0:23880:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790946264.907432:0:23880:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27ed22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ed29 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946264.907439:0:23880:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790946264.907454:0:23880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27ed22 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ed29 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946264.907460:0:23880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7600/0xd9f4181e0d27ed22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ed29 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946264.907473:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946264.907475:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946264.907476:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946264.907512:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946264.907513:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946264.907515:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946264.907536:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3648:1877942638734720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790946264.907572:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946264.907627:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3649:1877942638734848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790946264.907649:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946264.907905:0:23881:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638734720 00000100:00100000:0.0:1790946264.907911:0:23881:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638734720 00010000:00010000:0.0:1790946264.907931:0:23881:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40813ff200/0xd9f4181e0d27edc3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27edbc expref: 24 pid: 22717 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946264.908036:0:25754:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3f83c65400/0xd9f4181e0d27ecdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd9f4181e0d27ecd5 expref: 24 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946264.908047:0:25754:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3f83c65400/0xd9f4181e0d27ecdc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd9f4181e0d27ecd5 expref: 24 pid: 22718 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946264.908057:0:25754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25754:1877942638734976:0@lo:104: 00000100:00100000:3.0:1790946264.908090:0:25754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946264.908126:0:23881:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638734848 00000100:00100000:0.0:1790946264.908130:0:23881:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638734848 00010000:00010000:0.0:1790946264.908142:0:23881:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40c21d6e00/0xd9f4181e0d27ed29 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ed22 expref: 25 pid: 22718 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946264.908161:0:23881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790946264.908186:0:23881:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32dbedc5-819a-4eba-958c-cd7c205dd6c7+25:3648:x1877942638734720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790946264.908196:0:23881:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946264.908201:0:23881:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40813ff200/0xd9f4181e0d27edc3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27edbc expref: 25 pid: 22717 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946264.908222:0:23881:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40813ff200/0xd9f4181e0d27edc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27edbc expref: 25 pid: 22717 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946264.908236:0:23881:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946264.908269:0:23881:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32dbedc5-819a-4eba-958c-cd7c205dd6c7+25:3648:x1877942638734720:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946264.908276:0:23881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790946264.908291:0:23881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790946264.908297:0:23881:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:3649:x1877942638734848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790946264.908305:0:23881:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946264.908321:0:23881:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40c21d6e00/0xd9f4181e0d27ed29 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ed22 expref: 24 pid: 22718 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946264.908330:0:23881:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40c21d6e00/0xd9f4181e0d27ed29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27ed22 expref: 24 pid: 22718 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946264.908339:0:23881:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946264.908365:0:23881:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:3649:x1877942638734848:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946264.908371:0:23881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790946264.908525:0:22707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638734592 00000100:00100000:2.0:1790946264.908531:0:22707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638734592 00000100:00100000:2.0:1790946264.908554:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790946264.908561:0:22707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+3:25754:x1877942638734592:12345-0@lo:104: 00010000:00010000:2.0:1790946264.908571:0:22707:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40baef0000/0xd9f4181e0d27ece3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ecea expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946264.908616:0:22707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790946264.908621:0:22707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+3:25754:x1877942638734592:12345-0@lo:104: Request processed in 61us (3481us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946264.908627:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1790946264.908684:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946264.908690:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40baef0000/0xd9f4181e0d27ece3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ecea expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946264.908697:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef0000 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:0.0:1790946264.908701:0:22712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef0000/0xd9f4181e0d27ece3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27ecea expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946264.908719:0:22712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40baef0000/0xd9f4181e0d27ece3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27ecea expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946264.908725:0:22712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40baef0000/0xd9f4181e0d27ece3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27ecea expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946264.908730:0:22712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790946264.908758:0:22712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40baef0000/0xd9f4181e0d27ece3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ecea expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946264.908765:0:22712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790946264.908774:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40baef0000/0xd9f4181e0d27ece3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ecea expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946264.908780:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40baef0000/0xd9f4181e0d27ece3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ecea expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946264.908792:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946264.908794:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946264.908795:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946264.911263:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3650:1877942638735104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790946264.911355:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946264.911414:0:23881:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638735104 00000100:00100000:0.0:1790946264.911422:0:23881:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638735104 00010000:00010000:0.0:1790946264.911455:0:23881:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27ecea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ece3 expref: 24 pid: 22717 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946264.911485:0:23881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790946264.911493:0:23881:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a71ea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:3650:x1877942638735104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790946264.911523:0:23881:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946264.911530:0:23881:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27ecea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ece3 expref: 24 pid: 22717 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946264.911541:0:23881:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27ecea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27ece3 expref: 24 pid: 22717 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946264.911560:0:23881:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946264.911594:0:23881:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a71ea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:3650:x1877942638735104:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946264.911601:0:23881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790946264.911669:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3650:1877942638735104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790946264.912406:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3648:1877942638734720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790946264.912431:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3649:1877942638734848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790946264.912607:0:25754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4c20600 going to sleep for 11 seconds 00010000:00010000:3.0:1790946264.912625:0:25754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d408630ae00/0xd9f4181e0d27f04e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233112c expref: 12 pid: 22717 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946264.912639:0:25754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25754:1877942638734080:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790946264.912650:0:25754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d408630ac00/0xd9f4181e0d27f00f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223310bc expref: 11 pid: 22719 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946264.912659:0:25754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25754:1877942638734208:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790946264.912669:0:25754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40813ff200/0xd9f4181e0d27edc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27edbc expref: 23 pid: 22717 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946264.912692:0:25754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25754:1877942638734336:0@lo:104: 00010000:00010000:3.0:1790946264.912704:0:25754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d6e00/0xd9f4181e0d27ed29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27ed22 expref: 22 pid: 22718 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946264.912712:0:25754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25754:1877942638734464:0@lo:104: 00010000:00010000:3.0:1790946264.912722:0:25754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40c21d7c00/0xd9f4181e0d27ecea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27ece3 expref: 21 pid: 22717 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946264.912730:0:25754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25754:1877942638734592:0@lo:104: 00000100:00100000:2.0:1790946264.912845:0:22707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638734976 00000100:00100000:2.0:1790946264.912852:0:22707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638734976 00000100:00100000:3.0:1790946264.912996:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790946264.913007:0:22707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+3:25754:x1877942638734976:12345-0@lo:104: 00010000:00010000:3.0:1790946264.913022:0:22707:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27ecd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ecdc expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946264.913105:0:22707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790946264.913130:0:22707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+3:25754:x1877942638734976:12345-0@lo:104: Request processed in 126us (5039us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946264.913138:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790946264.913217:0:25754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25754:1877942638734976:0@lo:104: 00010000:00010000:1.0:1790946264.913245:0:25754:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27f07f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946264.913441:0:23880:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946264.913448:0:23880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27ecd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd9f4181e0d27ecdc expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946264.913456:0:23880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40c21d7000 already unused, calling callback (ffffffffc137ac20) 10000000:00010000:2.0:1790946264.913461:0:23880:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27ecd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd9f4181e0d27ecdc expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946264.913469:0:23880:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27ecd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd9f4181e0d27ecdc expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946264.913477:0:23880:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27ecd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd9f4181e0d27ecdc expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946264.913491:0:23880:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790946264.913530:0:23880:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27ecd5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ecdc expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946264.913537:0:23880:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946264.913561:0:23880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27ecd5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ecdc expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946264.913568:0:23880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9d40c21d7000/0xd9f4181e0d27ecd5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd9f4181e0d27ecdc expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946264.913585:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946264.913587:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946264.913589:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946264.913608:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f8312c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3647:1877942638735232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790946264.913648:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946264.913695:0:23881:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638735232 00000100:00100000:2.0:1790946264.913699:0:23881:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638735232 00010000:00010000:2.0:1790946264.913716:0:23881:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3f83c65400/0xd9f4181e0d27ecdc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ecd5 expref: 21 pid: 22718 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946264.913738:0:23881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790946264.913746:0:23881:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8312f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:3647:x1877942638735232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790946264.913756:0:23881:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946264.913761:0:23881:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3f83c65400/0xd9f4181e0d27ecdc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd9f4181e0d27ecd5 expref: 21 pid: 22718 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946264.913772:0:23881:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3f83c65400/0xd9f4181e0d27ecdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd9f4181e0d27ecd5 expref: 21 pid: 22718 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946264.913792:0:23881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3f83c65400/0xd9f4181e0d27ecdc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd9f4181e0d27ecd5 expref: 21 pid: 22718 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946264.913804:0:23881:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27f07f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946264.913812:0:23881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27f07f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946264.913825:0:23881:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27f07f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946264.913832:0:23881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27f07f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946264.913839:0:23881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27f07f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946264.913846:0:23881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27f07f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946264.913852:0:23881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1e00 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946264.913855:0:23881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27f07f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946264.913863:0:23881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27f07f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946264.913874:0:23881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27f07f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946264.913894:0:23881:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946264.913925:0:23881:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8312f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32dbedc5-819a-4eba-958c-cd7c205dd6c7+20:3647:x1877942638735232:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946264.913932:0:23881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790946264.913962:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f8312c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3647:1877942638735232:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790946264.914118:0:25754:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27f07f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946264.914126:0:25754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27f07f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946264.914142:0:25754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d40baef1e00/0xd9f4181e0d27f07f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946265.375462:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946265.952101:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638735360:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790946265.952209:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946265.952339:0:24236:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638735360 00000100:00100000:1.0:1790946265.952349:0:24236:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638735360 00000100:00100000:1.0:1790946265.952417:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790946265.952430:0:24236:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8312c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638735360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790946265.952458:0:24236:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790946265.952519:0:24236:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8312c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638735360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946265.952526:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790946265.952571:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638735360:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1790946265.953039:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:2.0:1790946266.207281:0:22721:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790946266.207290:0:22721:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3f826b5000 from 13 10000000:01000000:2.0:1790946266.207295:0:22721:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790946266.207346:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afda00/0xd9f4181e0d27f086 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.207368:0:22721:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4092afda00/0xd9f4181e0d27f086 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.207380:0:22721:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4092afda00/0xd9f4181e0d27f086 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946266.207406:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638735488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790946266.207477:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946266.207524:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d07840 going to sleep for 11 seconds 00000100:00100000:0.0:1790946266.208452:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638735488 00000100:00100000:0.0:1790946266.208462:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638735488 00000100:00100000:0.0:1790946266.208526:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790946266.208536:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+20:22721:x1877942638735488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946266.208551:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946266.208567:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d408630b600/0xd9f4181e0d27f08d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27f086 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.208591:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d408630b600/0xd9f4181e0d27f08d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27f086 expref: 21 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.208601:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d408630b600/0xd9f4181e0d27f08d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27f086 expref: 21 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.208610:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d408630b600, rc 0) 00000100:00100000:0.0:1790946266.208694:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:22721:x1877942638735488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946266.208713:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790946266.211912:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638735488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946266.211942:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4092afda00/0xd9f4181e0d27f086 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27f08d expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946266.211954:0:22721:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4092afda00/0xd9f4181e0d27f086 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27f08d expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946266.212050:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638735616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946266.212113:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946266.212197:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4c20c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790946266.212271:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638735616 00000100:00100000:1.0:1790946266.212277:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638735616 00000100:00100000:1.0:1790946266.212323:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790946266.212332:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:22721:x1877942638735616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946266.212465:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:22721:x1877942638735616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946266.212473:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790946266.212548:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638735616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946266.212575:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638735744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790946266.212631:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946266.212666:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4c20c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790946266.212769:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638735744 00000100:00100000:1.0:1790946266.212774:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638735744 00000100:00100000:1.0:1790946266.212792:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1790946266.212798:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:22721:x1877942638735744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790946266.212885:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:22721:x1877942638735744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946266.212898:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1790946266.213113:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638735744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790946266.214003:0:25767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1790946266.214236:0:22721:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1790946266.214257:0:22721:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790946266.214267:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afda00/0xd9f4181e0d27f086 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27f08d expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.214289:0:22721:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4092afda00/0xd9f4181e0d27f086 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27f08d expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946266.214299:0:22721:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790946266.214301:0:22721:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d40bfee6800 from 13 10000000:01000000:2.0:1790946266.214304:0:22721:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790946266.214333:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afce00/0xd9f4181e0d27f094 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.214340:0:22721:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4092afce00/0xd9f4181e0d27f094 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.214360:0:22721:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4092afce00/0xd9f4181e0d27f094 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946266.214377:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84417800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638735872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790946266.214421:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946266.214455:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d07d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790946266.214511:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638735872 00000100:00100000:1.0:1790946266.214517:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638735872 00000100:00100000:1.0:1790946266.214554:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1790946266.214562:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+21:22721:x1877942638735872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946266.214573:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946266.214584:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4080030800/0xd9f4181e0d27f09b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27f094 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.214604:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4080030800/0xd9f4181e0d27f09b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27f094 expref: 22 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.214624:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4080030800/0xd9f4181e0d27f09b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27f094 expref: 22 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.214632:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080030800, rc 0) 00000100:00100000:1.0:1790946266.214677:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+22:22721:x1877942638735872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946266.214683:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790946266.214886:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84417800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638735872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946266.214899:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4092afce00/0xd9f4181e0d27f094 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27f09b expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946266.214908:0:22721:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4092afce00/0xd9f4181e0d27f094 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27f09b expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946266.214970:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638736000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946266.214998:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946266.215012:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4c20d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790946266.215064:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638736000 00000100:00100000:2.0:1790946266.215069:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638736000 00000100:00100000:2.0:1790946266.215090:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1790946266.215096:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b4dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+22:22721:x1877942638736000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790946266.215221:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b4dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+22:22721:x1877942638736000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946266.215228:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790946266.215416:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638736000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946266.215445:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f81bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638736128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790946266.215482:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946266.215546:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4c20d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790946266.216593:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638736128 00000100:00100000:2.0:1790946266.216600:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638736128 00000100:00100000:2.0:1790946266.216805:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1790946266.216826:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4090317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+22:22721:x1877942638736128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790946266.217040:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4090317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+22:22721:x1877942638736128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 216us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946266.217049:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790946266.218077:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f81bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638736128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790946266.219154:0:25768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1790946266.230868:0:22721:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1790946266.230913:0:22721:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790946266.230925:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afce00/0xd9f4181e0d27f094 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27f09b expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.230939:0:22721:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4092afce00/0xd9f4181e0d27f094 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27f09b expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946266.230951:0:22721:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790946266.230954:0:22721:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d4096c6b800 from 13 10000000:01000000:2.0:1790946266.230957:0:22721:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790946266.231001:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afc400/0xd9f4181e0d27f0a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.231010:0:22721:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4092afc400/0xd9f4181e0d27f0a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.231036:0:22721:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4092afc400/0xd9f4181e0d27f0a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946266.231063:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638736256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790946266.231135:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946266.231216:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d07d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790946266.231298:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638736256 00000100:00100000:0.0:1790946266.231306:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638736256 00000100:00100000:0.0:1790946266.231359:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790946266.231370:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4090317050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+22:22721:x1877942638736256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946266.231383:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946266.231395:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d408630b800/0xd9f4181e0d27f0a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27f0a2 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.231418:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d408630b800/0xd9f4181e0d27f0a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27f0a2 expref: 23 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.231429:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d408630b800/0xd9f4181e0d27f0a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27f0a2 expref: 23 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.231438:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d408630b800, rc 0) 00000100:00100000:0.0:1790946266.231483:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4090317050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+23:22721:x1877942638736256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946266.231490:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1790946266.231662:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638736256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790946266.231677:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4092afc400/0xd9f4181e0d27f0a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27f0a9 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.231699:0:22721:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4092afc400/0xd9f4181e0d27f0a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27f0a9 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946266.231759:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638736384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790946266.231788:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946266.231822:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d07d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790946266.231936:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638736384 00000100:00100000:0.0:1790946266.231941:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638736384 00000100:00100000:0.0:1790946266.231972:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790946266.231980:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4090314c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+23:22721:x1877942638736384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790946266.232094:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4090314c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32dbedc5-819a-4eba-958c-cd7c205dd6c7+23:22721:x1877942638736384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946266.232101:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790946266.232275:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638736384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790946266.232304:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638736512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790946266.232344:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946266.233033:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d07d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790946266.237104:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638736512 00000100:00100000:0.0:1790946266.237121:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638736512 00000100:00100000:0.0:1790946266.237287:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790946266.237298:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4090315450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+23:22721:x1877942638736512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790946266.237476:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4090315450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+23:22721:x1877942638736512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (5130us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946266.237484:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1790946266.237583:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638736512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790946266.242565:0:25769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790946266.246975:0:22721:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790946266.247742:0:22721:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790946266.247757:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afc400/0xd9f4181e0d27f0a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27f0a9 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946266.247771:0:22721:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4092afc400/0xd9f4181e0d27f0a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27f0a9 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946266.254294:0:22721:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790946266.254303:0:22721:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d3f83705800 from 13 10000000:01000000:2.0:1790946266.254309:0:22721:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790946266.254357:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afd200/0xd9f4181e0d27f0b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.254369:0:22721:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9d4092afd200/0xd9f4181e0d27f0b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.254383:0:22721:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9d4092afd200/0xd9f4181e0d27f0b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946266.254413:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638736640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790946266.254493:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946266.254801:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d07840 going to sleep for 11 seconds 00000100:00100000:0.0:1790946266.255415:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638736640 00000100:00100000:0.0:1790946266.255425:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638736640 00000100:00100000:1.0:1790946266.255555:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790946266.255566:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4090315c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+23:22721:x1877942638736640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946266.255581:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946266.255597:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4080031400/0xd9f4181e0d27f0b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd9f4181e0d27f0b0 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.255633:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4080031400/0xd9f4181e0d27f0b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd9f4181e0d27f0b0 expref: 24 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.255669:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4080031400/0xd9f4181e0d27f0b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd9f4181e0d27f0b0 expref: 24 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.255679:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080031400, rc 0) 00000100:00100000:1.0:1790946266.255939:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4090315c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:22721:x1877942638736640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 374us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946266.255947:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790946266.256162:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638736640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790946266.256207:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9d4092afd200/0xd9f4181e0d27f0b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27f0b7 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.256216:0:22721:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9d4092afd200/0xd9f4181e0d27f0b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd9f4181e0d27f0b7 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946266.256282:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638736768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790946266.256316:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946266.256345:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d07840 going to sleep for 11 seconds 00000100:00100000:0.0:1790946266.256406:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638736768 00000100:00100000:0.0:1790946266.256411:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638736768 00000100:00100000:0.0:1790946266.256449:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790946266.256456:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40929a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:22721:x1877942638736768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790946266.256569:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40929a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:22721:x1877942638736768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946266.256585:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790946266.256984:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638736768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790946266.257025:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638736896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790946266.257072:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946266.257106:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d07840 going to sleep for 11 seconds 00000100:00100000:3.0:1790946266.257232:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638736896 00000100:00100000:3.0:1790946266.257238:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638736896 00000100:00100000:3.0:1790946266.257271:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790946266.257277:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40929a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:22721:x1877942638736896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790946266.257364:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40929a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:22721:x1877942638736896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946266.257371:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790946266.257529:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32dbedc5-819a-4eba-958c-cd7c205dd6c7:22721:1877942638736896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790946266.258530:0:25770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790946266.258994:0:22721:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790946266.259040:0:22721:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790946266.259053:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9d4092afd200/0xd9f4181e0d27f0b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27f0b7 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946266.259063:0:22721:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9d4092afd200/0xd9f4181e0d27f0b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd9f4181e0d27f0b7 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946266.346275:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946266.346374:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616610560 00000100:00100000:2.0:1790946266.346385:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616610560 00000100:00100000:2.0:1790946266.346585:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:2.0:1790946266.346598:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:18656:x1877942616610560:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790946266.346620:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946266.346653:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27f0be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331164 expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.346723:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27f0c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790946266.346843:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790946266.346938:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27f0c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.346953:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27f0c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.346972:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27f0cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.346980:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27f0cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.346988:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27f0cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.347080:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27f0d3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.347089:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27f0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.347097:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27f0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946266.347131:0:22725:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790946266.347135:0:22725:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790946266.348057:0:22725:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27f0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.348079:0:22725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27f0c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.348103:0:22725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27f0c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.348112:0:22725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27f0c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.348119:0:22725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afc600 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790946266.348124:0:22725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27f0c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.348133:0:22725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27f0c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.348147:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f8259fa00) 00010000:00010000:2.0:1790946266.348151:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946266.348155:0:22725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27f0c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.348162:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27f0c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.348216:0:22725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27f0cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.348223:0:22725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27f0cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.348229:0:22725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27f0cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.348234:0:22725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afde00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790946266.348244:0:22725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27f0cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.348251:0:22725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27f0cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.348260:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9d3f824e9c00) 00010000:00010000:2.0:1790946266.348263:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946266.348266:0:22725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27f0cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.348273:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27f0cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.348321:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27f0be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331164 expref: 8 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.348336:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afca00/0xd9f4181e0d27f0d3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331164 expref: 7 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.348344:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d3f824e9200) 00010000:00010000:2.0:1790946266.348346:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790946266.348348:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afca00, rc 0) 00000100:00100000:2.0:1790946266.348416:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+7:18656:x1877942616610560:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 1820us (2150us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946266.348424:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:1.0:1790946266.357491:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946266.357599:0:22736:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616610688 00000100:00100000:0.0:1790946266.357611:0:22736:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616610688 00000100:00100000:0.0:1790946266.357683:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:0.0:1790946266.357694:0:22736:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:93f4dfa8-f0c5-48de-82e2-232116f1669e+7:18656:x1877942616610688:12345-192.168.204.20@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1790946266.357785:0:22736:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:93f4dfa8-f0c5-48de-82e2-232116f1669e+7:18656:x1877942616610688:12345-192.168.204.20@tcp:900:lhsmtool_posix.0 Request processed in 93us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946266.357791:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:1.0:1790946266.360414:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946266.360517:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616610944 00000100:00100000:2.0:1790946266.360530:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616610944 00000100:00100000:2.0:1790946266.360594:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:2.0:1790946266.360604:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+7:18656:x1877942616610944:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790946266.360652:0:22726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946266.360676:0:22726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27f0da lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c22233116b expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.360764:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27f0e1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.360779:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27f0e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.360790:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27f0e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.360804:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27f0e8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.360810:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27f0e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.360817:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27f0e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.360924:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afdc00/0xd9f4181e0d27f0ef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.360933:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afdc00/0xd9f4181e0d27f0ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.360939:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afdc00/0xd9f4181e0d27f0ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946266.360948:0:22726:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1790946266.361104:0:22726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27f0e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.361113:0:22726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27f0e1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.361119:0:22726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27f0e1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.361125:0:22726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afde00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790946266.361129:0:22726:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27f0e1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.361137:0:22726:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27f0e1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.361148:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d3f824e9200) 00010000:00010000:2.0:1790946266.361151:0:22726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946266.361156:0:22726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27f0e1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.361162:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27f0e1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.361219:0:22726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27f0e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.361223:0:22726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27f0e8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.361229:0:22726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27f0e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.361242:0:22726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4092afc600 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790946266.361245:0:22726:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27f0e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.361250:0:22726:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27f0e8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.361258:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d3f824e9c00) 00010000:00010000:2.0:1790946266.361261:0:22726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946266.361263:0:22726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27f0e8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.361268:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27f0e8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.363745:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27f0da lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233116b expref: 10 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.363771:0:22726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afdc00/0xd9f4181e0d27f0ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233116b expref: 9 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.363781:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3f824e9e00) 00010000:00010000:2.0:1790946266.363784:0:22726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946266.363787:0:22726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afdc00, rc 0) 00000100:00100000:2.0:1790946266.363866:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+9:18656:x1877942616610944:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 3262us (3463us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1790946266.363875:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:3.0:1790946266.370145:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946266.370261:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616611072 00000100:00100000:0.0:1790946266.370273:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616611072 00000100:00100000:0.0:1790946266.370332:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:0.0:1790946266.370342:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+9:18656:x1877942616611072:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1790946266.370475:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+9:18656:x1877942616611072:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 Request processed in 133us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946266.370484:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:3.0:1790946266.372017:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946266.372257:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616611200 00000100:00100000:1.0:1790946266.372267:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616611200 00000100:00100000:1.0:1790946266.372365:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:1.0:1790946266.372378:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+5:18656:x1877942616611200:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1790946266.373038:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1790946266.379410:0:22724:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6993us 00000100:00100000:2.0:1790946266.398459:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+5:18656:x1877942616611200:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 Request processed in 26073us (26435us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946266.398612:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 26 00010000:00010000:0.0:1790946266.400268:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946266.431994:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946266.432405:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616611328 00000100:00100000:0.0:1790946266.432416:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616611328 00000100:00100000:0.0:1790946266.432481:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:0.0:1790946266.432492:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+9:18662:x1877942616611328:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1790946266.432514:0:24257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946266.432609:0:24257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f0fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331172 expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.432698:0:24257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f104 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.432716:0:24257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f104 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.432729:0:24257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f104 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.432745:0:24257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f10b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.432751:0:24257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f10b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.432757:0:24257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f10b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.432828:0:24257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f104 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.432835:0:24257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f104 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.432841:0:24257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f104 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.432846:0:24257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630a400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790946266.432850:0:24257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f104 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.432858:0:24257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f104 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.432871:0:24257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f8259fa00) 00010000:00010000:0.0:1790946266.432874:0:24257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946266.432879:0:24257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f104 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.432884:0:24257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f104 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.432899:0:24257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f10b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.432905:0:24257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f10b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.432910:0:24257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f10b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.432921:0:24257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630a800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790946266.432924:0:24257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f10b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.432930:0:24257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f10b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.432937:0:24257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9d40bc938400) 00010000:00010000:0.0:1790946266.432940:0:24257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946266.432943:0:24257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f10b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.432948:0:24257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f10b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.432985:0:24257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f0fd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331172 expref: 10 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.432995:0:24257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f8259fa00) 00010000:00010000:0.0:1790946266.432998:0:24257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946266.433001:0:24257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f0fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331172 expref: 10 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.433009:0:24257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d408630b000, rc 0) 00000100:00100000:0.0:1790946266.433366:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+9:18662:x1877942616611328:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 874us (1381us total) trans 0 rc 301/301 00000100:00100000:0.0:1790946266.433374:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:0.0:1790946266.441084:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946266.441420:0:22733:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616611456 00000100:00100000:1.0:1790946266.441431:0:22733:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616611456 00000100:00100000:1.0:1790946266.441543:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:1.0:1790946266.441555:0:22733:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:93f4dfa8-f0c5-48de-82e2-232116f1669e+9:18662:x1877942616611456:12345-192.168.204.20@tcp:700:lfs.0 00000100:00100000:1.0:1790946266.441674:0:22733:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:93f4dfa8-f0c5-48de-82e2-232116f1669e+9:18662:x1877942616611456:12345-192.168.204.20@tcp:700:lfs.0 Request processed in 120us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946266.441683:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:3.0:1790946266.444390:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946266.444738:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616611712 00000100:00100000:0.0:1790946266.444750:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616611712 00000100:00100000:0.0:1790946266.444812:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:0.0:1790946266.444822:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+9:18662:x1877942616611712:12345-192.168.204.20@tcp:36:lfs.0 00010000:00010000:0.0:1790946266.444874:0:22726:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946266.444903:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef0200/0xd9f4181e0d27f039 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223310ed expref: 9 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.444925:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f8259fa00) 00010000:00010000:0.0:1790946266.444930:0:22726:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790946266.444993:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f112 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.445007:0:22726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f078 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233115d expref: 5 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.445017:0:22726:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f112 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.445048:0:22726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f078 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233115d expref: 5 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.445062:0:22726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f078 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233115d expref: 5 pid: 22724 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946266.445076:0:22726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84533b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22726:1877942638737024:192.168.204.20@tcp:104: 00000100:00100000:0.0:1790946266.445222:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084352000 going to sleep for 11 seconds 00000100:00100000:0.0:1790946266.448157:0:22726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84533b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22726:1877942638737024:192.168.204.20@tcp:104: 00010000:00010000:0.0:1790946266.448500:0:22726:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f112 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946266.449403:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946266.449956:0:22710:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616611840 00000100:00100000:1.0:1790946266.449966:0:22710:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616611840 00010000:00010000:1.0:1790946266.450034:0:22710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f078 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233115d expref: 6 pid: 22724 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946266.450094:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:1.0:1790946266.450105:0:22710:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+6:2403:x1877942616611840:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946266.450122:0:22710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946266.450129:0:22710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f078 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233115d expref: 6 pid: 22724 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.450141:0:22710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f078 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233115d expref: 6 pid: 22724 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.450164:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f078 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233115d expref: 6 pid: 22724 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.450210:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f8259fa00) 00010000:00010000:1.0:1790946266.450216:0:22710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f112 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.450226:0:22710:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f112 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.450233:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f112 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.450261:0:22710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946266.450386:0:22710:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+5:2403:x1877942616611840:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 282us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946266.450394:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15 00010000:00010000:0.0:1790946266.451023:0:22726:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f112 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.451034:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f112 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.451059:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f119 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.451070:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f119 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.451080:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f119 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790946266.453390:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790946266.454776:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f120 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.454799:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f120 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.454810:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f120 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790946266.454827:0:22726:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000585c4c58 reply state 0000000092d5ca6f transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f120 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.454838:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f120 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.454857:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9d40bc938200) 00010000:00010000:0.0:1790946266.454860:0:22726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790946266.454864:0:22726:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790946266.454869:0:22726:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1790946266.454878:0:22726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f112 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.454885:0:22726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f112 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.454891:0:22726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f112 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.454897:0:22726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630b000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790946266.454901:0:22726:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f112 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.454909:0:22726:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f112 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.454918:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f8259fa00) 00010000:00010000:0.0:1790946266.454921:0:22726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946266.454925:0:22726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f112 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.454931:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f112 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790946266.454950:0:22726:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000585c4c58 reply state 0000000092d5ca6f transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f119 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.454970:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f119 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.454976:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9d40bc938400) 00010000:00010000:0.0:1790946266.454979:0:22726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790946266.454981:0:22726:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1790946266.455263:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+10:18662:x1877942616611712:12345-192.168.204.20@tcp:36:lfs.0 Request processed in 10436us (10875us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1790946266.455275:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:1.0:1790946266.463827:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638737152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790946266.463926:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946266.465469:0:22730:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638737152 00000100:00100000:0.0:1790946266.465485:0:22730:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638737152 00000100:00100000:0.0:1790946266.465550:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790946266.465560:0:22730:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638737152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790946266.465609:0:22730:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000040:00080000:3.0:1790946266.466721:0:23480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790946266.467345:0:22730:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638737152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1782us (3415us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946266.467357:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790946266.467397:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638737280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790946266.467448:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946266.467668:0:23467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638737280 00000100:00100000:3.0:1790946266.467676:0:23467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638737280 00000100:00100000:3.0:1790946266.467758:0:23467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790946266.467767:0:23467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638737280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790946266.467795:0:23467:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790946266.467931:0:23467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638737280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 165us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946266.467938:0:23467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790946266.468001:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638737280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790946266.469622:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638737152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790946266.535568:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946266.535681:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616611968 00000100:00100000:2.0:1790946266.535692:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616611968 00000100:00100000:2.0:1790946266.535757:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:2.0:1790946266.535767:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+10:18670:x1877942616611968:12345-192.168.204.20@tcp:101:lctl.0 00010000:00010000:2.0:1790946266.535791:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946266.535812:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27f127 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331179 expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.535879:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27f12e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.535892:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27f12e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.535903:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27f12e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946266.535945:0:22725:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790946266.535949:0:22725:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790946266.535986:0:22725:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27f12e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.536011:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27f127 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331179 expref: 12 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.536050:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afc600/0xd9f4181e0d27f12e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331179 expref: 11 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.536059:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824e9c00) 00010000:00010000:2.0:1790946266.536062:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790946266.536066:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afc600, rc 0) 00000100:00100000:2.0:1790946266.536130:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+11:18670:x1877942616611968:12345-192.168.204.20@tcp:101:lctl.0 Request processed in 363us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946266.536137:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:3.0:1790946266.563517:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946266.563773:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616612096 00000100:00100000:2.0:1790946266.563784:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616612096 00000100:00100000:2.0:1790946266.563847:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:2.0:1790946266.563857:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+5:18671:x1877942616612096:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790946266.563878:0:22724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946266.563899:0:22724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27f135 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331180 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.563965:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27f13c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.563979:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27f13c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.563991:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27f13c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946266.564034:0:22724:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790946266.564052:0:22724:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790946266.564074:0:22724:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27f13c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.564097:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd800/0xd9f4181e0d27f135 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331180 expref: 7 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.564116:0:22724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afde00/0xd9f4181e0d27f13c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331180 expref: 6 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.564124:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824e9c00) 00010000:00010000:2.0:1790946266.564126:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790946266.564129:0:22724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4092afde00, rc 0) 00000100:00100000:2.0:1790946266.564239:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+6:18671:x1877942616612096:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 384us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946266.564247:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:3.0:1790946266.567430:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946266.567832:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616612224 00000100:00100000:2.0:1790946266.567842:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616612224 00000100:00100000:2.0:1790946266.567895:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:2.0:1790946266.567905:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+6:18671:x1877942616612224:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790946266.567925:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946266.567943:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd400/0xd9f4181e0d27f143 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331187 expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568008:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f14a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568025:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f14a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568053:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f14a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568066:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f151 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568074:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568081:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568154:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f158 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568163:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f158 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568197:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f158 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946266.568251:0:22725:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790946266.568255:0:22725:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790946266.568286:0:22725:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f158 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568300:0:22725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f14a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568308:0:22725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f14a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568325:0:22725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f14a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568331:0:22725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790946266.568335:0:22725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f14a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568342:0:22725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f14a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568353:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824e9c00) 00010000:00010000:2.0:1790946266.568357:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946266.568361:0:22725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f14a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568367:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f14a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568772:0:22725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568781:0:22725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f151 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568787:0:22725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f151 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568792:0:22725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790946266.568795:0:22725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f151 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568812:0:22725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f151 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568821:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9d40bc938400) 00010000:00010000:2.0:1790946266.568823:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946266.568827:0:22725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f151 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568832:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f151 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568863:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4092afd400/0xd9f4181e0d27f143 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331187 expref: 8 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568876:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f158 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331187 expref: 7 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.568884:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9d40bc938200) 00010000:00010000:2.0:1790946266.568886:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790946266.568889:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65800, rc 0) 00000100:00100000:2.0:1790946266.568956:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+7:18671:x1877942616612224:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1052us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946266.568965:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:3.0:1790946266.571475:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946266.571708:0:22736:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616612352 00000100:00100000:2.0:1790946266.571718:0:22736:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616612352 00000100:00100000:2.0:1790946266.571772:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:2.0:1790946266.571781:0:22736:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+5:18671:x1877942616612352:12345-192.168.204.20@tcp:900:lfs.0 00000100:00100000:2.0:1790946266.571867:0:22736:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+5:18671:x1877942616612352:12345-192.168.204.20@tcp:900:lfs.0 Request processed in 86us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946266.571875:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00080000:3.0:1790946266.572818:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790946266.575460:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946266.576248:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616612608 00000100:00100000:2.0:1790946266.576259:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616612608 00000100:00100000:2.0:1790946266.576316:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:2.0:1790946266.576326:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+7:18671:x1877942616612608:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790946266.576348:0:22724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946266.576368:0:22724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f15f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c22233118e expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946266.576474:0:22724:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790946266.576593:0:22724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f15f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233118e expref: 9 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.576606:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824e9c00) 00010000:00010000:2.0:1790946266.576609:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790946266.576614:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f15f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233118e expref: 9 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.576627:0:22724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64800, rc 0) 00000100:00100000:2.0:1790946266.576704:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+8:18671:x1877942616612608:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 379us (1254us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1790946266.576712:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:3.0:1790946266.579740:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946266.579825:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616612864 00000100:00100000:0.0:1790946266.579835:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616612864 00000100:00100000:0.0:1790946266.579885:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:0.0:1790946266.579893:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+8:18671:x1877942616612864:12345-192.168.204.20@tcp:36:lfs.0 00010000:00010000:0.0:1790946266.579943:0:24257:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946266.579982:0:24257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f158 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331187 expref: 8 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.580002:0:24257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9d40bc938200) 00010000:00010000:0.0:1790946266.580006:0:24257:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790946266.580025:0:24257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630be00/0xd9f4181e0d27f16d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.580039:0:24257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630be00/0xd9f4181e0d27f16d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.580047:0:24257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630be00/0xd9f4181e0d27f16d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790946266.580258:0:24257:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000048750a7 reply state 000000000f8096df transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630be00/0xd9f4181e0d27f16d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.580271:0:24257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630be00/0xd9f4181e0d27f16d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.580288:0:24257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9d40bc938200) 00010000:00010000:0.0:1790946266.580291:0:24257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1790946266.580294:0:24257:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790946266.580301:0:24257:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1790946266.580374:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+9:18671:x1877942616612864:12345-192.168.204.20@tcp:36:lfs.0 Request processed in 481us (643us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1790946266.580388:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:3.0:1790946266.582368:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946266.582671:0:22727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616613120 00000100:00100000:1.0:1790946266.582681:0:22727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616613120 00000100:00100000:1.0:1790946266.582738:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:1.0:1790946266.582753:0:22727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+9:18671:x1877942616613120:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1790946266.582987:0:22727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+10:18671:x1877942616613120:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 235us (626us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1790946266.582995:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:3.0:1790946266.586003:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946266.586432:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616613376 00000100:00100000:2.0:1790946266.586442:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616613376 00000100:00100000:2.0:1790946266.586495:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:2.0:1790946266.586519:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+10:18671:x1877942616613376:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790946266.586545:0:22724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946266.586565:0:22724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f174 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331195 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.586659:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f17b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.586674:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f17b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.586685:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f17b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.586695:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f182 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.586701:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f182 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.586707:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f182 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946266.586808:0:22724:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790946266.586881:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f17b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.586889:0:22724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f17b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.586896:0:22724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f17b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.586913:0:22724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790946266.586918:0:22724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f17b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.586926:0:22724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f17b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.586938:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824e9c00) 00010000:00010000:2.0:1790946266.586941:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946266.586945:0:22724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f17b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.586951:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f17b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.586963:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f182 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.586969:0:22724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f182 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.586975:0:22724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f182 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.586981:0:22724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790946266.586983:0:22724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f182 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.586989:0:22724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f182 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.587007:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9d40bc938400) 00010000:00010000:2.0:1790946266.587009:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946266.587013:0:22724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f182 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.587019:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f182 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.587055:0:22724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f174 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331195 expref: 12 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.587064:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824e9c00) 00010000:00010000:2.0:1790946266.587066:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790946266.587069:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f174 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331195 expref: 12 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.587079:0:22724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64800, rc 0) 00000100:00100000:2.0:1790946266.587148:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+11:18671:x1877942616613376:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 630us (1154us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1790946266.587155:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:3.0:1790946266.589689:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946266.589915:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616613504 00000100:00100000:2.0:1790946266.589924:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616613504 00000100:00100000:2.0:1790946266.589971:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 35 00000100:00100000:2.0:1790946266.589980:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+11:18671:x1877942616613504:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790946266.590006:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946266.590026:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27f190 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c22233119c expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.590155:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f197 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.590197:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f197 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.590210:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f197 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946266.590346:0:22725:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790946266.590350:0:22725:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790946266.590369:0:22725:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f197 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.590461:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27f190 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233119c expref: 13 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.590481:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f197 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233119c expref: 12 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.590489:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9d40bc938200) 00010000:00010000:2.0:1790946266.590491:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790946266.590494:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65a00, rc 0) 00000100:00100000:2.0:1790946266.590597:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+12:18671:x1877942616613504:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 617us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946266.590604:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 35 00000100:00100000:3.0:1790946266.594134:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946266.594260:0:22727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616613632 00000100:00100000:1.0:1790946266.594271:0:22727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616613632 00000100:00100000:1.0:1790946266.594372:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:1.0:1790946266.594384:0:22727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+12:18671:x1877942616613632:12345-192.168.204.20@tcp:37:lfs.0 00000100:00100000:1.0:1790946266.600467:0:22727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+12:18671:x1877942616613632:12345-192.168.204.20@tcp:37:lfs.0 Request processed in 6075us (6330us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946266.600481:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:3.0:1790946266.603564:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946266.606729:0:22728:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616613888 00000100:00100000:2.0:1790946266.606744:0:22728:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616613888 00000100:00100000:0.0:1790946266.606994:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:0.0:1790946266.607006:0:22728:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfe66850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+12:18671:x1877942616613888:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:0.0:1790946266.607268:0:22728:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfe66850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+13:18671:x1877942616613888:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 263us (3713us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1790946266.607283:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:3.0:1790946266.664164:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946266.664341:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616614016 00000100:00100000:0.0:1790946266.664353:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616614016 00000100:00100000:0.0:1790946266.664416:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:0.0:1790946266.664426:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+11:18677:x1877942616614016:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1790946266.664447:0:22726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946266.664469:0:22726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f19e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c2223311a3 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664532:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f1a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664547:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f1a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664557:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f1a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664568:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f1ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664576:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f1ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664583:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f1ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664670:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ac00/0xd9f4181e0d27f1b3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664700:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ac00/0xd9f4181e0d27f1b3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664708:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ac00/0xd9f4181e0d27f1b3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946266.664744:0:22726:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790946266.664748:0:22726:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790946266.664787:0:22726:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ac00/0xd9f4181e0d27f1b3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664798:0:22726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f1a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664805:0:22726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f1a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664811:0:22726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f1a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664817:0:22726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630b200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790946266.664821:0:22726:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f1a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664828:0:22726:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f1a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664840:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824e9c00) 00010000:00010000:0.0:1790946266.664843:0:22726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946266.664848:0:22726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f1a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664864:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f1a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664878:0:22726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f1ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664883:0:22726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f1ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664889:0:22726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f1ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664893:0:22726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630aa00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790946266.664895:0:22726:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f1ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664901:0:22726:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f1ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664908:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9d40bc938400) 00010000:00010000:0.0:1790946266.664910:0:22726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946266.664913:0:22726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f1ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664917:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f1ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664940:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f19e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311a3 expref: 13 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664964:0:22726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ac00/0xd9f4181e0d27f1b3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311a3 expref: 12 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.664971:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9d40bc938200) 00010000:00010000:0.0:1790946266.664973:0:22726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790946266.664975:0:22726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d408630ac00, rc 0) 00000100:00100000:0.0:1790946266.665043:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+12:18677:x1877942616614016:12345-192.168.204.20@tcp:101:bash.0 Request processed in 617us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946266.665050:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:3.0:1790946266.667702:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946266.668376:0:22736:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616614144 00000100:00100000:2.0:1790946266.668388:0:22736:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616614144 00000100:00100000:3.0:1790946266.668651:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:3.0:1790946266.668663:0:22735:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:93f4dfa8-f0c5-48de-82e2-232116f1669e+5:18677:x1877942616614144:12345-192.168.204.20@tcp:900:bash.0 00000100:00100000:3.0:1790946266.668753:0:22735:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:93f4dfa8-f0c5-48de-82e2-232116f1669e+5:18677:x1877942616614144:12345-192.168.204.20@tcp:900:bash.0 Request processed in 93us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946266.668761:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:3.0:1790946266.670814:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946266.670890:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616614400 00000100:00100000:0.0:1790946266.670898:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616614400 00000100:00100000:0.0:1790946266.670958:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 37 00000100:00100000:0.0:1790946266.670988:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+12:18677:x1877942616614400:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1790946266.671007:0:24257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946266.671039:0:24257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a200/0xd9f4181e0d27f1ba lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c2223311aa expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.671140:0:24257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f1c1 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.671156:0:24257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f197 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233119c expref: 12 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.671188:0:24257:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f1c1 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.671223:0:24257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f197 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233119c expref: 12 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.671262:0:24257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f197 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233119c expref: 12 pid: 22725 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946266.671284:0:24257:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84533480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24257:1877942638737408:192.168.204.20@tcp:104: 00000100:00100000:0.0:1790946266.671376:0:24257:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d3f83588a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790946266.674318:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946266.674480:0:24257:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84533480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24257:1877942638737408:192.168.204.20@tcp:104: 00010000:00010000:2.0:1790946266.674510:0:24257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f1c1 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946266.675051:0:23881:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616614528 00000100:00100000:3.0:1790946266.675059:0:23881:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616614528 00010000:00010000:3.0:1790946266.675098:0:23881:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f197 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233119c expref: 13 pid: 22725 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946266.675137:0:23881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:3.0:1790946266.675145:0:23881:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84531f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+13:2403:x1877942616614528:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790946266.675161:0:23881:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946266.675199:0:23881:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f197 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233119c expref: 13 pid: 22725 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946266.675211:0:23881:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f197 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233119c expref: 13 pid: 22725 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946266.675230:0:23881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f197 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233119c expref: 13 pid: 22725 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946266.675270:0:23881:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9d40bc938200) 00010000:00010000:3.0:1790946266.675275:0:23881:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f1c1 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946266.675284:0:23881:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f1c1 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946266.675292:0:23881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f1c1 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946266.675312:0:23881:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946266.675421:0:23881:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84531f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+12:2403:x1877942616614528:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 276us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946266.675429:0:23881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00010000:00010000:0.0:1790946266.675678:0:24257:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f1c1 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.675686:0:24257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f1c1 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.675767:0:24257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f1c8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.675777:0:24257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f1c8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.675784:0:24257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f1c8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.676248:0:24257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f1cf lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.676259:0:24257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f1cf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.676267:0:24257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f1cf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946266.676302:0:24257:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790946266.676327:0:24257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f1c1 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.676335:0:24257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f1c1 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.676341:0:24257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f1c1 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.676346:0:24257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630bc00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790946266.676350:0:24257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f1c1 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.676357:0:24257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f1c1 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.676366:0:24257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9d40bc938200) 00010000:00010000:0.0:1790946266.676369:0:24257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946266.676373:0:24257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f1c1 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.676379:0:24257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f1c1 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790946266.676390:0:24257:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f990e768 reply state 00000000ce2d0851 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f1c8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.676400:0:24257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f1c8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.676423:0:24257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9d40bc938a00) 00010000:00010000:0.0:1790946266.676425:0:24257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790946266.676428:0:24257:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790946266.676461:0:24257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a200/0xd9f4181e0d27f1ba lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311aa expref: 15 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.676475:0:24257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f1cf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311aa expref: 14 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.676483:0:24257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:0.0:1790946266.676485:0:24257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1790946266.676487:0:24257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d408630aa00, rc 0) 00000100:00100000:0.0:1790946266.676531:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+15:18677:x1877942616614400:12345-192.168.204.20@tcp:101:bash.0 Request processed in 5546us (5726us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1790946266.676539:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 37 00000100:00100000:3.0:1790946266.690084:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946266.690560:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616614656 00000100:00100000:1.0:1790946266.690577:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616614656 00000100:00100000:1.0:1790946266.690853:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 158 00000100:00100000:1.0:1790946266.690866:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40929a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+11:18038:x1877942616614656:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946266.690885:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946266.690904:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4080031e00/0xd9f4181e0d27f1dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c2223311b1 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.690932:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4080031e00/0xd9f4181e0d27f1dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311b1 expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.690958:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4080031e00/0xd9f4181e0d27f1dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311b1 expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.690969:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080031e00, rc 0) 00000100:00100000:1.0:1790946266.691035:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40929a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+12:18038:x1877942616614656:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 173us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946266.691043:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 158 00000100:00100000:1.0:1790946266.694479:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946266.694736:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616614784 00000100:00100000:0.0:1790946266.694747:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616614784 00000100:00100000:0.0:1790946266.694880:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 159 00000100:00100000:0.0:1790946266.694890:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bd124a6-b6bd-4e62-987b-f878bfee98e2+12:18038:x1877942616614784:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790946266.695050:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bd124a6-b6bd-4e62-987b-f878bfee98e2+12:18038:x1877942616614784:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 160us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946266.695059:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 159 00000100:00100000:3.0:1790946266.701324:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946266.701432:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616614912 00000100:00100000:0.0:1790946266.701444:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616614912 00000100:00100000:0.0:1790946266.701509:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 38 00000100:00100000:0.0:1790946266.701529:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+15:18677:x1877942616614912:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1790946266.701581:0:22726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946266.701602:0:22726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a200/0xd9f4181e0d27f1e4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c2223311b8 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.701680:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f1eb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.701695:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f1eb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.701706:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f1eb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946266.701753:0:22726:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790946266.701757:0:22726:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790946266.702062:0:22726:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f1eb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.702073:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f1eb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.702098:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a200/0xd9f4181e0d27f1e4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311b8 expref: 17 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.702116:0:22726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f1eb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311b8 expref: 16 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946266.702124:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:0.0:1790946266.702127:0:22726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790946266.702131:0:22726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d408630bc00, rc 0) 00000100:00100000:0.0:1790946266.702259:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+16:18677:x1877942616614912:12345-192.168.204.20@tcp:101:bash.0 Request processed in 727us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946266.702268:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 38 00000100:00100000:2.0:1790946266.707192:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946266.707468:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616615040 00000100:00100000:1.0:1790946266.707478:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616615040 00000100:00100000:1.0:1790946266.707552:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 160 00000100:00100000:1.0:1790946266.707563:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+12:18038:x1877942616615040:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790946266.707737:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+12:18038:x1877942616615040:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 175us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946266.707745:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 160 00000100:00100000:1.0:1790946266.712692:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946266.713916:0:22727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616615296 00000100:00100000:3.0:1790946266.713928:0:22727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616615296 00000100:00100000:3.0:1790946266.714003:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:3.0:1790946266.714014:0:22727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+16:18677:x1877942616615296:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:3.0:1790946266.714802:0:22727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+17:18677:x1877942616615296:12345-192.168.204.20@tcp:35:bash.0 Request processed in 784us (2113us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1790946266.714812:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:2.0:1790946266.714962:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946266.718690:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616615424 00000100:00100000:1.0:1790946266.718705:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616615424 00000100:00100000:1.0:1790946266.718782:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 161 00000100:00100000:1.0:1790946266.718790:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bd124a6-b6bd-4e62-987b-f878bfee98e2+12:18038:x1877942616615424:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946266.718806:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946266.718822:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d4080030c00/0xd9f4181e0d27f1f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xccf0c8c2223311bf expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.718849:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d4080030c00/0xd9f4181e0d27f1f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311bf expref: 13 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.718874:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d4080030c00/0xd9f4181e0d27f1f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311bf expref: 13 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.718883:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080030c00, rc 0) 00000100:00100000:1.0:1790946266.719003:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bd124a6-b6bd-4e62-987b-f878bfee98e2+13:18038:x1877942616615424:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 213us (4041us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946266.719010:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 161 00000100:00100000:2.0:1790946266.723365:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946266.723516:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616615552 00000100:00100000:0.0:1790946266.723525:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616615552 00000100:00100000:0.0:1790946266.723583:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 162 00000100:00100000:0.0:1790946266.723593:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bd124a6-b6bd-4e62-987b-f878bfee98e2+13:18038:x1877942616615552:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790946266.723838:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bd124a6-b6bd-4e62-987b-f878bfee98e2+13:18038:x1877942616615552:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 245us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946266.723846:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 162 00000100:00100000:0.0:1790946266.726910:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946266.726991:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616615680 00000100:00100000:3.0:1790946266.727000:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616615680 00000100:00100000:3.0:1790946266.727075:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 163 00000100:00100000:3.0:1790946266.727084:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+13:18038:x1877942616615680:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790946266.727258:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bd124a6-b6bd-4e62-987b-f878bfee98e2+13:18038:x1877942616615680:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 174us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946266.727266:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 163 00000100:00100000:2.0:1790946266.818834:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946266.819608:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616615936 00000100:00100000:1.0:1790946266.819620:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616615936 00000100:00100000:1.0:1790946266.819704:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:1.0:1790946266.819714:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+17:18689:x1877942616615936:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1790946266.819741:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946266.819772:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030400/0xd9f4181e0d27f1f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c2223311c6 expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946266.819870:0:22725:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1790946266.819968:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030400/0xd9f4181e0d27f1f9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311c6 expref: 19 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.819983:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824e9c00) 00010000:00010000:1.0:1790946266.819986:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790946266.819991:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030400/0xd9f4181e0d27f1f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311c6 expref: 19 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.820005:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080030400, rc 0) 00000100:00100000:1.0:1790946266.820077:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+18:18689:x1877942616615936:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 365us (1253us total) trans 12884901898 rc 301/301 00000100:00100000:1.0:1790946266.820098:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:2.0:1790946266.831069:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946266.831158:0:22728:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616616192 00000100:00100000:0.0:1790946266.831197:0:22728:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616616192 00000100:00100000:0.0:1790946266.831254:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:0.0:1790946266.831265:0:22728:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+18:18689:x1877942616616192:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:0.0:1790946266.831498:0:22728:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+19:18689:x1877942616616192:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 234us (437us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1790946266.831506:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:3.0:1790946266.874506:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946266.874690:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616616448 00000100:00100000:2.0:1790946266.874701:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616616448 00000100:00100000:2.0:1790946266.874779:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 40 00000100:00100000:2.0:1790946266.874788:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+19:18692:x1877942616616448:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1790946266.874812:0:22724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946266.874831:0:22724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27f207 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c2223311cd expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.880083:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27f20e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.880107:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27f20e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.880119:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27f20e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946266.880134:0:22724:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790946266.880281:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27f207 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311cd expref: 22 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.880318:0:22724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27f20e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311cd expref: 21 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.880326:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:2.0:1790946266.880329:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790946266.880332:0:22724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64c00, rc 0) 00000100:00100000:2.0:1790946266.880586:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+21:18692:x1877942616616448:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 5797us (6087us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1790946266.880595:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 40 00000100:00100000:2.0:1790946266.893719:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946266.893818:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616616576 00000100:00100000:1.0:1790946266.893829:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616616576 00000100:00100000:1.0:1790946266.893894:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:1.0:1790946266.893905:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+21:18692:x1877942616616576:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:1.0:1790946266.893974:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27f21c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.893993:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27f21c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.894023:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27f21c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.894061:0:22725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27f21c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.894069:0:22725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27f21c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.894075:0:22725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27f21c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.894081:0:22725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080030a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790946266.894085:0:22725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27f21c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.894092:0:22725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27f21c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.894103:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:1.0:1790946266.894118:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790946266.894123:0:22725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27f21c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946266.894130:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27f21c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946266.894258:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+21:18692:x1877942616616576:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 355us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946266.894266:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:1.0:1790946266.896798:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946266.896885:0:22710:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616616704 00000100:00100000:2.0:1790946266.896896:0:22710:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616616704 00000100:00100000:2.0:1790946266.896962:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:2.0:1790946266.896972:0:22710:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+21:2401:x1877942616616704:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790946266.896988:0:22710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946266.897042:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27f20e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311cd expref: 21 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946266.897062:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:2.0:1790946266.897066:0:22710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946266.897123:0:22710:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+20:2401:x1877942616616704:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 152us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946266.897131:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:2.0:1790946266.900001:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946266.900243:0:22728:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616616960 00000100:00100000:0.0:1790946266.900253:0:22728:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616616960 00000100:00100000:0.0:1790946266.900325:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:0.0:1790946266.900344:0:22728:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+20:18692:x1877942616616960:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:0.0:1790946266.900563:0:22728:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+21:18692:x1877942616616960:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 228us (572us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1790946266.900571:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000040:00080000:3.0:1790946266.913518:0:22760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790946266.975507:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790946266.976584:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638737536:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790946266.976807:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946266.976991:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638737664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790946266.977000:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790946266.977020:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946266.977026:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638737792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946266.977164:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638738304:0@lo:400:kworker.0 00000100:00100000:0.0:1790946266.977210:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946266.977232:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1877942638738816:0@lo:400:kworker.0 00000100:00100000:0.0:1790946266.977256:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946266.977274:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790946266.977280:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638737920:0@lo:400:kworker.0 00000100:00100000:0.0:1790946266.977300:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946266.977316:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638738432:0@lo:400:kworker.0 00000100:00100000:0.0:1790946266.977355:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946266.977375:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638738944:0@lo:400:kworker.0 00000100:00100000:0.0:1790946266.977396:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946266.977425:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638738816 00000100:00100000:0.0:1790946266.977433:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638738816 00000100:00100000:0.0:1790946266.977481:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638738432 00000100:00100000:0.0:1790946266.977484:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638738432 00000100:00100000:0.0:1790946266.977495:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638738944 00000100:00100000:0.0:1790946266.977498:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638738944 00000100:00100000:0.0:1790946266.977531:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790946266.977539:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f8265ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877942638738816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946266.977585:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638738048:0@lo:400:kworker.0 00000100:00100000:0.0:1790946266.977594:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f8265ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877942638738816:12345-0@lo:400:kworker.0 Request processed in 54us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946266.977604:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790946266.977641:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946266.977660:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1877942638738816:0@lo:400:kworker.0 00000100:00100000:3.0:1790946266.977666:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638738560:0@lo:400:kworker.0 00000100:00100000:0.0:1790946266.977689:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790946266.977707:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946266.977708:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638738432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946266.977724:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790946266.977732:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638738176:0@lo:400:kworker.0 00000100:00100000:3.0:1790946266.977765:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946266.977765:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638738432:12345-0@lo:400:kworker.0 Request processed in 60us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946266.977775:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790946266.977784:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f84531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638738688:0@lo:400:kworker.0 00000100:00100000:0.0:1790946266.977791:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638738560 00000100:00100000:0.0:1790946266.977795:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638738560 00000100:00100000:0.0:1790946266.977814:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638738176 00000100:00100000:3.0:1790946266.977818:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946266.977818:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638738176 00000100:00100000:0.0:1790946266.977838:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638738688 00000100:00100000:0.0:1790946266.977842:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638738688 00000100:00080000:3.0:1790946266.977843:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790946266.977853:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946266.977860:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790946266.977867:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877942638738944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946266.977881:0:24832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638738304 00000100:00100000:3.0:1790946266.977885:0:24832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638738304 00000100:00100000:0.0:1790946266.977902:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877942638738944:12345-0@lo:400:kworker.0 Request processed in 34us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946266.977908:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790946266.977918:0:24832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638737920 00000100:00100000:3.0:1790946266.977921:0:24832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638737920 00000100:00100000:0.0:1790946266.977927:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790946266.977935:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638738560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946266.977945:0:24832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638738048 00000100:00100000:3.0:1790946266.977948:0:24832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638738048 00000100:00100000:3.0:1790946266.977965:0:24832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790946266.977972:0:24832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638738304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946266.977976:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1877942638738560:12345-0@lo:400:kworker.0 Request processed in 41us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946266.977983:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790946266.978012:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1877942638738560:0@lo:400:kworker.0 00000100:00100000:3.0:1790946266.978026:0:24832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1877942638738304:12345-0@lo:400:kworker.0 Request processed in 53us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946266.978040:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638738432:0@lo:400:kworker.0 00000100:00100000:3.0:1790946266.978047:0:24832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1790946266.978057:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f84532d80 x1877942638738944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946266.978067:0:24832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790946266.978068:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638738944:0@lo:400:kworker.0 00000100:00100000:3.0:1790946266.978076:0:24832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f81bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638737920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946266.978098:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1877942638738304:0@lo:400:kworker.0 00000100:00100000:3.0:1790946266.978118:0:24832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f81bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638737920:12345-0@lo:400:kworker.0 Request processed in 42us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946266.978125:0:24832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790946266.978127:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638737920:0@lo:400:kworker.0 00000100:00100000:3.0:1790946266.978142:0:24832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790946266.978151:0:24832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638738048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946266.978152:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790946266.978164:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638738176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946266.978219:0:24832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638738048:12345-0@lo:400:kworker.0 Request processed in 69us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946266.978226:0:24832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790946266.978229:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638738048:0@lo:400:kworker.0 00000100:00080000:3.0:1790946266.978259:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790946266.978264:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790946266.978272:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638738176:12345-0@lo:400:kworker.0 Request processed in 110us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946266.978279:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790946266.978302:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638738176:0@lo:400:kworker.0 00000100:00100000:0.0:1790946266.978318:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790946266.978325:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638738688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946266.978358:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638738688:12345-0@lo:400:kworker.0 Request processed in 34us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946266.978364:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1790946266.978385:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d3f84531500 x1877942638738688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946266.978394:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638738688:0@lo:400:kworker.0 00000100:00100000:1.0:1790946266.978867:0:24236:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638737536 00000100:00100000:1.0:1790946266.978875:0:24236:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638737536 00000100:00100000:0.0:1790946266.978891:0:24237:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638737664 00000100:00100000:0.0:1790946266.978898:0:24237:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638737664 00000100:00100000:0.0:1790946266.978926:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790946266.978932:0:24237:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638737664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790946266.978948:0:24237:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790946266.978987:0:24237:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1877942638737664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (1967us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946266.979001:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790946266.979049:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1877942638737664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790946266.979457:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946266.979699:0:24236:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638737792 00000100:00100000:2.0:1790946266.979704:0:24236:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638737792 00000100:00100000:2.0:1790946266.979727:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790946266.979733:0:24236:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f84416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638737536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790946266.979755:0:24236:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1790946266.979804:0:24236:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f84416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638737536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (2998us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946266.979811:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790946266.979825:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790946266.979831:0:24236:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638737792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790946266.979840:0:24236:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1790946266.979867:0:24236:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877942638737792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946266.979872:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790946266.980080:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f84531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638737792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790946266.980114:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638737536:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1790946266.980839:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790946267.176968:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946267.177143:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616617216 00000100:00100000:0.0:1790946267.177154:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616617216 00000100:00100000:0.0:1790946267.177257:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:0.0:1790946267.177268:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+21:18723:x1877942616617216:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:0.0:1790946267.177299:0:24257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946267.177323:0:24257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a200/0xd9f4181e0d27f223 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c2223311d4 expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.177436:0:24257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f22a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.177458:0:24257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f22a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.177470:0:24257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f22a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946267.177482:0:24257:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790946267.177614:0:24257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a200/0xd9f4181e0d27f223 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311d4 expref: 24 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.177687:0:24257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f22a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311d4 expref: 23 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.177696:0:24257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:0.0:1790946267.177698:0:24257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790946267.177701:0:24257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d408630b200, rc 0) 00000100:00100000:0.0:1790946267.177829:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+23:18723:x1877942616617216:12345-192.168.204.20@tcp:101:cat.0 Request processed in 562us (870us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1790946267.177837:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:1.0:1790946267.186310:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946267.186411:0:22728:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616617472 00000100:00100000:0.0:1790946267.186421:0:22728:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616617472 00000100:00100000:0.0:1790946267.186481:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:0.0:1790946267.186491:0:22728:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+23:18723:x1877942616617472:12345-192.168.204.20@tcp:35:cat.0 00000100:00100000:0.0:1790946267.186802:0:22728:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+24:18723:x1877942616617472:12345-192.168.204.20@tcp:35:cat.0 Request processed in 312us (501us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1790946267.186810:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:2.0:1790946267.189025:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946267.189163:0:23881:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616617600 00000100:00100000:3.0:1790946267.189450:0:23881:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616617600 00000100:00100000:3.0:1790946267.189665:0:23881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:3.0:1790946267.189675:0:23881:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+24:2404:x1877942616617600:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790946267.189692:0:23881:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946267.189718:0:23881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f22a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311d4 expref: 24 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946267.189736:0:23881:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:3.0:1790946267.189741:0:23881:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946267.189799:0:23881:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+23:2404:x1877942616617600:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 126us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946267.189825:0:23881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:1.0:1790946267.203696:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946267.203739:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946267.203866:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946267.203913:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946267.203932:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946267.203947:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946267.203961:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946267.203989:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946267.204032:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616618240 00000100:00100000:1.0:1790946267.204044:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616618240 00000100:00100000:1.0:1790946267.204118:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616617856 00000100:00100000:1.0:1790946267.204128:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616617856 00000100:00100000:1.0:1790946267.204144:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616618368 00000100:00100000:1.0:1790946267.204145:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616618368 00000100:00100000:1.0:1790946267.204160:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:1.0:1790946267.204209:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+12:2402:x1877942616618240:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790946267.204304:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+12:2402:x1877942616618240:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 135us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946267.204311:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:1.0:1790946267.204328:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:1.0:1790946267.204335:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+5:2402:x1877942616617856:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790946267.204359:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+5:2402:x1877942616617856:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946267.204365:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:1.0:1790946267.204377:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:1.0:1790946267.204383:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+5:2402:x1877942616618368:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1790946267.204405:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+5:2402:x1877942616618368:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 23us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946267.204411:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:3.0:1790946267.205421:0:24234:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616617984 00000100:00100000:3.0:1790946267.205431:0:24234:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616617984 00000100:00100000:3.0:1790946267.205491:0:24234:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616618496 00000100:00100000:3.0:1790946267.205495:0:24234:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616618496 00000100:00100000:3.0:1790946267.205510:0:24234:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616618112 00000100:00100000:3.0:1790946267.205513:0:24234:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616618112 00000100:00100000:3.0:1790946267.205525:0:24234:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616618624 00000100:00100000:3.0:1790946267.205528:0:24234:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616618624 00000100:00100000:3.0:1790946267.205543:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:3.0:1790946267.205549:0:24234:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+5:2402:x1877942616617984:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790946267.205607:0:24234:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+5:2402:x1877942616617984:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 58us (1866us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946267.205615:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:3.0:1790946267.205643:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:3.0:1790946267.205649:0:24234:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+5:2402:x1877942616618496:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790946267.205674:0:24234:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+5:2402:x1877942616618496:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 23us (1759us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946267.205679:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:3.0:1790946267.205687:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:3.0:1790946267.205693:0:24234:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+5:2402:x1877942616618112:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790946267.205709:0:24234:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+5:2402:x1877942616618112:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 17us (1761us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946267.205713:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:3.0:1790946267.205721:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:3.0:1790946267.205738:0:24234:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+5:2402:x1877942616618624:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1790946267.205761:0:24234:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+5:2402:x1877942616618624:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 23us (1771us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946267.205765:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00080000:2.0:1790946267.205991:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790946267.205996:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790946267.206191:0:22718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616617728 00000100:00100000:0.0:1790946267.206197:0:22718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616617728 00000100:00100000:0.0:1790946267.206242:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 164 00000100:00100000:0.0:1790946267.206250:0:22718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bd124a6-b6bd-4e62-987b-f878bfee98e2+13:2402:x1877942616617728:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1790946267.206296:0:22718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bd124a6-b6bd-4e62-987b-f878bfee98e2+13:2402:x1877942616617728:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 47us (2609us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946267.206301:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 164 00000100:00100000:1.0:1790946267.290703:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946267.290892:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616618880 00000100:00100000:0.0:1790946267.290904:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616618880 00000100:00100000:0.0:1790946267.290969:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:0.0:1790946267.290980:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+23:18729:x1877942616618880:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1790946267.291007:0:24257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946267.291027:0:24257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a200/0xd9f4181e0d27f238 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c2223311db expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.291750:0:24257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a000/0xd9f4181e0d27f23f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.291784:0:24257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a000/0xd9f4181e0d27f23f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.291805:0:24257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a000/0xd9f4181e0d27f23f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946267.291819:0:24257:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790946267.292544:0:24257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a200/0xd9f4181e0d27f238 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311db expref: 26 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.292567:0:24257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a000/0xd9f4181e0d27f23f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311db expref: 25 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.292576:0:24257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:0.0:1790946267.292579:0:24257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790946267.292582:0:24257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d408630a000, rc 0) 00000100:00100000:0.0:1790946267.292997:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+25:18729:x1877942616618880:12345-192.168.204.20@tcp:101:dd.0 Request processed in 2017us (2302us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1790946267.293006:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:3.0:1790946267.306802:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946267.306889:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946267.307087:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616619008 00000100:00100000:2.0:1790946267.307097:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616619008 00000100:00100000:2.0:1790946267.307161:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:2.0:1790946267.307203:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+25:18729:x1877942616619008:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:2.0:1790946267.307251:0:22726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946267.307277:0:22726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f24d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c2223311e2 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.307314:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27f254 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.307328:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27f254 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.307339:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27f254 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.307443:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f24d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311e2 expref: 27 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.307572:0:22726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27f254 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311e2 expref: 26 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.307582:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:2.0:1790946267.307585:0:22726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790946267.307588:0:22726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c64000, rc 0) 00000100:00100000:2.0:1790946267.307656:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+26:18729:x1877942616619008:12345-192.168.204.20@tcp:101:dd.0 Request processed in 487us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946267.307663:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:1.0:1790946267.308200:0:22710:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616619136 00000100:00100000:1.0:1790946267.308206:0:22710:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616619136 00000100:00100000:1.0:1790946267.308251:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:1.0:1790946267.308267:0:22710:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+26:2403:x1877942616619136:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946267.308279:0:22710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946267.308438:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a000/0xd9f4181e0d27f23f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311db expref: 26 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946267.308530:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:1.0:1790946267.308536:0:22710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946267.308574:0:22710:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+25:2403:x1877942616619136:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 316us (1685us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946267.308581:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:3.0:1790946267.320664:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946267.322648:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616619392 00000100:00100000:1.0:1790946267.322664:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616619392 00000100:00100000:1.0:1790946267.322738:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:1.0:1790946267.322748:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+25:18729:x1877942616619392:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:1.0:1790946267.322804:0:22725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946267.322830:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f1eb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311b8 expref: 25 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946267.322848:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:1.0:1790946267.322853:0:22725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790946267.323038:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031600/0xd9f4181e0d27f25b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946267.323051:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031600/0xd9f4181e0d27f25b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946267.323060:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031600/0xd9f4181e0d27f25b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790946267.323103:0:22725:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:1.0:1790946267.323127:0:22725:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bcf34758 reply state 00000000a206fa6d transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031600/0xd9f4181e0d27f25b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946267.323157:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031600/0xd9f4181e0d27f25b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946267.323163:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:1.0:1790946267.323214:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790946267.323218:0:22725:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790946267.324395:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+27:18729:x1877942616619392:12345-192.168.204.20@tcp:36:dd.0 Request processed in 1639us (3804us total) trans 12884901906 rc 0/0 00000100:00100000:1.0:1790946267.324405:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 45 00000020:00080000:1.0:1790946267.324412:0:22725:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790946267.424559:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946267.475521:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946267.475745:0:22728:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616619648 00000100:00100000:0.0:1790946267.475756:0:22728:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616619648 00000100:00100000:0.0:1790946267.475820:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:0.0:1790946267.475831:0:22728:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40812e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+27:18729:x1877942616619648:12345-192.168.204.20@tcp:35:dd.0 00000100:00100000:0.0:1790946267.476074:0:22728:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40812e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+28:18729:x1877942616619648:12345-192.168.204.20@tcp:35:dd.0 Request processed in 244us (564us total) trans 12884901907 rc 0/0 00000100:00100000:0.0:1790946267.476081:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00000040:00080000:3.0:1790946267.488076:0:23480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790946267.695371:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946267.695942:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616619776 00000100:00100000:2.0:1790946267.695954:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616619776 00000100:00100000:2.0:1790946267.696090:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:2.0:1790946267.696102:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+28:18743:x1877942616619776:12345-192.168.204.20@tcp:101:stat.0 00010000:00010000:2.0:1790946267.696128:0:22726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946267.696150:0:22726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f262 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c2223311e9 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696249:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f269 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696265:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f269 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696281:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f269 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696295:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f270 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696303:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f270 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696320:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f270 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696398:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f277 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696408:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f277 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696415:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f277 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946267.696470:0:22726:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790946267.696475:0:22726:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790946267.696518:0:22726:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f277 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696530:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f277 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696538:0:22726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f269 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696544:0:22726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f269 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696551:0:22726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f269 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696558:0:22726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790946267.696563:0:22726:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f269 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696570:0:22726:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f269 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696595:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9d40bc938200) 00010000:00010000:2.0:1790946267.696599:0:22726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946267.696605:0:22726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f269 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696613:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f269 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696655:0:22726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f270 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696663:0:22726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f270 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696669:0:22726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f270 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696674:0:22726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790946267.696678:0:22726:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f270 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696685:0:22726:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f270 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696693:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9d40bc938a00) 00010000:00010000:2.0:1790946267.696696:0:22726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946267.696699:0:22726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f270 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696705:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f270 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696737:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f262 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311e9 expref: 30 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696763:0:22726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f277 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311e9 expref: 29 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946267.696781:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:2.0:1790946267.696783:0:22726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790946267.696786:0:22726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65400, rc 0) 00000100:00100000:2.0:1790946267.696936:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+29:18743:x1877942616619776:12345-192.168.204.20@tcp:101:stat.0 Request processed in 835us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946267.696945:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:3.0:1790946267.756815:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946267.756995:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616620032 00000100:00100000:0.0:1790946267.757022:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616620032 00000100:00100000:0.0:1790946267.757086:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:0.0:1790946267.757097:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+29:18749:x1877942616620032:12345-192.168.204.20@tcp:36:truncate.0 00010000:00010000:0.0:1790946267.757204:0:24257:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946267.757233:0:24257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65400/0xd9f4181e0d27f277 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311e9 expref: 29 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.757266:0:24257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:0.0:1790946267.757272:0:24257:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790946267.757442:0:24257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a200/0xd9f4181e0d27f27e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.757457:0:24257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a200/0xd9f4181e0d27f27e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.757466:0:24257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a200/0xd9f4181e0d27f27e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790946267.758427:0:24257:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:0.0:1790946267.758475:0:24257:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009f7f3e52 reply state 0000000089309d64 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a200/0xd9f4181e0d27f27e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.759627:0:24257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a200/0xd9f4181e0d27f27e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.759648:0:24257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:0.0:1790946267.759651:0:24257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790946267.759656:0:24257:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790946267.760104:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+31:18749:x1877942616620032:12345-192.168.204.20@tcp:36:truncate.0 Request processed in 3005us (3295us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1790946267.760115:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 47 00000020:00080000:0.0:1790946267.760135:0:24257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790946267.935397:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946267.935726:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616620160 00000100:00100000:0.0:1790946267.935737:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616620160 00000100:00100000:0.0:1790946267.936054:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:0.0:1790946267.936078:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+31:18763:x1877942616620160:12345-192.168.204.20@tcp:101:stat.0 00010000:00010000:0.0:1790946267.936106:0:22724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946267.936128:0:22724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a600/0xd9f4181e0d27f285 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c2223311f0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.936329:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f28c lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.936346:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f28c lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.936357:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f28c lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.936368:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f293 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.936375:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f293 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.936381:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f293 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.936454:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a000/0xd9f4181e0d27f29a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.936464:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a000/0xd9f4181e0d27f29a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.936488:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a000/0xd9f4181e0d27f29a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946267.937637:0:22724:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1790946267.937645:0:22724:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790946267.937680:0:22724:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a000/0xd9f4181e0d27f29a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.937766:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a000/0xd9f4181e0d27f29a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.937777:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f28c lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.937832:0:22724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f28c lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.937840:0:22724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f28c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.937846:0:22724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630ba00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790946267.937850:0:22724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f28c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.937858:0:22724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f28c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.937872:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9d40bc938200) 00010000:00010000:0.0:1790946267.937875:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946267.937880:0:22724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f28c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.937901:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f28c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.937917:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f293 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.937923:0:22724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f293 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.937930:0:22724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f293 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.937935:0:22724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630bc00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790946267.937938:0:22724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f293 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.937944:0:22724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f293 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.937951:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9d40bc938a00) 00010000:00010000:0.0:1790946267.937953:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946267.937956:0:22724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f293 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.937962:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f293 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.937996:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a600/0xd9f4181e0d27f285 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311f0 expref: 33 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.938023:0:22724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a000/0xd9f4181e0d27f29a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311f0 expref: 32 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946267.938030:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:0.0:1790946267.938032:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790946267.938034:0:22724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d408630a000, rc 0) 00000100:00100000:0.0:1790946267.938694:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+32:18763:x1877942616620160:12345-192.168.204.20@tcp:101:stat.0 Request processed in 2627us (3307us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946267.939907:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:3.0:1790946268.027553:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946268.028007:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616620416 00000100:00100000:1.0:1790946268.028018:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616620416 00000100:00100000:1.0:1790946268.028097:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:1.0:1790946268.028111:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+32:18773:x1877942616620416:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1790946268.028134:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946268.028327:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27f2a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c2223311f7 expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946268.028451:0:22725:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1790946268.028555:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27f2a1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311f7 expref: 34 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946268.028570:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824e9c00) 00010000:00010000:1.0:1790946268.028573:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790946268.028578:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27f2a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311f7 expref: 34 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946268.028627:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080030a00, rc 0) 00000100:00100000:1.0:1790946268.029050:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+33:18773:x1877942616620416:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 942us (1504us total) trans 12884901910 rc 301/301 00000100:00100000:1.0:1790946268.029058:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00080000:2.0:1790946268.029136:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946268.037020:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946268.037111:0:22728:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616620672 00000100:00100000:0.0:1790946268.037123:0:22728:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616620672 00000100:00100000:0.0:1790946268.037211:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:0.0:1790946268.037221:0:22728:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bfe65c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+33:18773:x1877942616620672:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:0.0:1790946268.037506:0:22728:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bfe65c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+34:18773:x1877942616620672:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 285us (494us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1790946268.037515:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:3.0:1790946268.130352:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946268.130426:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616620928 00000100:00100000:2.0:1790946268.130437:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616620928 00000100:00100000:2.0:1790946268.130555:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 50 00000100:00100000:2.0:1790946268.130567:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+34:18779:x1877942616620928:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1790946268.130601:0:22726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946268.130640:0:22726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f2af lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c2223311fe expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.130789:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2b6 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.130806:0:22726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f1cf lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311aa expref: 35 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.130816:0:22726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a000/0xd9f4181e0d27f29a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311f0 expref: 35 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.130826:0:22726:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2b6 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.130883:0:22726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a000/0xd9f4181e0d27f29a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311f0 expref: 35 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.130898:0:22726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a000/0xd9f4181e0d27f29a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311f0 expref: 35 pid: 22724 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946268.130911:0:22726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40812e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22726:1877942638739072:192.168.204.20@tcp:104: 00010000:00010000:2.0:1790946268.131001:0:22726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f1cf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311aa expref: 35 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.131010:0:22726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f1cf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311aa expref: 35 pid: 24257 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946268.131019:0:22726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff82680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22726:1877942638739200:192.168.204.20@tcp:104: 00000100:00100000:2.0:1790946268.131038:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d07540 going to sleep for 11 seconds 00000100:00100000:1.0:1790946268.142851:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946268.142938:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946268.143102:0:22709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616621056 00000100:00100000:0.0:1790946268.143111:0:22709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616621056 00010000:00010000:0.0:1790946268.143155:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a000/0xd9f4181e0d27f29a lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311f0 expref: 36 pid: 22724 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946268.143222:0:22709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616621184 00000100:00100000:0.0:1790946268.143226:0:22709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616621184 00010000:00010000:0.0:1790946268.143240:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f1cf lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311aa expref: 37 pid: 24257 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946268.143287:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:0.0:1790946268.143296:0:22709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a71e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+37:2404:x1877942616621056:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946268.143312:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946268.143319:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a000/0xd9f4181e0d27f29a lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311f0 expref: 37 pid: 22724 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.143331:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a000/0xd9f4181e0d27f29a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311f0 expref: 37 pid: 22724 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.143353:0:22709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:0.0:1790946268.143358:0:22709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2b6 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.143366:0:22709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2b6 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.143372:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946268.143428:0:22709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a71e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+37:2404:x1877942616621056:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 132us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946268.143437:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:0.0:1790946268.143486:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:0.0:1790946268.143493:0:22709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+36:2404:x1877942616621184:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946268.143500:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946268.143505:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f1cf lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311aa expref: 36 pid: 24257 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.143525:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f1cf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311aa expref: 36 pid: 24257 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.143538:0:22709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:0.0:1790946268.143541:0:22709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2b6 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.143549:0:22709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2b6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.143557:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2b6 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.143575:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946268.143596:0:22709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+36:2404:x1877942616621184:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 104us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946268.143602:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 18 00010000:00010000:2.0:1790946268.152278:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a000/0xd9f4181e0d27f29a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311f0 expref: 35 pid: 22724 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946268.152314:0:22726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40812e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22726:1877942638739072:192.168.204.20@tcp:104: 00010000:00010000:2.0:1790946268.152337:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f1cf lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311aa expref: 34 pid: 24257 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946268.152347:0:22726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff82680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22726:1877942638739200:192.168.204.20@tcp:104: 00010000:00010000:2.0:1790946268.152379:0:22726:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2b6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.152422:0:22726:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2b6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.152428:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2b6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946268.152460:0:22726:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1790946268.152656:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f2af lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311fe expref: 35 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.152671:0:22726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2b6 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311fe expref: 34 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.152681:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:2.0:1790946268.152684:0:22726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790946268.152687:0:22726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65a00, rc 0) 00000100:00100000:2.0:1790946268.152761:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+34:18779:x1877942616620928:12345-192.168.204.20@tcp:101:bash.0 Request processed in 22196us (22420us total) trans 12884901912 rc 0/0 00000100:00100000:2.0:1790946268.152771:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 50 00000100:00100000:1.0:1790946268.165855:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946268.165979:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616621440 00000100:00100000:0.0:1790946268.165989:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616621440 00000100:00100000:0.0:1790946268.166053:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:0.0:1790946268.166063:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+34:18779:x1877942616621440:12345-192.168.204.20@tcp:36:bash.0 00010000:00010000:0.0:1790946268.166587:0:24257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f2c4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.166618:0:24257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f2c4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.166630:0:24257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f2c4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790946268.166695:0:24257:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:0.0:1790946268.167369:0:24257:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009dd57405 reply state 00000000287f2f34 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f2c4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.167388:0:24257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f2c4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.167397:0:24257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:0.0:1790946268.167399:0:24257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790946268.167403:0:24257:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790946268.167596:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+37:18779:x1877942616621440:12345-192.168.204.20@tcp:36:bash.0 Request processed in 1531us (1748us total) trans 12884901914 rc 0/0 00000100:00100000:0.0:1790946268.167605:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 51 00000020:00080000:0.0:1790946268.167622:0:24257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790946268.174498:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946268.174602:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616621568 00000100:00100000:0.0:1790946268.174621:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616621568 00000100:00100000:0.0:1790946268.174687:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:0.0:1790946268.174697:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+37:18779:x1877942616621568:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1790946268.174835:0:22724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946268.174857:0:22724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f2cb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331205 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.174922:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f2cb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331205 expref: 38 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.174936:0:22724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f2cb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331205 expref: 38 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.174979:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:0.0:1790946268.174982:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790946268.174986:0:22724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d408630ba00, rc 0) 00000100:00100000:0.0:1790946268.175052:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+38:18779:x1877942616621568:12345-192.168.204.20@tcp:101:bash.0 Request processed in 355us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946268.175060:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:3.0:1790946268.186462:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946268.186828:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616621696 00000100:00100000:1.0:1790946268.186839:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616621696 00000100:00100000:1.0:1790946268.186908:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:1.0:1790946268.186919:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f83c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+38:18779:x1877942616621696:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:1.0:1790946268.186940:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946268.186960:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030400/0xd9f4181e0d27f2d2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c22233120c expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946268.187060:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27f2d9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946268.187076:0:22725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2b6 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311fe expref: 39 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946268.187086:0:22725:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27f2d9 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946268.187122:0:22725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2b6 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311fe expref: 39 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946268.187151:0:22725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2b6 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311fe expref: 39 pid: 22726 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946268.187164:0:22725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5c2f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22725:1877942638739328:192.168.204.20@tcp:104: 00000100:00100000:1.0:1790946268.187288:0:22725:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d409016c300 going to sleep for 11 seconds 00000100:00100000:3.0:1790946268.190875:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946268.191063:0:22709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616621824 00000100:00100000:0.0:1790946268.191073:0:22709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616621824 00010000:00010000:0.0:1790946268.191118:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2b6 lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311fe expref: 40 pid: 22726 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946268.191157:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:0.0:1790946268.191188:0:22709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+40:2403:x1877942616621824:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946268.191208:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946268.191215:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2b6 lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311fe expref: 40 pid: 22726 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.191228:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2b6 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311fe expref: 40 pid: 22726 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.191270:0:22709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:0.0:1790946268.191275:0:22709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27f2d9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.191286:0:22709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27f2d9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.191314:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27f2d9 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.191332:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946268.191400:0:22709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+40:2403:x1877942616621824:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 234us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946268.191408:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00010000:00010000:2.0:1790946268.193482:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2b6 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311fe expref: 39 pid: 22726 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946268.193508:0:22725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5c2f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22725:1877942638739328:192.168.204.20@tcp:104: 00010000:00010000:2.0:1790946268.193535:0:22725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27f2d9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.193546:0:22725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27f2d9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.193567:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27f2d9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946268.193637:0:22725:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790946268.193642:0:22725:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790946268.193664:0:22725:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27f2d9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.193701:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030400/0xd9f4181e0d27f2d2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233120c expref: 39 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.193719:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27f2d9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233120c expref: 38 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.193727:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:2.0:1790946268.193730:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790946268.193734:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d4080030a00, rc 0) 00000100:00100000:2.0:1790946268.193869:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f83c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+38:18779:x1877942616621696:12345-192.168.204.20@tcp:101:bash.0 Request processed in 6950us (7414us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946268.193878:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:0.0:1790946268.201967:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946268.202089:0:23881:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616622080 00000100:00100000:3.0:1790946268.202101:0:23881:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616622080 00000100:00100000:3.0:1790946268.202204:0:23881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:3.0:1790946268.202215:0:23881:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+38:18779:x1877942616622080:12345-192.168.204.20@tcp:103:bash.0 00010000:00010000:3.0:1790946268.202231:0:23881:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1790946268.202410:0:23881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f2cb lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331205 expref: 38 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946268.202439:0:23881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080030a00/0xd9f4181e0d27f2d9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233120c expref: 37 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946268.202451:0:23881:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:3.0:1790946268.202469:0:23881:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946268.202536:0:23881:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+36:18779:x1877942616622080:12345-192.168.204.20@tcp:103:bash.0 Request processed in 322us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946268.202545:0:23881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:1.0:1790946268.207873:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946268.208035:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616622208 00000100:00100000:2.0:1790946268.208050:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616622208 00000100:00100000:2.0:1790946268.208118:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 54 00000100:00100000:2.0:1790946268.208129:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+36:18779:x1877942616622208:12345-192.168.204.20@tcp:58:bash.0 00010000:00010000:2.0:1790946268.208302:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2e0 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.208322:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2e0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.208349:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2e0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790946268.209512:0:22726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790946268.209550:0:22726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1790946268.209690:0:22726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1790946268.209841:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+36:18779:x1877942616622208:12345-192.168.204.20@tcp:58:bash.0 Request processed in 1710us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946268.209852:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 54 00000100:00100000:1.0:1790946268.218285:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946268.218421:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616622336 00000100:00100000:0.0:1790946268.218435:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616622336 00000100:00100000:0.0:1790946268.218505:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:0.0:1790946268.218516:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+36:18779:x1877942616622336:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1790946268.218542:0:24257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946268.218565:0:24257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f2e7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331213 expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.218635:0:24257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2e0 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.218645:0:24257:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f2e7 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331213 expref: 37 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.218665:0:24257:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2e0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.218679:0:24257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f2e7 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331213 expref: 37 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.218869:0:24257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:0.0:1790946268.218872:0:24257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790946268.218878:0:24257:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f2e7 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331213 expref: 37 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946268.218886:0:24257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d408630b200, rc 0) 00000100:00100000:0.0:1790946268.218992:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+37:18779:x1877942616622336:12345-192.168.204.20@tcp:101:bash.0 Request processed in 477us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946268.219000:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 55 00010000:00010000:1.0:1790946268.447662:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790946268.959531:0:22760:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1790946268.959541:0:22760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790946268.959563:0:22760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1790946268.959572:0:22760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1790946268.960135:0:22760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff82680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22760:1877942638739456:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790946268.960561:0:22760:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d073c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946268.965241:0:22760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff82680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22760:1877942638739456:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790946268.975253:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946268.976196:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616622464 00000100:00100000:0.0:1790946268.976209:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616622464 00000100:00100000:0.0:1790946268.976274:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 56 00000100:00100000:0.0:1790946268.976284:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+37:18780:x1877942616622464:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790946268.976317:0:22724:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790946268.977457:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+37:18780:x1877942616622464:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 1168us (2207us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946268.977468:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 56 00000100:00100000:1.0:1790946268.995888:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946268.996026:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616622592 00000100:00100000:2.0:1790946268.996037:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616622592 00000100:00100000:2.0:1790946268.996100:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:2.0:1790946268.996109:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+37:18780:x1877942616622592:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790946268.996203:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f2ee lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996221:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f2ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996233:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f2ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996541:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f2f5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996551:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996558:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996582:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f2fc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996603:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f2fc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996610:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f2fc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946268.996714:0:22725:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790946268.996719:0:22725:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790946268.996732:0:22725:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f2fc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996743:0:22725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f2ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996750:0:22725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f2ee lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996757:0:22725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f2ee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996773:0:22725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790946268.996778:0:22725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f2ee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996786:0:22725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f2ee lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996797:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3f824e9e00) 00010000:00010000:2.0:1790946268.996800:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946268.996804:0:22725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f2ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996810:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f2ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996825:0:22725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996830:0:22725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f2f5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996836:0:22725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f2f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996840:0:22725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790946268.996843:0:22725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f2f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996848:0:22725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f2f5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996864:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9d3f824e9d00) 00010000:00010000:2.0:1790946268.996866:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946268.996869:0:22725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f2f5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996874:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f2f5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996889:0:22725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f2fc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996894:0:22725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f2fc lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996899:0:22725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f2fc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996903:0:22725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790946268.996906:0:22725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f2fc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996911:0:22725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f2fc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996917:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:2.0:1790946268.996918:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946268.996921:0:22725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f2fc lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946268.996926:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f2fc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946268.997027:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+37:18780:x1877942616622592:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 Request processed in 917us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946268.997035:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:1.0:1790946269.010095:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946269.010207:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616622848 00000100:00100000:2.0:1790946269.010217:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616622848 00000100:00100000:2.0:1790946269.010288:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:2.0:1790946269.010296:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+37:18780:x1877942616622848:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790946269.010315:0:22726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946269.010334:0:22726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f303 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c22233121a expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.010435:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f30a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.010450:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f30a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.010461:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f30a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946269.010473:0:22726:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790946269.010571:0:22726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f30a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.010580:0:22726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f30a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.010587:0:22726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f30a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.010618:0:22726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:2.0:1790946269.010623:0:22726:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f30a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.010629:0:22726:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f30a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.010654:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:2.0:1790946269.010656:0:22726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790946269.010661:0:22726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f30a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.010667:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f30a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.010710:0:22726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f303 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233121a expref: 39 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.010720:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3f824e9e00) 00010000:00010000:2.0:1790946269.010722:0:22726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790946269.010726:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f303 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233121a expref: 39 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.010735:0:22726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65000, rc 0) 00000100:00100000:2.0:1790946269.010796:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+38:18780:x1877942616622848:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 500us (710us total) trans 12884901915 rc 301/301 00000100:00100000:2.0:1790946269.010804:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:1.0:1790946269.019909:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946269.021423:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616622976 00000100:00100000:0.0:1790946269.021438:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616622976 00000100:00100000:0.0:1790946269.021521:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:0.0:1790946269.021532:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+38:18780:x1877942616622976:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790946269.021583:0:24257:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790946269.021934:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+38:18780:x1877942616622976:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 402us (2034us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946269.021958:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:1.0:1790946269.033622:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946269.033951:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616623232 00000100:00100000:0.0:1790946269.033963:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616623232 00000100:00100000:0.0:1790946269.034026:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:0.0:1790946269.034036:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+38:18780:x1877942616623232:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790946269.034059:0:22724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946269.034079:0:22724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ae00/0xd9f4181e0d27f318 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331221 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790946269.035106:0:22724:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =59 00000004:00080000:0.0:1790946269.035117:0:22724:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+59 in llog 00000004:00080000:0.0:1790946269.035142:0:22724:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:0.0:1790946269.036155:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f31f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.036204:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f31f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.036216:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f31f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.036307:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ae00/0xd9f4181e0d27f318 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331221 expref: 41 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.036328:0:22724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f31f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331221 expref: 40 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.036337:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9d40bc938f00) 00010000:00010000:0.0:1790946269.036352:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790946269.036356:0:22724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d408630ba00, rc 0) 00000100:00100000:0.0:1790946269.036418:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+40:18780:x1877942616623232:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 2383us (2805us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1790946269.036428:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:1.0:1790946269.055079:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946269.055202:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616623488 00000100:00100000:0.0:1790946269.055213:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616623488 00000100:00100000:0.0:1790946269.055286:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:0.0:1790946269.055296:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5c2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+40:18780:x1877942616623488:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790946269.055357:0:24257:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946269.055400:0:24257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f31f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331221 expref: 40 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.055420:0:24257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9d40bc938f00) 00010000:00010000:0.0:1790946269.055430:0:24257:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790946269.055455:0:24257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ae00/0xd9f4181e0d27f32d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.055469:0:24257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ae00/0xd9f4181e0d27f32d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.055478:0:24257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ae00/0xd9f4181e0d27f32d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.055491:0:24257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f334 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x8478ab93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.055497:0:24257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f334 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8478ab93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.055523:0:24257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f334 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8478ab93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.055583:0:24257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ae00/0xd9f4181e0d27f32d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.055601:0:24257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ae00/0xd9f4181e0d27f32d lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.055608:0:24257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ae00/0xd9f4181e0d27f32d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.055614:0:24257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630ae00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790946269.055619:0:24257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ae00/0xd9f4181e0d27f32d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.055626:0:24257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ae00/0xd9f4181e0d27f32d lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.055635:0:24257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9d40bc938200) 00010000:00010000:0.0:1790946269.055961:0:24257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946269.055966:0:24257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ae00/0xd9f4181e0d27f32d lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.055973:0:24257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ae00/0xd9f4181e0d27f32d lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.055984:0:24257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f334 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8478ab93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.055990:0:24257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f334 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8478ab93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.056006:0:24257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f334 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8478ab93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.056011:0:24257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630aa00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790946269.056015:0:24257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f334 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8478ab93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.056022:0:24257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f334 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8478ab93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.056031:0:24257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x8478ab93 (ffff9d40bc938e00) 00010000:00010000:0.0:1790946269.056033:0:24257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946269.056036:0:24257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f334 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x8478ab93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.056042:0:24257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f334 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x8478ab93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946269.056133:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5c2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+39:18780:x1877942616623488:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 838us (1064us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790946269.056141:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:1.0:1790946269.060348:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946269.060440:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616623616 00000100:00100000:2.0:1790946269.060455:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616623616 00000100:00100000:2.0:1790946269.060507:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:2.0:1790946269.060517:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+39:18780:x1877942616623616:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790946269.060537:0:22726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946269.060574:0:22726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f33b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331228 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.060622:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f342 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.060647:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f342 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.060659:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f342 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.060766:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f33b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331228 expref: 41 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.060785:0:22726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65800/0xd9f4181e0d27f342 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331228 expref: 40 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.060794:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9d3f824e9d00) 00010000:00010000:2.0:1790946269.060796:0:22726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790946269.060800:0:22726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65800, rc 0) 00000100:00100000:2.0:1790946269.060865:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+40:18780:x1877942616623616:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 349us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946269.060872:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:1.0:1790946269.065930:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946269.066034:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616623872 00000100:00100000:2.0:1790946269.066056:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616623872 00000100:00100000:2.0:1790946269.066113:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:2.0:1790946269.066123:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+40:18780:x1877942616623872:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790946269.066238:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f349 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.066264:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f349 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.066276:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f349 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790946269.066459:0:22725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:2.0:1790946269.066468:0:22725:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 719882299733ns, next at 720882297557ns, rc = 0 00000004:00010000:2.0:1790946269.066515:0:22725:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002c4caa0c reply state 00000000fed381b6 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f349 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.066528:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f349 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.066536:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9d3f824e9d00) 00010000:00010000:2.0:1790946269.066539:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790946269.066542:0:22725:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790946269.069105:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+42:18780:x1877942616623872:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 2972us (3173us total) trans 12884901917 rc 0/0 00000100:00100000:2.0:1790946269.069118:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:1.0:1790946269.076699:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946269.076853:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616624000 00000100:00100000:2.0:1790946269.076864:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616624000 00000100:00100000:2.0:1790946269.076922:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:2.0:1790946269.076933:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+42:18780:x1877942616624000:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790946269.076978:0:22726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946269.077001:0:22726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f350 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c22233122f expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.077064:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f350 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233122f expref: 43 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.077080:0:22726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f350 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233122f expref: 43 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.077098:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9d3f824e9d00) 00010000:00010000:2.0:1790946269.077101:0:22726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790946269.077105:0:22726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65000, rc 0) 00000100:00100000:2.0:1790946269.077207:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+43:18780:x1877942616624000:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 238us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946269.077215:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:1.0:1790946269.084916:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946269.086760:0:24234:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616624128 00000100:00100000:3.0:1790946269.086780:0:24234:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616624128 00000100:00100000:3.0:1790946269.086869:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:3.0:1790946269.086881:0:24234:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+5:2402:x1877942616624128:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1790946269.087241:0:24234:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:2402:x1877942616624128:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 363us (2335us total) trans 12884901891 rc 0/0 00000100:00100000:3.0:1790946269.087249:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00080000:2.0:1790946269.088204:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790946269.091441:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946269.091619:0:22728:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616624384 00000100:00100000:0.0:1790946269.091631:0:22728:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616624384 00000100:00100000:0.0:1790946269.091691:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:0.0:1790946269.091702:0:22728:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+43:18780:x1877942616624384:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790946269.091939:0:22728:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+44:18780:x1877942616624384:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 239us (509us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1790946269.091948:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:3.0:1790946269.097772:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946269.106941:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616624640 00000100:00100000:1.0:1790946269.106957:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616624640 00000100:00100000:1.0:1790946269.107041:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:1.0:1790946269.107052:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+44:18780:x1877942616624640:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790946269.107192:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+44:18780:x1877942616624640:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 142us (9430us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946269.107805:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:1.0:1790946269.112141:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946269.117951:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616624768 00000100:00100000:2.0:1790946269.117969:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616624768 00000100:00100000:2.0:1790946269.118034:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:2.0:1790946269.118045:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+44:18780:x1877942616624768:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790946269.118067:0:22726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946269.118089:0:22726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27f357 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331236 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.118163:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27f35e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.118217:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27f35e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.118889:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27f35e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946269.118946:0:22726:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790946269.118969:0:22726:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27f35e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.119003:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27f357 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331236 expref: 46 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.119023:0:22726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27f35e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331236 expref: 45 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.119032:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9d3f824e9d00) 00010000:00010000:2.0:1790946269.119035:0:22726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790946269.119038:0:22726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65c00, rc 0) 00000100:00100000:2.0:1790946269.119118:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+45:18780:x1877942616624768:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 1074us (6985us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946269.119126:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:0.0:1790946269.126138:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946269.126432:0:24235:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616624896 00000100:00100000:3.0:1790946269.126443:0:24235:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616624896 00000100:00100000:3.0:1790946269.126504:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:3.0:1790946269.126515:0:24235:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+6:2403:x1877942616624896:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790946269.126536:0:24235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946269.126556:0:24235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5a8f4c4/0xd9f4181e0d27f365 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c22233123d expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790946269.126583:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abfabdd, blocks: 0x0 00010000:00010000:3.0:1790946269.126613:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=719s v=(0 0) 00010000:00010000:3.0:1790946269.126619:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946269.126628:0:24235:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5a8f4c4/0xd9f4181e0d27f365 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233123d expref: 7 pid: 24235 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.126749:0:24235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d5a8f4c4/0xd9f4181e0d27f365 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233123d expref: 7 pid: 24235 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.126762:0:24235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef1a00, rc 0) 00000100:00100000:3.0:1790946269.126914:0:24235:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+7:2403:x1877942616624896:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 401us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946269.126921:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:3.0:1790946269.132549:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946269.132661:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616625152 00000100:00100000:2.0:1790946269.132672:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616625152 00000100:00100000:2.0:1790946269.132732:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:2.0:1790946269.132741:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+45:18780:x1877942616625152:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790946269.132848:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+45:18780:x1877942616625152:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 108us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946269.132870:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:1.0:1790946269.139597:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946269.139765:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616625280 00000100:00100000:0.0:1790946269.139776:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616625280 00000100:00100000:0.0:1790946269.139844:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:0.0:1790946269.139854:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+45:18780:x1877942616625280:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790946269.143464:0:22704:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:2.0:1790946269.143485:0:22704:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1790946269.143551:0:22704:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:3.0:1790946269.143684:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f119 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143698:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f119 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143707:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f119 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143714:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630a800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790946269.143719:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f119 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143727:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f119 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143744:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9d40bc938400) 00010000:00010000:3.0:1790946269.143747:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946269.143752:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f119 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143773:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f119 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143795:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f120 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143800:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f120 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143807:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f120 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143813:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630a400 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790946269.143816:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f120 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143822:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f120 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143830:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9d40bc938200) 00010000:00010000:3.0:1790946269.143832:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946269.143836:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f120 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143842:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f120 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143856:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f1c8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143864:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f1c8 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143876:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f1c8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143881:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630b000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790946269.143884:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f1c8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143892:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f1c8 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143901:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9d40bc938a00) 00010000:00010000:3.0:1790946269.143903:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946269.143907:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f1c8 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143913:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b000/0xd9f4181e0d27f1c8 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143929:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031600/0xd9f4181e0d27f25b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143936:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031600/0xd9f4181e0d27f25b lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143943:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031600/0xd9f4181e0d27f25b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143948:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d4080031600 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790946269.143952:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031600/0xd9f4181e0d27f25b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143968:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031600/0xd9f4181e0d27f25b lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143977:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:3.0:1790946269.143979:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946269.143983:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031600/0xd9f4181e0d27f25b lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.143988:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d4080031600/0xd9f4181e0d27f25b lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.144001:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a200/0xd9f4181e0d27f27e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.144007:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a200/0xd9f4181e0d27f27e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.144014:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a200/0xd9f4181e0d27f27e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.144019:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630a200 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790946269.144022:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a200/0xd9f4181e0d27f27e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.144029:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a200/0xd9f4181e0d27f27e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.144036:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:3.0:1790946269.144038:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946269.144041:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a200/0xd9f4181e0d27f27e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.144057:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a200/0xd9f4181e0d27f27e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.144068:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f2c4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.144073:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f2c4 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.144079:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f2c4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.144083:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630bc00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790946269.144086:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f2c4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.144092:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f2c4 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.144099:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:3.0:1790946269.144101:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946269.144103:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f2c4 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.144108:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630bc00/0xd9f4181e0d27f2c4 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.144117:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f349 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.144123:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f349 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.144137:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f349 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.144142:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790946269.144145:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f349 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.144151:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f349 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.144158:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9d3f824e9d00) 00010000:00010000:3.0:1790946269.144160:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790946269.144163:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f349 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.144224:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f349 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946269.144824:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+14:18780:x1877942616625280:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 Request processed in 4965us (5243us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946269.144836:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 68 00010000:00010000:1.0:1790946269.144873:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630be00/0xd9f4181e0d27f16d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946269.144884:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630be00/0xd9f4181e0d27f16d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946269.144890:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630be00/0xd9f4181e0d27f16d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946269.144909:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630be00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:1.0:1790946269.144913:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630be00/0xd9f4181e0d27f16d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946269.144920:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630be00/0xd9f4181e0d27f16d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946269.144932:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9d40bc938200) 00010000:00010000:1.0:1790946269.144935:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790946269.144939:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630be00/0xd9f4181e0d27f16d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946269.144945:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630be00/0xd9f4181e0d27f16d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946269.145094:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638739584:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790946269.145147:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946269.146910:0:25123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638739584 00000100:00100000:1.0:1790946269.146924:0:25123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638739584 00000100:00100000:1.0:1790946269.147013:0:25123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790946269.147024:0:25123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638739584:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1790946269.147200:0:25123:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1790946269.147204:0:25123:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1790946269.147206:0:25123:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790946269.147208:0:25123:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1790946269 -> 1790946269 00002000:00010000:1.0:1790946269.147210:0:25123:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00080000:2.0:1790946269.147364:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790946269.147476:0:25123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3647:x1877942638739584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 454us (2327us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1790946269.147484:0:25123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:2.0:1790946269.147558:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d40b5d0ed80/2, rc 0, transno 12884901892 00000100:00100000:2.0:1790946269.147564:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638739584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790946269.149478:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946269.153974:0:24233:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616625408 00000100:00100000:3.0:1790946269.153992:0:24233:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616625408 00000100:00100000:3.0:1790946269.154071:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:3.0:1790946269.154083:0:24233:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+7:2402:x1877942616625408:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1790946269.154840:0:24233:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+7:2402:x1877942616625408:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 Request processed in 755us (5365us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946269.154851:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:0.0:1790946269.165034:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946269.165139:0:22725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616625664 00000100:00100000:2.0:1790946269.165151:0:22725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616625664 00000100:00100000:2.0:1790946269.165269:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:2.0:1790946269.165280:0:22725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+14:18780:x1877942616625664:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790946269.165338:0:22725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946269.165364:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27f35e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331236 expref: 14 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.165385:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9d3f824e9d00) 00010000:00010000:2.0:1790946269.165390:0:22725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790946269.165419:0:22725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27f36c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.165434:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27f36c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.165443:0:22725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27f36c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790946269.165600:0:22725:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003825524b reply state 0000000010b0c885 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27f36c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.165614:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64c00/0xd9f4181e0d27f36c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.165620:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9d3f824e9d00) 00010000:00010000:2.0:1790946269.165622:0:22725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790946269.165625:0:22725:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790946269.166048:0:22725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+15:18780:x1877942616625664:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 768us (1024us total) trans 12884901919 rc 0/0 00000100:00100000:2.0:1790946269.166057:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:1.0:1790946269.176892:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946269.176975:0:24235:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616625792 00000100:00100000:3.0:1790946269.176987:0:24235:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616625792 00000100:00100000:3.0:1790946269.177050:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:3.0:1790946269.177060:0:24235:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4088109850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+7:18780:x1877942616625792:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790946269.177091:0:24235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946269.177109:0:24235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27f373 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331244 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.177142:0:24235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5a8f4c4/0xd9f4181e0d27f365 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233123d expref: 8 pid: 24235 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.177151:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946269.177155:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946269.177160:0:24235:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27f373 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331244 expref: 8 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.177241:0:24235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d5a8f4c4/0xd9f4181e0d27f365 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233123d expref: 8 pid: 24235 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.177265:0:24235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d5a8f4c4/0xd9f4181e0d27f365 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233123d expref: 8 pid: 24235 timeout: 819 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946269.177280:0:24235:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24235:1877942638739712:192.168.204.20@tcp:104: 00000100:00100000:3.0:1790946269.177357:0:24235:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4c20b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790946269.188923:0:24235:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24235:1877942638739712:192.168.204.20@tcp:104: 00010000:00010000:3.0:1790946269.188958:0:24235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27f373 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331244 expref: 8 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.188979:0:24235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d40baef0a00, rc 0) 00000100:00100000:1.0:1790946269.190540:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946269.190669:0:22709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616625920 00000100:00100000:0.0:1790946269.190679:0:22709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616625920 00010000:00010000:0.0:1790946269.190724:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d5a8f4c4/0xd9f4181e0d27f365 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233123d expref: 9 pid: 24235 timeout: 819 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946269.190763:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:0.0:1790946269.190772:0:22709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+9:2403:x1877942616625920:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946269.190789:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946269.190814:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000d5a8f4c4/0xd9f4181e0d27f365 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233123d expref: 9 pid: 24235 timeout: 819 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.190829:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d5a8f4c4/0xd9f4181e0d27f365 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233123d expref: 9 pid: 24235 timeout: 819 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.190854:0:22709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5a8f4c4/0xd9f4181e0d27f365 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233123d expref: 9 pid: 24235 timeout: 819 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.190890:0:22709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1790946269.190894:0:22709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946269.190901:0:22709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27f373 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331244 expref: 8 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.190911:0:22709:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27f373 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331244 expref: 8 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.190955:0:22709:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27f373 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331244 expref: 8 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946269.190970:0:22709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5d0e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:22709:1877942638739840:192.168.204.20@tcp:105: 00000100:00100000:0.0:1790946269.191057:0:22709:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871c6180 going to sleep for 11 seconds 00000100:00100000:1.0:1790946269.195671:0:22709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5d0e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:22709:1877942638739840:192.168.204.20@tcp:105: 00010000:00010000:1.0:1790946269.195702:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946269.195766:0:22709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+8:2403:x1877942616625920:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 4995us (5236us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946269.195778:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:2.0:1790946269.197932:0:24235:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4088109850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+7:18780:x1877942616625792:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 20862us (21038us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946269.197946:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:0.0:1790946269.211016:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946269.211117:0:25123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616626048 00000100:00100000:1.0:1790946269.211128:0:25123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616626048 00000100:00100000:1.0:1790946269.211231:0:25123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:1.0:1790946269.211244:0:25123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93f4dfa8-f0c5-48de-82e2-232116f1669e+7:2404:x1877942616626048:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790946269.211413:0:25123:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1790946269.211416:0:25123:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1790946268 00002000:00010000:1.0:1790946269.211419:0:25123:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1790946266 00002000:00010000:1.0:1790946269.211421:0:25123:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1790946269 -> 1790946268 00002000:00010000:1.0:1790946269.211423:0:25123:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1790946269.211492:0:25123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:93f4dfa8-f0c5-48de-82e2-232116f1669e+8:2404:x1877942616626048:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 252us (485us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1790946269.211516:0:25123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:1.0:1790946269.218447:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946269.218775:0:24832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616626176 00000100:00100000:0.0:1790946269.218786:0:24832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616626176 00000100:00100000:0.0:1790946269.218853:0:24832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:0.0:1790946269.218863:0:24832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+8:2404:x1877942616626176:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790946269.218908:0:24832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a09a4248/0xd9f4181e0d27f37a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.218930:0:24832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27f373 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331244 expref: 8 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.218958:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946269.218963:0:24832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790946269.218968:0:24832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a09a4248/0xd9f4181e0d27f37a lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.219006:0:24832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27f373 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331244 expref: 8 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.219021:0:24832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27f373 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331244 expref: 8 pid: 24235 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946269.219036:0:24832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5d0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:24832:1877942638739968:192.168.204.20@tcp:104: 00000100:00100000:0.0:1790946269.219124:0:24832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40871c60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946269.221858:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1790946269.221950:0:22710:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616626304 00000100:00100000:1.0:1790946269.221960:0:22710:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616626304 00010000:00010000:1.0:1790946269.222001:0:22710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27f373 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331244 expref: 9 pid: 24235 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946269.222043:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:1.0:1790946269.222054:0:22710:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5d0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+9:2404:x1877942616626304:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946269.222068:0:22710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946269.222089:0:22710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27f373 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331244 expref: 9 pid: 24235 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946269.222101:0:22710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27f373 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331244 expref: 9 pid: 24235 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946269.222125:0:22710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790946269.222129:0:22710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790946269.222135:0:22710:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a09a4248/0xd9f4181e0d27f37a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946269.222145:0:22710:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a09a4248/0xd9f4181e0d27f37a lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946269.222165:0:22710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946269.222286:0:22710:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5d0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+9:2404:x1877942616626304:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 233us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946269.222294:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 21 00010000:00010000:2.0:1790946269.222956:0:24832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050f88e0d/0xd9f4181e0d27f373 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331244 expref: 8 pid: 24235 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946269.222974:0:24832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5d0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:24832:1877942638739968:192.168.204.20@tcp:104: 00010000:00010000:2.0:1790946269.222993:0:24832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a09a4248/0xd9f4181e0d27f37a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.223003:0:24832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a09a4248/0xd9f4181e0d27f37a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.223010:0:24832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a09a4248/0xd9f4181e0d27f37a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.223043:0:24832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a09a4248/0xd9f4181e0d27f37a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.223052:0:24832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a09a4248/0xd9f4181e0d27f37a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.223060:0:24832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a09a4248/0xd9f4181e0d27f37a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.223068:0:24832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630a600 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:2.0:1790946269.223072:0:24832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a09a4248/0xd9f4181e0d27f37a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.223080:0:24832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a09a4248/0xd9f4181e0d27f37a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.223093:0:24832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a09a4248/0xd9f4181e0d27f37a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.223101:0:24832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a09a4248/0xd9f4181e0d27f37a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946269.223210:0:24832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+7:2404:x1877942616626176:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 Request processed in 4348us (4772us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946269.223234:0:24832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:0.0:1790946269.229742:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946269.229894:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616626560 00000100:00100000:2.0:1790946269.229906:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616626560 00000100:00100000:2.0:1790946269.229964:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:2.0:1790946269.229972:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+15:18780:x1877942616626560:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790946269.230054:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27f381 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.230072:0:22726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27f254 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311e2 expref: 15 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.230082:0:22726:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27f381 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.230117:0:22726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27f254 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311e2 expref: 15 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.230130:0:22726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27f254 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311e2 expref: 15 pid: 22726 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946269.230144:0:22726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff82680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22726:1877942638740096:192.168.204.20@tcp:104: 00000100:00100000:2.0:1790946269.230271:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d073c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946269.233986:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946269.234059:0:22711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616626688 00000100:00100000:3.0:1790946269.234069:0:22711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616626688 00010000:00010000:3.0:1790946269.234110:0:22711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27f254 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311e2 expref: 16 pid: 22726 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946269.234153:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:3.0:1790946269.234162:0:22711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+16:2403:x1877942616626688:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790946269.234733:0:22711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946269.234743:0:22711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27f254 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311e2 expref: 16 pid: 22726 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.234756:0:22711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27f254 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311e2 expref: 16 pid: 22726 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.234780:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:3.0:1790946269.234786:0:22711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f2e7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331213 expref: 16 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.234796:0:22711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27f381 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.234804:0:22711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27f381 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.234811:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27f381 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.234829:0:22711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946269.234890:0:22711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+16:2403:x1877942616626688:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 727us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946269.234910:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 22 00010000:00010000:2.0:1790946269.235115:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27f254 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c2223311e2 expref: 15 pid: 22726 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946269.235133:0:22726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff82680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22726:1877942638740096:192.168.204.20@tcp:104: 00010000:00010000:2.0:1790946269.235162:0:22726:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27f381 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.235216:0:22726:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27f381 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.235237:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27f381 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.235520:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f388 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.235533:0:22726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f350 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233122f expref: 15 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.235541:0:22726:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f388 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.235584:0:22726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f350 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233122f expref: 15 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.235609:0:22726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f350 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233122f expref: 15 pid: 22726 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946269.235624:0:22726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff82680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22726:1877942638740224:192.168.204.20@tcp:104: 00000100:00100000:2.0:1790946269.235707:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d40b4d07540 going to sleep for 11 seconds 00000100:00100000:1.0:1790946269.248742:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946269.249026:0:22710:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616626816 00000100:00100000:3.0:1790946269.249039:0:22710:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616626816 00010000:00010000:3.0:1790946269.249093:0:22710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f350 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233122f expref: 16 pid: 22726 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946269.249146:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:3.0:1790946269.249156:0:22710:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40a71e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+16:2404:x1877942616626816:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790946269.249207:0:22710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946269.249216:0:22710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f350 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233122f expref: 16 pid: 22726 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.249243:0:22710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f350 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233122f expref: 16 pid: 22726 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.249274:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9d3f824e9d00) 00010000:00010000:3.0:1790946269.249280:0:22710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f388 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.249290:0:22710:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f388 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.249298:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f388 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.249317:0:22710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946269.249374:0:22710:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40a71e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+16:2404:x1877942616626816:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 219us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946269.249397:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 23 00010000:00010000:2.0:1790946269.252720:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65000/0xd9f4181e0d27f350 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233122f expref: 15 pid: 22726 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946269.252749:0:22726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff82680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22726:1877942638740224:192.168.204.20@tcp:104: 00010000:00010000:2.0:1790946269.252791:0:22726:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f388 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.252802:0:22726:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f388 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.252809:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f388 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790946269.252926:0:22726:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:2.0:1790946269.253048:0:22726:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:2.0:1790946269.253083:0:22726:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:2.0:1790946269.253159:0:22726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff82680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22726:1877942638740352:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790946269.253329:0:22726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946269.253355:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d408133a900 going to sleep for 11 seconds 00000100:00100000:0.0:1790946269.253693:0:22730:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638740352 00000100:00100000:0.0:1790946269.253702:0:22730:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638740352 00000100:00100000:0.0:1790946269.253755:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790946269.253764:0:22730:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22726:x1877942638740352:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790946269.253862:0:22730:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22726:x1877942638740352:12345-0@lo:1000:mdt00_002.0 Request processed in 100us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946269.253870:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790946269.254087:0:22726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff82680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22726:1877942638740352:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1790946269.254281:0:22726:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:3.0:1790946269.254347:0:22726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22726:1877942638740480:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1790946269.254381:0:22726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946269.254407:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4088c20600 going to sleep for 11 seconds 00000100:00100000:1.0:1790946269.254550:0:23467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638740480 00000100:00100000:1.0:1790946269.254566:0:23467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638740480 00000100:00100000:1.0:1790946269.254617:0:23467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790946269.254626:0:23467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22726:x1877942638740480:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1790946269.254749:0:23467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22726:x1877942638740480:12345-0@lo:1000:mdt00_002.0 Request processed in 124us (365us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1790946269.254756:0:23467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790946269.255112:0:22726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22726:1877942638740480:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1790946269.255148:0:22726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f388 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.255158:0:22726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f388 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.255196:0:22726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f388 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.255202:0:22726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64800 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790946269.255207:0:22726:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f388 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.255215:0:22726:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f388 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.255230:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9d3f824e9d00) 00010000:00010000:3.0:1790946269.255233:0:22726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790946269.255237:0:22726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f388 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.255243:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64800/0xd9f4181e0d27f388 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.255282:0:22726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2e0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.255288:0:22726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2e0 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.255295:0:22726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2e0 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.255299:0:22726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65a00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790946269.255302:0:22726:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2e0 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.255307:0:22726:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2e0 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.255314:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:3.0:1790946269.255316:0:22726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790946269.255322:0:22726:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f2e7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331213 expref: 18 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.255332:0:22726:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f2e7 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331213 expref: 18 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.255341:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f2e7 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331213 expref: 18 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.255367:0:22726:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630b200/0xd9f4181e0d27f2e7 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331213 expref: 18 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946269.255391:0:22726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22726:1877942638740608:192.168.204.20@tcp:105: 00000100:00100000:3.0:1790946269.255451:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9d4084073480 going to sleep for 11 seconds 00000100:00100000:1.0:1790946269.260080:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946269.260793:0:22727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616626944 00000100:00100000:2.0:1790946269.260805:0:22727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616626944 00000100:00100000:2.0:1790946269.260874:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:2.0:1790946269.260884:0:22727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+19:18779:x1877942616626944:12345-192.168.204.20@tcp:49:bash.0 00000100:00100000:2.0:1790946269.261025:0:22727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+19:18779:x1877942616626944:12345-192.168.204.20@tcp:49:bash.0 Request processed in 142us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946269.261034:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:3.0:1790946269.264361:0:22726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22726:1877942638740608:192.168.204.20@tcp:105: 00010000:00010000:3.0:1790946269.264398:0:22726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2e0 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.264411:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65a00/0xd9f4181e0d27f2e0 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.264451:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27f38f lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.264466:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27f38f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.264477:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27f38f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.264489:0:22726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27f38f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.264495:0:22726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27f38f lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.264502:0:22726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27f38f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.264507:0:22726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d40baef1000 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790946269.264511:0:22726:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27f38f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.264539:0:22726:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27f38f lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.264552:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:3.0:1790946269.264570:0:22726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946269.264574:0:22726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27f38f lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.264581:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d40baef1000/0xd9f4181e0d27f38f lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.264604:0:22726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27f381 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.264611:0:22726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27f381 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.264617:0:22726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27f381 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.264622:0:22726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c65c00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:3.0:1790946269.264625:0:22726:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27f381 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.265063:0:22726:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27f381 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.265077:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:3.0:1790946269.265080:0:22726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790946269.265084:0:22726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27f381 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.265112:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c65c00/0xd9f4181e0d27f381 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22726 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946269.266093:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+18:18780:x1877942616626560:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 36114us (36354us total) trans 12884901924 rc 0/0 00000100:00100000:3.0:1790946269.266107:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 70 00000020:00080000:3.0:1790946269.266113:0:22726:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790946269.267369:0:22760:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1790946269.267377:0:22760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790946269.267393:0:22760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1790946269.267400:0:22760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1790946269.270211:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946269.271009:0:24235:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616627072 00000100:00100000:2.0:1790946269.271023:0:24235:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616627072 00000100:00100000:2.0:1790946269.271092:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:2.0:1790946269.271119:0:24235:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+7:18779:x1877942616627072:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1790946269.271139:0:24235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946269.271159:0:24235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a795762/0xd9f4181e0d27f396 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c22233124b expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790946269.271234:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6abfabdc, atime: 0x6abfabda, ctime: 0x6abfabdc, blocks: 0x0 00010000:00010000:2.0:1790946269.271265:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=720s v=(0 0) 00010000:00010000:2.0:1790946269.271270:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946269.271281:0:24235:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a795762/0xd9f4181e0d27f396 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233124b expref: 8 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.271297:0:24235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006a795762/0xd9f4181e0d27f396 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c22233124b expref: 8 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.271311:0:24235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3f83c65000, rc 0) 00000100:00100000:2.0:1790946269.271380:0:24235:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+8:18779:x1877942616627072:12345-192.168.204.20@tcp:101:bash.0 Request processed in 264us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946269.271388:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:3.0:1790946269.273161:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946269.274985:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946269.275071:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616627456 00000100:00100000:0.0:1790946269.275081:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616627456 00000100:00100000:0.0:1790946269.275161:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:0.0:1790946269.275198:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+18:18779:x1877942616627456:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1790946269.275227:0:24257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946269.275247:0:24257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f39d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331252 expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.275296:0:24257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f3a4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.275310:0:24257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f3a4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.275320:0:24257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f3a4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.275425:0:24257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f39d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331252 expref: 20 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.275443:0:24257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a800/0xd9f4181e0d27f3a4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331252 expref: 19 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.275452:0:24257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:0.0:1790946269.275456:0:24257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790946269.275459:0:24257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d408630a800, rc 0) 00000100:00100000:0.0:1790946269.275511:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+19:18779:x1877942616627456:12345-192.168.204.20@tcp:101:bash.0 Request processed in 342us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946269.275518:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:2.0:1790946269.276346:0:22727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616627328 00000100:00100000:2.0:1790946269.276355:0:22727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616627328 00000100:00100000:2.0:1790946269.276400:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:2.0:1790946269.276409:0:22727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+19:18780:x1877942616627328:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790946269.276908:0:22727:0:(mdd_object.c:4180:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790946269.277011:0:22727:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:2.0:1790946269.277076:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27f3ab lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.277159:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27f3ab lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.277213:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27f3ab lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.277224:0:22727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27f3ab lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.277230:0:22727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27f3ab lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.277237:0:22727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27f3ab lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946269.277273:0:22727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790946269.277368:0:22727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+21:18780:x1877942616627328:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 958us (4213us total) trans 12884901926 rc 0/0 00000100:00100000:2.0:1790946269.277376:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000020:00080000:2.0:1790946269.277381:0:22727:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790946269.279071:0:22712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946269.279083:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27f3ab lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.279093:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3f83c64000 already unused, calling callback (ffffffffc0d4cac0) 00010000:00010000:3.0:1790946269.279097:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27f3ab lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.279107:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27f3ab lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.279122:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9d3f824e9d00) 00010000:00010000:3.0:1790946269.279126:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790946269.279131:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27f3ab lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.279136:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3f83c64000/0xd9f4181e0d27f3ab lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946269.279156:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946269.279158:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946269.279214:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946269.280501:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946269.281072:0:22727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616627712 00000100:00100000:0.0:1790946269.281085:0:22727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616627712 00000100:00100000:0.0:1790946269.281885:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:0.0:1790946269.281900:0:22727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+21:18779:x1877942616627712:12345-192.168.204.20@tcp:35:bash.0 00000001:00080000:0.0:1790946269.282121:0:22727:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:0.0:1790946269.282217:0:22727:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:0.0:1790946269.282365:0:22727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+24:18779:x1877942616627712:12345-192.168.204.20@tcp:35:bash.0 Request processed in 468us (1870us total) trans 12884901929 rc 0/0 00000100:00100000:0.0:1790946269.282373:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00000020:00080000:0.0:1790946269.282379:0:22727:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1790946269.399594:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946269.400291:0:22724:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616627968 00000100:00100000:0.0:1790946269.400304:0:22724:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616627968 00000100:00100000:0.0:1790946269.400380:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 72 00000100:00100000:0.0:1790946269.400390:0:22724:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+24:18790:x1877942616627968:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1790946269.400414:0:22724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946269.400435:0:22724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f3b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xccf0c8c222331259 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946269.400560:0:22724:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1790946269.400681:0:22724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f3b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331259 expref: 26 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.400697:0:22724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3f824e9c00) 00010000:00010000:0.0:1790946269.400699:0:22724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790946269.400704:0:22724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630a400/0xd9f4181e0d27f3b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xccf0c8c222331259 expref: 26 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.400718:0:22724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d408630a400, rc 0) 00000100:00100000:0.0:1790946269.400794:0:22724:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93f4dfa8-f0c5-48de-82e2-232116f1669e+25:18790:x1877942616627968:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 406us (1220us total) trans 12884901930 rc 301/301 00000100:00100000:0.0:1790946269.400809:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 72 00000100:00100000:1.0:1790946269.403546:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1790946269.403632:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616628096 00000100:00100000:0.0:1790946269.403642:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616628096 00000100:00100000:0.0:1790946269.403705:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 73 00000100:00100000:0.0:1790946269.403715:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+25:18790:x1877942616628096:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:0.0:1790946269.403797:0:24257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ae00/0xd9f4181e0d27f3c0 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.403814:0:24257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ae00/0xd9f4181e0d27f3c0 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.403835:0:24257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ae00/0xd9f4181e0d27f3c0 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.403850:0:24257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f3c7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.403857:0:24257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f3c7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.403863:0:24257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f3c7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.403930:0:24257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f3ce lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.403938:0:24257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f3ce lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.403944:0:24257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f3ce lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790946269.404015:0:24257:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f3ce lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.404027:0:24257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ae00/0xd9f4181e0d27f3c0 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.404034:0:24257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ae00/0xd9f4181e0d27f3c0 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.404041:0:24257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ae00/0xd9f4181e0d27f3c0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.404046:0:24257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630ae00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790946269.404050:0:24257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ae00/0xd9f4181e0d27f3c0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.404057:0:24257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ae00/0xd9f4181e0d27f3c0 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.404068:0:24257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9d40bc938200) 00010000:00010000:0.0:1790946269.404071:0:24257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946269.404075:0:24257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ae00/0xd9f4181e0d27f3c0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.404081:0:24257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ae00/0xd9f4181e0d27f3c0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.404095:0:24257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f3c7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.404101:0:24257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f3c7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.404112:0:24257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f3c7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.404117:0:24257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630aa00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790946269.404120:0:24257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f3c7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.404126:0:24257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f3c7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.404134:0:24257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9d40bc938e00) 00010000:00010000:0.0:1790946269.404136:0:24257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946269.404139:0:24257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f3c7 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.404144:0:24257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630aa00/0xd9f4181e0d27f3c7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.404156:0:24257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f3ce lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.404161:0:24257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f3ce lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.404189:0:24257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f3ce lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.404194:0:24257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d408630ba00 already unused, calling callback (ffffffffc198c4f0) 00010000:00010000:0.0:1790946269.404196:0:24257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f3ce lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.404211:0:24257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f3ce lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.404220:0:24257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9d40bc938900) 00010000:00010000:0.0:1790946269.404222:0:24257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946269.404224:0:24257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f3ce lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946269.404230:0:24257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d408630ba00/0xd9f4181e0d27f3ce lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24257 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946269.404310:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93f4dfa8-f0c5-48de-82e2-232116f1669e+25:18790:x1877942616628096:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 596us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946269.404319:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 73 00000100:00100000:1.0:1790946269.412333:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1790946269.412494:0:22728:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616628352 00000100:00100000:3.0:1790946269.412505:0:22728:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616628352 00000100:00100000:3.0:1790946269.412571:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:3.0:1790946269.412591:0:22728:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+25:18790:x1877942616628352:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:3.0:1790946269.412833:0:22728:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93f4dfa8-f0c5-48de-82e2-232116f1669e+26:18790:x1877942616628352:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 252us (510us total) trans 12884901931 rc 0/0 00000100:00100000:3.0:1790946269.412841:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15 00010000:00010000:2.0:1790946269.472989:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946270.502782:0:22713:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790946271.057673:0:25808:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:3.0:1790946271.072817:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5d0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638740736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790946271.072897:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946271.073425:0:24236:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638740736 00000100:00100000:2.0:1790946271.073436:0:24236:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638740736 00000100:00100000:2.0:1790946271.073564:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790946271.073576:0:24236:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638740736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790946271.073618:0:24236:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790946271.073687:0:24236:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638740736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946271.073712:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790946271.074447:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5d0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638740736:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1790946271.074475:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790946271.520400:0:22712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946271.583991:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790946271.584016:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638740864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790946271.584090:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946271.584327:0:23467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638740864 00000100:00100000:3.0:1790946271.584336:0:23467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638740864 00000100:00100000:3.0:1790946271.584384:0:23467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790946271.584395:0:23467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638740864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790946271.584427:0:23467:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1790946271.584483:0:23467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877942638740864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946271.584490:0:23467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790946271.585263:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790946271.585280:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638740992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790946271.585324:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946271.585386:0:22730:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638740992 00000100:00100000:0.0:1790946271.585391:0:22730:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638740992 00000100:00100000:0.0:1790946271.585427:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790946271.585434:0:22730:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638740992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790946271.585851:0:22730:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790946271.585905:0:22730:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877942638740992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 470us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946271.585912:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790946271.585962:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1877942638740864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790946271.586408:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1877942638740992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790946272.095639:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790946272.095662:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40b5cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638741120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790946272.095730:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946272.095797:0:24236:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638741120 00000100:00100000:1.0:1790946272.095805:0:24236:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638741120 00000100:00100000:1.0:1790946272.095858:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790946272.095870:0:24236:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40b5cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638741120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790946272.095898:0:24236:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1790946272.095943:0:24236:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40b5cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1877942638741120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946272.095949:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1790946272.095969:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790946272.096004:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40b5cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1877942638741120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790946272.096446:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790946272.096456:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d3f835ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638741376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790946272.096487:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946272.096522:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790946272.096541:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638741248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790946272.096566:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946272.096778:0:24237:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638741376 00000100:00100000:1.0:1790946272.096784:0:24237:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638741376 00000100:00100000:0.0:1790946272.096912:0:24236:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638741248 00000100:00100000:0.0:1790946272.096923:0:24236:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638741248 00000100:00100000:1.0:1790946272.096976:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790946272.096984:0:24237:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1877942638741376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790946272.097000:0:24237:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790946272.097037:0:24237:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1877942638741376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946272.097043:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790946272.102001:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638741888:0@lo:400:kworker.0 00000100:00100000:2.0:1790946272.102071:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946272.102107:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638742400:0@lo:400:kworker.0 00000100:00100000:2.0:1790946272.102127:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946272.102150:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790946272.102156:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3649:1877942638741504:0@lo:400:kworker.0 00000100:00100000:2.0:1790946272.102209:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946272.102254:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638742016:0@lo:400:kworker.0 00000100:00100000:2.0:1790946272.102276:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946272.102305:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638741504 00000100:00100000:2.0:1790946272.102312:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638741504 00000100:00100000:2.0:1790946272.102356:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1790946272.102365:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:3649:x1877942638741504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946272.102417:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32dbedc5-819a-4eba-958c-cd7c205dd6c7+24:3649:x1877942638741504:12345-0@lo:400:kworker.0 Request processed in 53us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946272.102424:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1790946272.102455:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638741888 00000100:00100000:2.0:1790946272.102459:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638741888 00000100:00100000:2.0:1790946272.102483:0:24257:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638742400 00000100:00100000:2.0:1790946272.102486:0:24257:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638742400 00000100:00080000:3.0:1790946272.107196:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790946272.107241:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638741632:0@lo:400:kworker.0 00000100:00100000:3.0:1790946272.107330:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946272.107361:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638742144:0@lo:400:kworker.0 00000100:00100000:3.0:1790946272.107385:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946272.107405:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790946272.107411:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638741760:0@lo:400:kworker.0 00000100:00100000:3.0:1790946272.107433:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946272.107450:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9d40bff81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638742272:0@lo:400:kworker.0 00000100:00100000:3.0:1790946272.107484:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946272.107513:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638742016 00000100:00100000:3.0:1790946272.107521:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638742016 00000100:00100000:3.0:1790946272.107689:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638741632 00000100:00100000:3.0:1790946272.107694:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638741632 00000100:00100000:3.0:1790946272.107708:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638742144 00000100:00100000:3.0:1790946272.107711:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638742144 00000100:00100000:3.0:1790946272.107721:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638742272 00000100:00100000:3.0:1790946272.107723:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638742272 00000100:00100000:3.0:1790946272.107738:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790946272.107747:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638741888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946272.107802:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877942638741888:12345-0@lo:400:kworker.0 Request processed in 55us (5730us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946272.107809:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790946272.107827:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790946272.107833:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638742016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946272.107862:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877942638742016:12345-0@lo:400:kworker.0 Request processed in 30us (5586us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946272.107886:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790946272.107900:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790946272.107905:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638741632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946272.107942:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1877942638741632:12345-0@lo:400:kworker.0 Request processed in 37us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946272.107948:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790946272.107959:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790946272.107966:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638742144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946272.108262:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1877942638742144:12345-0@lo:400:kworker.0 Request processed in 296us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946272.108270:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790946272.108284:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790946272.108362:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638742272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946272.108396:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1877942638742272:12345-0@lo:400:kworker.0 Request processed in 107us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946272.108402:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790946272.108430:0:24233:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942638741760 00000100:00100000:3.0:1790946272.108435:0:24233:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942638741760 00000100:00100000:3.0:1790946272.108464:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790946272.108517:0:24233:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638741760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946272.108561:0:24233:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1877942638741760:12345-0@lo:400:kworker.0 Request processed in 91us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946272.108568:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790946272.108617:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d3f835ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1877942638741376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790946272.108650:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1877942638741760:0@lo:400:kworker.0 00000100:00100000:3.0:1790946272.108671:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1877942638742272:0@lo:400:kworker.0 00000100:00100000:3.0:1790946272.108681:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1877942638741632:0@lo:400:kworker.0 00010000:00080000:3.0:1790946272.108692:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bff81880 x1877942638742144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946272.108703:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1877942638742144:0@lo:400:kworker.0 00000100:00080000:3.0:1790946272.108811:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790946272.108816:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790946272.108819:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790946272.108821:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790946272.110347:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32dbedc5-819a-4eba-958c-cd7c205dd6c7:3649:1877942638741504:0@lo:400:kworker.0 00000100:00100000:3.0:1790946272.110372:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1877942638742016:0@lo:400:kworker.0 00000100:00100000:3.0:1790946272.110385:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877942638741888:0@lo:400:kworker.0 00000100:00100000:0.0:1790946272.111795:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790946272.111808:0:24236:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3f835eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638741248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790946272.111832:0:24236:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1790946272.111910:0:24236:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3f835eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1877942638741248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (15342us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946272.111918:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790946272.111982:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1877942638741248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790946272.115201:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790946272.115216:0:24257:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877942638742400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946272.115640:0:24257:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877942638742400:12345-0@lo:400:kworker.0 Request processed in 426us (13509us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946272.115661:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1790946272.115747:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d40bff81500 x1877942638742400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946272.115762:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9d40bff81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1877942638742400:0@lo:400:kworker.0 00000100:00100000:2.0:1790946272.325215:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946272.325260:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946272.325288:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946272.325316:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946272.325341:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946272.325356:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946272.325371:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946272.325389:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946272.325410:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1790946272.325437:0:24235:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616628864 00000100:00100000:2.0:1790946272.325448:0:24235:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616628864 00000100:00100000:2.0:1790946272.325499:0:24235:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616629376 00000100:00100000:2.0:1790946272.325501:0:24235:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616629376 00000100:00100000:2.0:1790946272.325511:0:24235:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616628992 00000100:00100000:2.0:1790946272.325514:0:24235:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616628992 00000100:00100000:2.0:1790946272.325524:0:24235:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616629504 00000100:00100000:2.0:1790946272.325538:0:24235:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616629504 00000100:00100000:2.0:1790946272.325554:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:2.0:1790946272.325563:0:24235:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+8:2401:x1877942616628864:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790946272.325634:0:24235:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+8:2401:x1877942616628864:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 72us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946272.325641:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:2.0:1790946272.325662:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:2.0:1790946272.325668:0:24235:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+5:2401:x1877942616629376:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790946272.325692:0:24235:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+5:2401:x1877942616629376:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946272.325716:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:2.0:1790946272.325729:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:2.0:1790946272.325735:0:24235:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+5:2401:x1877942616628992:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790946272.325761:0:24235:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+5:2401:x1877942616628992:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 27us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946272.325766:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:2.0:1790946272.325775:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:2.0:1790946272.325781:0:24235:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+5:2401:x1877942616629504:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790946272.325800:0:24235:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+5:2401:x1877942616629504:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 20us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946272.325805:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:2.0:1790946272.325822:0:22719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616628480 00000100:00100000:2.0:1790946272.325825:0:22719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616628480 00000100:00100000:2.0:1790946272.325847:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 166 00000100:00100000:2.0:1790946272.325854:0:22719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d4085cc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bd124a6-b6bd-4e62-987b-f878bfee98e2+13:2401:x1877942616628480:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790946272.325877:0:22719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d4085cc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bd124a6-b6bd-4e62-987b-f878bfee98e2+13:2401:x1877942616628480:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 24us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946272.325883:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 166 00000100:00100000:2.0:1790946272.325927:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616628608 00000100:00100000:2.0:1790946272.325930:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616628608 00000100:00100000:2.0:1790946272.325961:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616629120 00000100:00100000:2.0:1790946272.325964:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616629120 00000100:00100000:2.0:1790946272.325972:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616628736 00000100:00100000:2.0:1790946272.325974:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616628736 00000100:00100000:2.0:1790946272.325983:0:22726:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942616629248 00000100:00100000:2.0:1790946272.325990:0:22726:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942616629248 00000100:00100000:2.0:1790946272.326004:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:2.0:1790946272.326009:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+26:2401:x1877942616628608:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790946272.326037:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+26:2401:x1877942616628608:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 28us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946272.326043:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:2.0:1790946272.326052:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:2.0:1790946272.326057:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+6:2401:x1877942616629120:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790946272.326078:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+6:2401:x1877942616629120:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 20us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946272.326084:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:2.0:1790946272.326095:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:2.0:1790946272.326100:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+5:2401:x1877942616628736:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790946272.326124:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93f4dfa8-f0c5-48de-82e2-232116f1669e+5:2401:x1877942616628736:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 24us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946272.326130:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:2.0:1790946272.326140:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:2.0:1790946272.326145:0:22726:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9d40bff81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+5:2401:x1877942616629248:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1790946272.326161:0:22726:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9d40bff81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9f48c6e-ea20-465c-a9e8-4a851f3ac66f+5:2401:x1877942616629248:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 16us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946272.326192:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00080000:1.0:1790946272.326596:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790946272.326602:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790946272.326605:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790946272.326607:0:22720:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790946272.543351:0:23880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14196 lines, 14196 kept, 0 dropped, 0 bad.