00000001:00080000:2.0F:1788483252.479939:0:17202:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:2.0:1788483252.479965:0:17202:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a68c2623f00 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:2.0:1788483252.479971:0:17202:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a69ed9d5e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a69c9725840 00000020:00080000:2.0:1788483252.479974:0:17202:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a69ed9d5100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a68c3306800 00000020:00080000:1.0F:1788483252.480129:0:17262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:1.0:1788483252.480206:0:17262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0F:1788483252.480210:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1be66 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483252.480227:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1be66 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483252.480235:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1be66 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483252.480240:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483252.480245:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1be66 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483252.480252:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1be66 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483252.480270:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a69fd169400) 00010000:00010000:3.0:1788483252.480273:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483252.480277:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1be66 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483252.480284:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26200/0x1d7ea3d89ea1be66 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483252.536338:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1788483253.496261:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098776960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788483253.496338:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483253.496393:0:20364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098776960 00000100:00100000:0.0:1788483253.496399:0:20364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098776960 00000100:00100000:0.0:1788483253.496446:0:20364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788483253.496457:0:20364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098776960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788483253.496480:0:20364:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788483253.496518:0:20364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098776960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483253.496526:0:20364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788483253.496545:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483253.496616:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098776960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788483253.499197:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098777088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788483253.499255:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483253.499897:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098777088 00000100:00100000:3.0:1788483253.499906:0:18733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098777088 00000100:00080000:0.0:1788483253.499965:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788483253.499970:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788483253.499981:0:18733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098777088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788483253.500001:0:18733:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788483253.500057:0:18733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098777088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483253.500078:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788483253.500155:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098777088:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788483253.560340:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483254.520238:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c4d0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098777216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788483254.520307:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483254.520365:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098777216 00000100:00100000:1.0:1788483254.520371:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098777216 00000100:00100000:1.0:1788483254.520416:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788483254.520425:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c4d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098777216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788483254.520457:0:17227:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788483254.520498:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c4d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098777216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483254.520518:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788483254.520565:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c4d0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098777216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483254.522964:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efde9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098777344:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788483254.523028:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483254.523078:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098777344 00000100:00100000:2.0:1788483254.523085:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098777344 00000100:00100000:2.0:1788483254.523141:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788483254.523151:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efdeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098777344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788483254.523180:0:17963:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788483254.523222:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efdeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098777344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483254.523230:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788483254.523269:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efde9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098777344:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788483254.585503:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788483255.229060:0:17258:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788483255.229068:0:17258:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788483255.229088:0:17258:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788483255.229132:0:17258:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788483255.460535:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483255.460581:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483255.460609:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483255.460634:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087158912 00000100:00100000:2.0:1788483255.460643:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087158912 00000100:00100000:3.0:1788483255.460764:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087159040 00000100:00100000:3.0:1788483255.460769:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087159040 00000100:00100000:3.0:1788483255.460807:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087159168 00000100:00100000:3.0:1788483255.460810:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087159168 00000100:00100000:3.0:1788483255.461931:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 81 00000100:00100000:3.0:1788483255.461946:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efde9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f66e931-3201-4238-a1e4-162d21e5f09a+13:2390:x1875360087159040:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483255.462023:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efde9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f66e931-3201-4238-a1e4-162d21e5f09a+13:2390:x1875360087159040:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 82us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483255.462030:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 81 00000100:00100000:3.0:1788483255.462051:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 82 00000100:00100000:3.0:1788483255.462058:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efdeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2390:x1875360087159168:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483255.462089:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efdeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2390:x1875360087159168:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 25us (1473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483255.462110:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 82 00000100:00080000:3.0:1788483255.462132:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788483255.462136:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788483255.462212:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 170 00000100:00100000:2.0:1788483255.462223:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:2390:x1875360087158912:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483255.462252:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:2390:x1875360087158912:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 33us (1672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483255.462258:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 170 00000100:00100000:1.0:1788483255.478916:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483255.479002:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483255.479035:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483255.479058:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483255.479121:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087159680 00000100:00100000:0.0:1788483255.479131:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087159680 00000100:00100000:0.0:1788483255.479187:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087159552 00000100:00100000:0.0:1788483255.479190:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087159552 00000100:00100000:0.0:1788483255.479213:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 83 00000100:00100000:0.0:1788483255.479222:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c4d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2390:x1875360087159680:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483255.479291:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c4d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2390:x1875360087159680:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 70us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483255.479299:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 83 00000100:00100000:0.0:1788483255.479316:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 84 00000100:00100000:0.0:1788483255.479321:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c4d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:2390:x1875360087159552:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483255.479350:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c4d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:2390:x1875360087159552:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 29us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483255.479356:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 84 00000100:00080000:0.0:1788483255.479370:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788483255.479374:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788483255.491427:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483255.496203:0:19165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087159424 00000100:00100000:2.0:1788483255.496234:0:19165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087159424 00000100:00100000:2.0:1788483255.496356:0:18730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087159296 00000100:00100000:2.0:1788483255.496359:0:18730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087159296 00000100:00100000:2.0:1788483255.496385:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 35 00000100:00100000:2.0:1788483255.496395:0:18730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c4d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2390:x1875360087159424:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483255.496465:0:18730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c4d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2390:x1875360087159424:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 72us (17559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483255.496472:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 35 00000100:00100000:2.0:1788483255.496488:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 31 00000100:00100000:2.0:1788483255.496495:0:18730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c4d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2389:x1875360087159296:12345-192.168.206.54@tcp:9:kworker.0 00000020:00000080:2.0:1788483255.496512:0:18730:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1bb95 00000100:00080000:2.0:1788483255.496526:0:18730:0:(import.c:65:import_set_state_nolock()) ffff9a68c1fc2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788483255.496567:0:18730:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788483255.496690:0:18730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c4d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+2:2389:x1875360087159296:12345-192.168.206.54@tcp:9:kworker.0 Request processed in 196us (17631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483255.496697:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 31 00010000:00010000:2.0:1788483255.496715:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483255.498912:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00080000:1.0:1788483255.499011:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788483255.499017:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788483255.500428:0:20063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087159808 00000100:00100000:2.0:1788483255.500439:0:20063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087159808 00000100:00100000:2.0:1788483255.500490:0:20063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087159936 00000100:00100000:2.0:1788483255.500493:0:20063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087159936 00000100:00100000:2.0:1788483255.500520:0:20063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 32 00000100:00100000:2.0:1788483255.500529:0:20063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c4d09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2389:x1875360087159808:12345-192.168.206.54@tcp:9:kworker.0 00000020:00000080:2.0:1788483255.500561:0:20063:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1bbd4 00000100:00080000:2.0:1788483255.500569:0:20063:0:(import.c:65:import_set_state_nolock()) ffff9a68c36e3800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788483255.500610:0:20063:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788483255.500947:0:20063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c4d09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+2:2389:x1875360087159808:12345-192.168.206.54@tcp:9:kworker.0 Request processed in 417us (9528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483255.501430:0:20063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 32 00000100:00100000:2.0:1788483255.501452:0:20063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 33 00000100:00100000:2.0:1788483255.501461:0:20063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c4d0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2389:x1875360087159936:12345-192.168.206.54@tcp:9:kworker.0 00000020:00000080:2.0:1788483255.501476:0:20063:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1bbdb 00000100:00080000:2.0:1788483255.501484:0:20063:0:(import.c:65:import_set_state_nolock()) ffff9a68c1d34800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788483255.501511:0:20063:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1788483255.501599:0:20063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c4d0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+2:2389:x1875360087159936:12345-192.168.206.54@tcp:9:kworker.0 Request processed in 139us (2694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483255.501606:0:20063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 33 00010000:00010000:2.0:1788483255.501635:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788483255.501933:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788483255.501939:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788483255.502399:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483255.609634:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483255.970181:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483255.970275:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087160064 00000100:00100000:0.0:1788483255.970285:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087160064 00000100:00100000:0.0:1788483255.970351:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 65 00000100:00100000:0.0:1788483255.970361:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c4d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f66e931-3201-4238-a1e4-162d21e5f09a+13:15598:x1875360087160064:12345-192.168.206.54@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788483255.970467:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c4d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f66e931-3201-4238-a1e4-162d21e5f09a+13:15598:x1875360087160064:12345-192.168.206.54@tcp:60:lhsmtool_posix.0 Request processed in 108us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483255.970475:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 65 00000100:00100000:2.0:1788483255.988392:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483255.994252:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087160192 00000100:00100000:3.0:1788483255.994268:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087160192 00000100:00100000:3.0:1788483255.994347:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 66 00000100:00100000:3.0:1788483255.994357:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efde9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+5:15598:x1875360087160192:12345-192.168.206.54@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788483255.994480:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efde9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+5:15598:x1875360087160192:12345-192.168.206.54@tcp:60:lhsmtool_posix.0 Request processed in 124us (6095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483255.994489:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 66 00000100:00100000:1.0:1788483256.008343:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483256.008569:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087160448 00000100:00100000:0.0:1788483256.008579:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087160448 00000100:00100000:0.0:1788483256.008639:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 12 00000100:00100000:0.0:1788483256.008650:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c4d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+13:15598:x1875360087160448:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788483256.009231:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c4d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+14:15598:x1875360087160448:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 Request processed in 580us (894us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1788483256.009240:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 12 00010000:00010000:0.0:1788483256.633141:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483257.080959:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098777856:0@lo:400:kworker.0 00000100:00100000:3.0:1788483257.081019:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483257.081124:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098778368:0@lo:400:kworker.0 00000100:00100000:3.0:1788483257.081157:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483257.081183:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098778880:0@lo:400:kworker.0 00000100:00100000:3.0:1788483257.081207:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483257.081230:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788483257.081236:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098777472:0@lo:400:kworker.0 00000100:00100000:3.0:1788483257.081261:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483257.081283:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098777984:0@lo:400:kworker.0 00000100:00100000:3.0:1788483257.081303:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483257.081321:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098778496:0@lo:400:kworker.0 00000100:00100000:3.0:1788483257.081339:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483257.081353:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098779008:0@lo:400:kworker.0 00000100:00100000:3.0:1788483257.081371:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483257.081394:0:20063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098777856 00000100:00100000:3.0:1788483257.081400:0:20063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098777856 00000100:00100000:3.0:1788483257.081446:0:20063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098778368 00000100:00100000:3.0:1788483257.081449:0:20063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098778368 00000100:00100000:3.0:1788483257.081471:0:20063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788483257.082559:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098777600:0@lo:400:kworker.0 00000100:00100000:1.0:1788483257.082631:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483257.082660:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098778112:0@lo:400:kworker.0 00000100:00100000:1.0:1788483257.082694:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483257.082714:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098778624:0@lo:400:kworker.0 00000100:00100000:1.0:1788483257.082735:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483257.082746:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c4d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098779136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483257.082766:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483257.082789:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788483257.082794:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6232680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098777728:0@lo:400:kworker.0 00000100:00100000:1.0:1788483257.082830:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483257.082857:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098778240:0@lo:400:kworker.0 00000100:00100000:1.0:1788483257.082878:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483257.082888:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098778752:0@lo:400:kworker.0 00000100:00100000:1.0:1788483257.082918:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788483257.082945:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788483257.082958:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098777600 00000100:00100000:1.0:1788483257.082963:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098777600 00000100:00100000:1.0:1788483257.082996:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098778112 00000100:00100000:1.0:1788483257.082999:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098778112 00000100:00100000:1.0:1788483257.083014:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788483257.083021:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c4d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098777600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483257.083125:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c4d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098777600:12345-0@lo:400:kworker.0 Request processed in 74us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483257.083827:0:20063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098777856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483257.083901:0:20063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098777856:12345-0@lo:400:kworker.0 Request processed in 2421us (2879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483257.083920:0:20063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788483257.083943:0:20063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098777728 00000100:00100000:3.0:1788483257.083947:0:20063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098777728 00000100:00100000:3.0:1788483257.083974:0:20063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098778240 00000100:00100000:3.0:1788483257.083977:0:20063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098778240 00000100:00100000:3.0:1788483257.083992:0:20063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788483257.083998:0:20063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098778368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483257.084028:0:20063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098778368:12345-0@lo:400:kworker.0 Request processed in 30us (2871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483257.084034:0:20063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788483257.084043:0:20063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788483257.084049:0:20063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098777728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483257.084073:0:20063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098777728:12345-0@lo:400:kworker.0 Request processed in 24us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483257.084079:0:20063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788483257.084585:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788483257.084605:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788483257.084613:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c4d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098778112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483257.084686:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c4d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098778112:12345-0@lo:400:kworker.0 Request processed in 73us (1989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483257.084692:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788483257.084713:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098779136 00000100:00100000:1.0:1788483257.084718:0:18732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098779136 00000100:00100000:1.0:1788483257.084745:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788483257.084751:0:18732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c4d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098779136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788483257.084770:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788483257.084800:0:18732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c4d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098779136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (2033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483257.084818:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788483257.084845:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788483257.084877:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6232680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098777728:0@lo:400:kworker.0 00000100:00100000:1.0:1788483257.084890:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098777600:0@lo:400:kworker.0 00000100:00100000:1.0:1788483257.084900:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098778112:0@lo:400:kworker.0 00000100:00100000:1.0:1788483257.084916:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c4d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098779136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483257.084936:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788483257.084947:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efdeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098779264:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788483257.084976:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483257.085003:0:20364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098779264 00000100:00100000:1.0:1788483257.085007:0:20364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098779264 00000100:00100000:1.0:1788483257.085025:0:20364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788483257.085032:0:20364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e00d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098779264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788483257.085055:0:20364:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788483257.085121:0:20364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e00d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098779264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483257.085142:0:20364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788483257.085172:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efdeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098779264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788483257.092122:0:19165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788483257.092159:0:19165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098778240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483257.092259:0:19165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098778240:12345-0@lo:400:kworker.0 Request processed in 116us (9380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483257.092267:0:19165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788483257.092327:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098778880 00000100:00100000:2.0:1788483257.092334:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098778880 00000100:00100000:2.0:1788483257.092373:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098777984 00000100:00100000:2.0:1788483257.092376:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098777984 00000100:00100000:2.0:1788483257.092387:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098778496 00000100:00100000:2.0:1788483257.092390:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098778496 00000100:00100000:2.0:1788483257.092400:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098779008 00000100:00100000:2.0:1788483257.092402:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098779008 00000100:00100000:2.0:1788483257.092414:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098778624 00000100:00100000:2.0:1788483257.092416:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098778624 00000100:00100000:2.0:1788483257.092427:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098778752 00000100:00100000:2.0:1788483257.092444:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098778752 00000100:00100000:2.0:1788483257.092463:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788483257.092470:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098778880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483257.092518:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875360098778880:12345-0@lo:400:kworker.0 Request processed in 49us (11310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483257.092525:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788483257.092538:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788483257.092544:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098777984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483257.092572:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098777984:12345-0@lo:400:kworker.0 Request processed in 28us (11268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483257.092578:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788483257.092590:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788483257.092595:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098778496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483257.092622:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098778496:12345-0@lo:400:kworker.0 Request processed in 27us (11282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483257.092628:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788483257.092638:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788483257.092644:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098779008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483257.092683:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098779008:12345-0@lo:400:kworker.0 Request processed in 39us (11310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483257.092689:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788483257.092700:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788483257.092706:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c4d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098778624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483257.092734:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c4d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098778624:12345-0@lo:400:kworker.0 Request processed in 28us (9997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483257.092749:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788483257.092760:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788483257.092765:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e00d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098778752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483257.092794:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e00d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098778752:12345-0@lo:400:kworker.0 Request processed in 29us (9875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483257.092799:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788483257.094496:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098777472 00000100:00100000:1.0:1788483257.094509:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098777472 00000100:00100000:1.0:1788483257.094564:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788483257.094573:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:3619:x1875360098777472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483257.094645:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:3619:x1875360098777472:12345-0@lo:400:kworker.0 Request processed in 73us (13381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483257.094652:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:1.0:1788483257.094734:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788483257.094739:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788483257.094773:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098778240:0@lo:400:kworker.0 00010000:00080000:1.0:1788483257.094790:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd936300 x1875360098778752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483257.094800:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098778752:0@lo:400:kworker.0 00000100:00100000:1.0:1788483257.095005:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098778624:0@lo:400:kworker.0 00000100:00100000:1.0:1788483257.095369:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098777472:0@lo:400:kworker.0 00000100:00100000:1.0:1788483257.095383:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098777984:0@lo:400:kworker.0 00000100:00100000:1.0:1788483257.095393:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098778496:0@lo:400:kworker.0 00010000:00080000:1.0:1788483257.095405:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f525d880 x1875360098779008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483257.095414:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098779008:0@lo:400:kworker.0 00000100:00100000:1.0:1788483257.095444:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c35fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098777856:0@lo:400:kworker.0 00000100:00100000:1.0:1788483257.095455:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098778368:0@lo:400:kworker.0 00000100:00100000:1.0:1788483257.095466:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3619:1875360098778880:0@lo:400:kworker.0 00010000:00010000:1.0:1788483257.656451:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483258.617017:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788483258.617042:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098779392:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788483258.617144:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483258.617435:0:20364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098779392 00000100:00100000:0.0:1788483258.617443:0:20364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098779392 00000100:00100000:0.0:1788483258.617509:0:20364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788483258.617519:0:20364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efde8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098779392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788483258.617548:0:20364:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788483258.617597:0:20364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efde8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098779392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483258.617613:0:20364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788483258.617919:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098779520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788483258.617951:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483258.618001:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098779392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788483258.619324:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098779520 00000100:00100000:3.0:1788483258.619335:0:18733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098779520 00000100:00100000:3.0:1788483258.619400:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788483258.619410:0:18733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efdeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098779520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788483258.619430:0:18733:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788483258.619562:0:18733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efdeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098779520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483258.619570:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788483258.619752:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098779520:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788483258.622952:0:17202:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:2.0:1788483258.622968:0:17202:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:1.0:1788483258.623036:0:17262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:1.0:1788483258.623047:0:17262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:1.0:1788483258.682897:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788483259.532596:0:20600:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 20:54:17 (1788483257) 00000100:00100000:2.0:1788483259.643369:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098779648:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483259.643450:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483259.643503:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788483259.643510:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098779776:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788483259.643535:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483259.643571:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098779648 00000100:00100000:2.0:1788483259.643578:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098779648 00000100:00100000:2.0:1788483259.643617:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098779776 00000100:00100000:2.0:1788483259.643631:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098779776 00000100:00100000:2.0:1788483259.643650:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788483259.643658:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098779648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788483259.643690:0:17963:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788483259.643729:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098779648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483259.643736:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788483259.643751:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788483259.643757:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098779776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788483259.643771:0:17963:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788483259.643793:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098779776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 36us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483259.643798:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788483259.643842:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098779776:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788483259.643854:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098779648:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788483259.707303:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483260.569361:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483260.569411:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483260.569449:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087160576 00000100:00100000:1.0:1788483260.569459:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087160576 00000100:00100000:1.0:1788483260.569512:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 172 00000100:00100000:1.0:1788483260.569521:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:2393:x1875360087160576:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483260.569584:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:2393:x1875360087160576:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 63us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483260.569591:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 172 00000100:00100000:0.0:1788483260.570150:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087160704 00000100:00100000:0.0:1788483260.570155:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087160704 00000100:00100000:0.0:1788483260.570200:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 91 00000100:00100000:0.0:1788483260.570209:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e00d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+13:2392:x1875360087160704:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483260.570258:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e00d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f66e931-3201-4238-a1e4-162d21e5f09a+13:2392:x1875360087160704:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 51us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483260.570264:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 91 00000100:00080000:0.0:1788483260.570282:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788483260.570315:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483260.570360:0:19165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087160960 00000100:00100000:0.0:1788483260.570365:0:19165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087160960 00000100:00100000:0.0:1788483260.570398:0:19165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 40 00000100:00100000:0.0:1788483260.570410:0:19165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2392:x1875360087160960:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483260.570442:0:19165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2392:x1875360087160960:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 38us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483260.570448:0:19165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 40 00000100:00080000:0.0:1788483260.570464:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788483260.584722:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483260.584754:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483260.584862:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087161216 00000100:00100000:0.0:1788483260.584864:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483260.584873:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087161216 00000100:00080000:0.0:1788483260.584903:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788483260.584930:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087160832 00000100:00100000:1.0:1788483260.584934:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087160832 00000100:00100000:1.0:1788483260.584955:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087161088 00000100:00100000:1.0:1788483260.584958:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087161088 00000100:00100000:1.0:1788483260.584976:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 92 00000100:00100000:1.0:1788483260.584986:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2392:x1875360087161216:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483260.585017:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 93 00000100:00100000:0.0:1788483260.585029:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2393:x1875360087160832:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483260.585057:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2392:x1875360087161216:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 72us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483260.585072:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 92 00000100:00100000:1.0:1788483260.585089:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 94 00000100:00100000:1.0:1788483260.585124:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:2393:x1875360087161088:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483260.585152:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:2393:x1875360087161088:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 57us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483260.585159:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 94 00000100:00100000:0.0:1788483260.585188:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2393:x1875360087160832:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 39us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483260.585202:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 93 00000100:00080000:0.0:1788483260.585221:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788483260.585223:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:2.0:1788483260.733736:0:17976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788483260.737871:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788483261.693306:0:19542:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6 00000020:00000080:2.0:1788483261.693314:0:19542:0:(genops.c:885:class_export_put()) final put ffff9a69f6ab6800/ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6 00000001:00100000:1.0:1788483261.693915:0:18725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6 00000020:00000080:1.0:1788483261.693920:0:18725:0:(genops.c:885:class_export_put()) final put ffff9a68c36e4800/ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6 00000001:00100000:1.0:1788483261.693946:0:18725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0f66e931-3201-4238-a1e4-162d21e5f09a 00000020:00000080:1.0:1788483261.693948:0:18725:0:(genops.c:885:class_export_put()) final put ffff9a68c1fc1800/0f66e931-3201-4238-a1e4-162d21e5f09a 00000020:00000080:3.0:1788483261.693989:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c36e4800/ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6 for lustre-OST0000 00000020:00000080:3.0:1788483261.694040:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c1fc1800/0f66e931-3201-4238-a1e4-162d21e5f09a for lustre-OST0000 00000020:00000080:3.0:1788483261.694055:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c36e3800 for lustre-OST0000 00000020:00000080:3.0:1788483261.694067:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c1fc2800 for lustre-OST0000 00000020:00000080:1.0:1788483261.694744:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69f6ab6800/ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6 for lustre-OST0001 00000020:00000080:1.0:1788483261.694997:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c1d34800 for lustre-OST0001 00010000:00010000:1.0:1788483261.754184:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483262.200893:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098780288:0@lo:400:kworker.0 00000100:00100000:2.0:1788483262.200952:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483262.201004:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098780800:0@lo:400:kworker.0 00000100:00100000:2.0:1788483262.201028:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483262.201048:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1875360098781312:0@lo:400:kworker.0 00000100:00100000:2.0:1788483262.201085:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483262.201149:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788483262.201155:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098780160:0@lo:400:kworker.0 00000100:00100000:2.0:1788483262.201192:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483262.201207:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098780672:0@lo:400:kworker.0 00000100:00100000:2.0:1788483262.201227:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483262.201241:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1875360098781184:0@lo:400:kworker.0 00000100:00100000:2.0:1788483262.201258:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483262.201478:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098780288 00000100:00100000:0.0:1788483262.201486:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098780288 00000100:00100000:0.0:1788483262.201534:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098780800 00000100:00100000:0.0:1788483262.201537:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098780800 00000100:00100000:0.0:1788483262.201550:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098780160 00000100:00100000:0.0:1788483262.201552:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098780160 00000100:00100000:0.0:1788483262.201562:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098780672 00000100:00100000:0.0:1788483262.201564:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098780672 00000100:00100000:0.0:1788483262.201576:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788483262.201584:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098780288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483262.201631:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098780288:12345-0@lo:400:kworker.0 Request processed in 48us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483262.201638:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788483262.201653:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788483262.201658:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098780800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483262.201679:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098780800:12345-0@lo:400:kworker.0 Request processed in 22us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483262.201684:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788483262.201693:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788483262.201698:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098780160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483262.201717:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098780160:12345-0@lo:400:kworker.0 Request processed in 19us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483262.201722:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788483262.201738:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788483262.201743:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098780672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483262.201765:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098780672:12345-0@lo:400:kworker.0 Request processed in 22us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483262.201770:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788483262.201786:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098781312 00000100:00100000:0.0:1788483262.201789:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098781312 00000100:00100000:0.0:1788483262.201825:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098781184 00000100:00100000:0.0:1788483262.201828:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098781184 00000100:00100000:0.0:1788483262.201845:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788483262.201851:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875360098781312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483262.201877:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875360098781312:12345-0@lo:400:kworker.0 Request processed in 26us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483262.201882:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788483262.201891:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788483262.201896:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875360098781184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483262.201915:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875360098781184:12345-0@lo:400:kworker.0 Request processed in 19us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483262.201921:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788483262.201957:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098780160:0@lo:400:kworker.0 00000100:00100000:0.0:1788483262.201967:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098780672:0@lo:400:kworker.0 00010000:00080000:0.0:1788483262.201976:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f22300 x1875360098781184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483262.201987:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1875360098781184:0@lo:400:kworker.0 00000100:00100000:0.0:1788483262.201994:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098780288:0@lo:400:kworker.0 00000100:00100000:0.0:1788483262.202010:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098780800:0@lo:400:kworker.0 00000100:00100000:0.0:1788483262.202018:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3622:1875360098781312:0@lo:400:kworker.0 00000100:00100000:1.0:1788483262.202379:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098779904:0@lo:400:kworker.0 00000100:00100000:1.0:1788483262.202414:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483262.202439:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098780416:0@lo:400:kworker.0 00000100:00100000:1.0:1788483262.202461:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483262.202475:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098780928:0@lo:400:kworker.0 00000100:00100000:1.0:1788483262.202493:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483262.202506:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098781440:0@lo:400:kworker.0 00000100:00100000:1.0:1788483262.202523:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483262.202538:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788483262.202543:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098780032:0@lo:400:kworker.0 00000100:00100000:1.0:1788483262.202564:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483262.202591:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098780544:0@lo:400:kworker.0 00000100:00100000:1.0:1788483262.202653:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483262.202669:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098781056:0@lo:400:kworker.0 00000100:00100000:1.0:1788483262.202688:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483262.202712:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098780416 00000100:00100000:1.0:1788483262.202715:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098780416 00000100:00100000:1.0:1788483262.202734:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098780928 00000100:00100000:1.0:1788483262.202736:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098780928 00000100:00100000:1.0:1788483262.202745:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098781440 00000100:00100000:1.0:1788483262.202747:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098781440 00000100:00100000:1.0:1788483262.202758:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098781056 00000100:00100000:1.0:1788483262.202760:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098781056 00000100:00100000:1.0:1788483262.202773:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788483262.202779:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e00d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098780416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483262.202826:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e00d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098780416:12345-0@lo:400:kworker.0 Request processed in 47us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483262.202832:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788483262.202844:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788483262.202849:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e00d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098780928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483262.202874:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e00d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098780928:12345-0@lo:400:kworker.0 Request processed in 25us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483262.202879:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788483262.202890:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788483262.202895:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e00d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098781440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483262.202919:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e00d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098781440:12345-0@lo:400:kworker.0 Request processed in 25us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483262.202925:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788483262.202945:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788483262.202950:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e00d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098781056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483262.202977:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e00d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098781056:12345-0@lo:400:kworker.0 Request processed in 27us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483262.202982:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788483262.203042:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098779904 00000100:00100000:1.0:1788483262.203046:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098779904 00000100:00100000:1.0:1788483262.203067:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788483262.203087:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd9b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:3619:x1875360098779904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483262.203143:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd9b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:3619:x1875360098779904:12345-0@lo:400:kworker.0 Request processed in 70us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483262.203149:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788483262.203183:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098780032 00000100:00100000:1.0:1788483262.203187:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098780032 00000100:00100000:1.0:1788483262.203204:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098780544 00000100:00100000:1.0:1788483262.203206:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098780544 00000100:00100000:1.0:1788483262.203215:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788483262.203220:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e00d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098780032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483262.203249:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e00d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098780032:12345-0@lo:400:kworker.0 Request processed in 29us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483262.203255:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788483262.203266:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788483262.203272:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e00d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098780544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483262.203313:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e00d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098780544:12345-0@lo:400:kworker.0 Request processed in 41us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483262.203319:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788483262.203351:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098780032:0@lo:400:kworker.0 00000100:00100000:1.0:1788483262.203367:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098780544:0@lo:400:kworker.0 00000100:00100000:1.0:1788483262.203374:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098781056:0@lo:400:kworker.0 00000100:00100000:1.0:1788483262.203381:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098779904:0@lo:400:kworker.0 00000100:00100000:1.0:1788483262.203389:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098780416:0@lo:400:kworker.0 00000100:00100000:1.0:1788483262.203396:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098780928:0@lo:400:kworker.0 00010000:00080000:1.0:1788483262.203406:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f20000 x1875360098781440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483262.203415:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098781440:0@lo:400:kworker.0 00000100:00100000:1.0:1788483262.203434:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788483262.203440:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e00d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098781568:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788483262.203472:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483262.203502:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098781568 00000100:00100000:1.0:1788483262.203506:0:18732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098781568 00000100:00100000:1.0:1788483262.203531:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788483262.203537:0:18732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e00d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098781568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788483262.203557:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788483262.203588:0:18732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e00d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098781568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483262.203594:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788483262.203624:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e00d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098781568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788483262.205336:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e00d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098781696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788483262.205386:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788483262.205649:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788483262.205654:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788483262.205657:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788483262.205660:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788483262.208632:0:20364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098781696 00000100:00100000:1.0:1788483262.208646:0:20364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098781696 00000100:00100000:1.0:1788483262.208694:0:20364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788483262.208717:0:20364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098781696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788483262.208740:0:20364:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788483262.208834:0:20364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098781696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (3447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483262.208841:0:20364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788483262.210581:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e00d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098781696:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788483262.776742:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483263.738675:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788483263.738719:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098781824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788483263.738823:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483263.738973:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098781824 00000100:00100000:0.0:1788483263.738983:0:18733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098781824 00000100:00100000:0.0:1788483263.739067:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788483263.739078:0:18733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098781824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788483263.739153:0:18733:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788483263.739206:0:18733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098781824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483263.739214:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788483263.739715:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098781824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788483263.742262:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098781952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788483263.742346:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483263.742522:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098781952 00000100:00100000:2.0:1788483263.742531:0:18732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098781952 00000100:00100000:2.0:1788483263.742596:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788483263.742606:0:18732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e00d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098781952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788483263.742632:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788483263.746537:0:18732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e00d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098781952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3919us (4177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483263.746556:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788483263.749659:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098781952:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788483263.800384:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483264.760400:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788483264.760421:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098782080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483264.760653:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098782208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788483264.760737:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483264.760832:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098782208 00000100:00100000:3.0:1788483264.760840:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098782208 00000100:00100000:3.0:1788483264.760892:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788483264.760901:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098782208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788483264.760930:0:17963:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788483264.760940:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483264.760971:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098782080 00000100:00100000:0.0:1788483264.760976:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098782080 00000100:00100000:0.0:1788483264.761001:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788483264.761010:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098782208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483264.761011:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098782080:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788483264.761024:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000004:00000024:0.0:1788483264.761037:0:17228:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788483264.761082:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098782208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788483264.761086:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098782080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483264.761094:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788483264.761183:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098782080:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788483264.825558:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483264.871402:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483264.871507:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087161472 00000100:00100000:2.0:1788483264.871522:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087161472 00000100:00100000:2.0:1788483264.871619:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 13 00000100:00100000:2.0:1788483264.871632:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+13:16359:x1875360087161472:12345-192.168.206.54@tcp:35:umount.0 00000001:00080000:2.0:1788483264.871901:0:17226:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000100:00100000:2.0:1788483264.872036:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+15:16359:x1875360087161472:12345-192.168.206.54@tcp:35:umount.0 Request processed in 407us (650us total) trans 8589934625 rc 0/0 00000100:00080000:0.0:1788483264.872216:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788483264.872479:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 13 00000020:00080000:2.0:1788483264.872485:0:17226:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788483264.887231:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483264.887287:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483264.887341:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483264.887489:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087161600 00000100:00100000:3.0:1788483264.887502:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087161600 00000100:00100000:3.0:1788483264.887561:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087161856 00000100:00100000:3.0:1788483264.887564:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087161856 00000100:00100000:3.0:1788483264.887577:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087161728 00000100:00100000:3.0:1788483264.887580:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087161728 00000100:00100000:3.0:1788483264.887598:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 3 00000100:00100000:3.0:1788483264.887609:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+15:2391:x1875360087161600:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483264.887627:0:17207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483264.887652:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ed9d8000/0x1d7ea3d89ea1bb72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e619 expref: 15 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483264.887674:0:17207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483264.888035:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+14:2391:x1875360087161600:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 426us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483264.888045:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 3 00000100:00100000:3.0:1788483264.888082:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 4 00000100:00100000:3.0:1788483264.888089:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f7384050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+13:2391:x1875360087161856:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483264.888169:0:17207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483264.888183:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ecee1800/0x1d7ea3d89ea1bbfe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e700 expref: 13 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483264.888194:0:17207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483264.888220:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f7384050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+12:2391:x1875360087161856:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 131us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483264.888227:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 4 00000100:00100000:3.0:1788483264.888282:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 5 00000100:00100000:3.0:1788483264.888289:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+11:2391:x1875360087161728:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483264.888299:0:17207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483264.888310:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1bb79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e64a expref: 11 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483264.888319:0:17207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483264.888336:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+10:2391:x1875360087161728:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 48us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483264.888342:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 5 00000100:00100000:1.0:1788483264.896054:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483264.897583:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087161984 00000100:00100000:0.0:1788483264.897600:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087161984 00000100:00100000:0.0:1788483264.897706:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 34 00000100:00100000:0.0:1788483264.897718:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e00d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2389:x1875360087161984:12345-192.168.206.54@tcp:9:umount.0 00000100:00080000:2.0:1788483264.897898:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:0.0:1788483264.898016:0:18731:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1bb9c 00000100:00080000:0.0:1788483264.898029:0:18731:0:(import.c:65:import_set_state_nolock()) ffff9a68c1fc6800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788483264.898191:0:18731:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1788483264.898532:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e00d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+2:2389:x1875360087161984:12345-192.168.206.54@tcp:9:umount.0 Request processed in 806us (2484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483264.898547:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 34 00010000:00010000:2.0:1788483264.899692:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483264.930928:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483264.931340:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087162880 00000100:00100000:1.0:1788483264.931349:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087162880 00000100:00100000:1.0:1788483264.931410:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 67 00000100:00100000:1.0:1788483264.931420:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+15:2389:x1875360087162880:12345-192.168.206.54@tcp:39:umount.0 00000020:00000080:1.0:1788483264.931451:0:17223:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1bb87 00000020:00010000:1.0:1788483264.931468:0:17223:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a68c24d6000: total 0 00000100:00080000:1.0:1788483264.931472:0:17223:0:(import.c:65:import_set_state_nolock()) ffff9a68c24d3800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788483264.931530:0:17223:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934625 00000100:00100000:1.0:1788483264.931712:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f66e931-3201-4238-a1e4-162d21e5f09a+14:2389:x1875360087162880:12345-192.168.206.54@tcp:39:umount.0 Request processed in 293us (791us total) trans 8589934626 rc 0/0 00000100:00100000:1.0:1788483264.931720:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 67 00000020:00010000:2.0:1788483264.931832:0:17211:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a68c24d6000: total 0 00010000:00010000:2.0:1788483264.931836:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483264.931883:0:17211:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a68c24d6000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788483264.931920:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:2.0:1788483264.931923:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788483264.931931:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1be9e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7bd expref: 13 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483264.931947:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a69ecd6cd00) 00010000:00010000:2.0:1788483264.931950:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483264.931953:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77000/0x1d7ea3d89ea1bc6e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e70e expref: 12 pid: 17222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483264.931968:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:2.0:1788483264.931971:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788483264.931974:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a600/0x1d7ea3d89ea1bdb0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e770 expref: 11 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483264.931984:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69ecd6c200) 00010000:00010000:2.0:1788483264.931999:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788483264.932004:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76200/0x1d7ea3d89ea1bcad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e71c expref: 10 pid: 18206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483264.932030:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a69fd169400) 00010000:00010000:2.0:1788483264.932239:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788483264.932245:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69edb8a000/0x1d7ea3d89ea1be3c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e79a expref: 9 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483264.932267:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a68c3603a00) 00010000:00010000:2.0:1788483264.932270:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788483264.932274:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9400/0x1d7ea3d89ea1bc52 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e707 expref: 8 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483264.932288:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a68c3603000) 00010000:00010000:2.0:1788483264.932290:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788483264.932293:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400c00/0x1d7ea3d89ea1bd32 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e746 expref: 7 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483264.932307:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a68c3603900) 00010000:00010000:2.0:1788483264.932310:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788483264.932313:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400200/0x1d7ea3d89ea1bde1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e785 expref: 6 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483264.932325:0:17211:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a68c24d6000, canceled 8 locks, left on hash table 0. 00010000:00010000:2.0:1788483264.932339:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483264.932341:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483264.932343:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483264.946802:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483264.946964:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087163008 00000100:00100000:0.0:1788483264.946973:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087163008 00000100:00100000:0.0:1788483264.947056:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 68 00000100:00100000:0.0:1788483264.947067:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+5:2389:x1875360087163008:12345-192.168.206.54@tcp:39:umount.0 00000020:00000080:0.0:1788483264.947146:0:17224:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1bb8e 00000100:00080000:2.0:1788483264.947306:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788483264.947453:0:17224:0:(import.c:65:import_set_state_nolock()) ffff9a68c24d1000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788483264.947486:0:17224:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1788483264.947754:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483264.947804:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f66e931-3201-4238-a1e4-162d21e5f09a+3:2389:x1875360087163008:12345-192.168.206.54@tcp:39:umount.0 Request processed in 730us (1009us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788483264.947812:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 68 00000040:00080000:3.0:1788483265.469668:0:17258:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788483265.469677:0:17258:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788483265.469709:0:17258:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788483265.469719:0:17258:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788483265.685324:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483265.685368:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483265.685453:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483265.685539:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087163392 00000100:00100000:2.0:1788483265.685548:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087163392 00000100:00100000:2.0:1788483265.685630:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087163264 00000100:00100000:2.0:1788483265.685634:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087163264 00000100:00100000:0.0:1788483265.685657:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 101 00000100:00100000:0.0:1788483265.685680:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2393:x1875360087163392:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483265.685748:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2393:x1875360087163392:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 71us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483265.685808:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087163136 00000100:00100000:1.0:1788483265.685813:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087163136 00000100:00100000:1.0:1788483265.685857:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 174 00000100:00100000:1.0:1788483265.685865:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+10:2393:x1875360087163136:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483265.685898:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+10:2393:x1875360087163136:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 34us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483265.685905:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 174 00000100:00080000:3.0:1788483265.685991:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788483265.685995:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788483265.692416:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 102 00000100:00100000:2.0:1788483265.692452:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:2393:x1875360087163264:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483265.692529:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:2393:x1875360087163264:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 99us (7075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483265.692538:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 102 00000100:00100000:0.0:1788483265.696646:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 101 00010000:00010000:2.0:1788483265.848448:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483266.485147:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483266.485193:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483266.485308:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087163648 00000100:00100000:1.0:1788483266.485324:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087163648 00000100:00100000:3.0:1788483266.485353:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087163520 00000100:00100000:3.0:1788483266.485363:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087163520 00000100:00100000:1.0:1788483266.485410:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 6 00000100:00100000:1.0:1788483266.485423:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+11:2391:x1875360087163648:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483266.485454:0:17207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483266.485475:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ecee0600/0x1d7ea3d89ea1bbb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e6ba expref: 11 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483266.485492:0:17207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483266.485567:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+10:2391:x1875360087163648:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 146us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483266.494267:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483266.494411:0:17209:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788483266.494423:0:17209:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788483266.494994:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 6 00000100:00100000:0.0:1788483266.495036:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087163776 00000100:00100000:0.0:1788483266.495050:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087163776 00000100:00100000:1.0:1788483266.495059:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 7 00000100:00100000:1.0:1788483266.495079:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+10:2391:x1875360087163520:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483266.495143:0:17207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483266.495173:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ed9d8a00/0x1d7ea3d89ea1bbb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e689 expref: 10 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483266.495194:0:17207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483266.495271:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+9:2391:x1875360087163520:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 200us (10075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483266.495280:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 7 00000100:00100000:1.0:1788483266.495302:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 8 00000100:00100000:1.0:1788483266.495323:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+8:2392:x1875360087163776:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483266.495332:0:17207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483266.495346:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69edb8be00/0x1d7ea3d89ea1bbf7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e6f9 expref: 8 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483266.495356:0:17207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483266.495376:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+7:2392:x1875360087163776:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 54us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483266.495382:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 8 00000100:00100000:0.0:1788483266.506201:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483266.506446:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087164032 00000100:00100000:2.0:1788483266.506461:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087164032 00000100:00100000:2.0:1788483266.506538:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 69 00000100:00100000:2.0:1788483266.506551:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+6:2389:x1875360087164032:12345-192.168.206.54@tcp:39:umount.0 00000020:00000080:2.0:1788483266.506605:0:17223:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1bbcd 00000020:00010000:2.0:1788483266.506616:0:17223:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a69f451f000: total 0 00000100:00080000:2.0:1788483266.506621:0:17223:0:(import.c:65:import_set_state_nolock()) ffff9a69f4519000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1788483266.506935:0:17211:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a69f451f000: total 0 00010000:00010000:3.0:1788483266.507003:0:17211:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a69f451f000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788483266.507043:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69ecd6c200) 00010000:00010000:3.0:1788483266.507047:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788483266.507056:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ed9d9200/0x1d7ea3d89ea1bcbb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e723 expref: 5 pid: 17223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483266.507083:0:17211:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a69f451f000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788483266.507138:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483266.507141:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483266.507143:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788483266.507405:0:17223:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:2.0:1788483266.507607:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+3:2389:x1875360087164032:12345-192.168.206.54@tcp:39:umount.0 Request processed in 1054us (1414us total) trans 8589934627 rc 0/0 00000100:00100000:2.0:1788483266.507731:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 69 00000100:00100000:1.0:1788483266.515229:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483266.515289:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087164160 00000100:00100000:2.0:1788483266.515310:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087164160 00000100:00100000:2.0:1788483266.515372:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 70 00000100:00100000:2.0:1788483266.515385:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e00d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+5:2389:x1875360087164160:12345-192.168.206.54@tcp:39:umount.0 00000020:00000080:2.0:1788483266.515440:0:17224:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1bbc6 00000100:00080000:2.0:1788483266.515450:0:17224:0:(import.c:65:import_set_state_nolock()) ffff9a68c24d2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788483266.515483:0:17224:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788483266.515661:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e00d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6+3:2389:x1875360087164160:12345-192.168.206.54@tcp:39:umount.0 Request processed in 279us (440us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788483266.515669:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 70 00010000:00010000:1.0:1788483266.515898:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483266.548170:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483266.548267:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087164416 00000100:00100000:1.0:1788483266.548276:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087164416 00000100:00100000:1.0:1788483266.548331:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 175 00000100:00100000:1.0:1788483266.548341:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+7:2389:x1875360087164416:12345-192.168.206.54@tcp:251:umount.0 00000020:00000080:1.0:1788483266.548389:0:17217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1bb64 00000020:00010000:1.0:1788483266.548399:0:17217:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a69f45fb800: total 0 00000100:00080000:1.0:1788483266.548404:0:17217:0:(import.c:65:import_set_state_nolock()) ffff9a69f45fd800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1788483266.548466:0:19802:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a69f45fb800: total 0 00000100:00100000:1.0:1788483266.548481:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd+3:2389:x1875360087164416:12345-192.168.206.54@tcp:251:umount.0 Request processed in 138us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483266.548490:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 175 00010000:00010000:3.0:1788483266.548562:0:19802:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a69f45fb800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788483266.548779:0:19802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69edb8ae00/0x1d7ea3d89ea1bb6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e612 expref: 2 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483266.548809:0:19802:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a69f45fb800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788483266.548831:0:19802:0:(genops.c:885:class_export_put()) final put ffff9a69f45fb800/5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd 00010000:00010000:1.0:1788483266.548856:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483266.549030:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483266.549033:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788483266.549155:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69f45fb800/5a608b3c-1838-4d7c-bfdf-5c0932ddc5cd for MGS 00000020:00000080:3.0:1788483266.549209:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69f45fd800 for MGS 00010000:00010000:3.0:1788483266.872981:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483267.320306:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098782720:0@lo:400:kworker.0 00000100:00100000:2.0:1788483267.320369:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483267.320420:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098783232:0@lo:400:kworker.0 00000100:00100000:2.0:1788483267.320455:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483267.320477:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098783744:0@lo:400:kworker.0 00000100:00100000:2.0:1788483267.320516:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483267.320541:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788483267.320945:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098782336:0@lo:400:kworker.0 00000100:00100000:2.0:1788483267.321259:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483267.321285:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098782848:0@lo:400:kworker.0 00000100:00100000:2.0:1788483267.321306:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483267.321322:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098783360:0@lo:400:kworker.0 00000100:00100000:2.0:1788483267.321340:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483267.321366:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098783872:0@lo:400:kworker.0 00000100:00100000:2.0:1788483267.321443:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483267.321473:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098782464:0@lo:400:kworker.0 00000100:00100000:2.0:1788483267.321512:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483267.321531:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098782976:0@lo:400:kworker.0 00000100:00100000:1.0:1788483267.321889:0:18730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098782720 00000100:00100000:1.0:1788483267.321896:0:18730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098782720 00000100:00100000:1.0:1788483267.321943:0:18730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098783232 00000100:00100000:1.0:1788483267.321947:0:18730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098783232 00000100:00100000:1.0:1788483267.321985:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788483267.321994:0:18730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098782720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483267.322049:0:18730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098782720:12345-0@lo:400:kworker.0 Request processed in 57us (1680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483267.322056:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788483267.322072:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788483267.322078:0:18730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098783232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483267.322120:0:18730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098783232:12345-0@lo:400:kworker.0 Request processed in 42us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483267.322125:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788483267.322142:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098782336 00000100:00100000:1.0:1788483267.322145:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098782336 00000100:00100000:1.0:1788483267.322169:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788483267.322174:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:3621:x1875360098782336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483267.322202:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:3621:x1875360098782336:12345-0@lo:400:kworker.0 Request processed in 27us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483267.322207:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:1.0:1788483267.322258:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788483267.322288:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098782336:0@lo:400:kworker.0 00000100:00100000:1.0:1788483267.322302:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098782720:0@lo:400:kworker.0 00000100:00100000:1.0:1788483267.322310:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098783232:0@lo:400:kworker.0 00000100:00100000:2.0:1788483267.322487:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483267.322518:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098783488:0@lo:400:kworker.0 00000100:00100000:2.0:1788483267.322542:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483267.322579:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e00d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098784000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788483267.322614:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483267.322632:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788483267.322638:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098782592:0@lo:400:kworker.0 00000100:00100000:2.0:1788483267.322659:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483267.322674:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098783104:0@lo:400:kworker.0 00000100:00100000:2.0:1788483267.322693:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483267.322706:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098783616:0@lo:400:kworker.0 00000100:00100000:2.0:1788483267.322724:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483267.324070:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098783744 00000100:00100000:3.0:1788483267.324081:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098783744 00000100:00100000:2.0:1788483267.324171:0:18729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098782592 00000100:00100000:2.0:1788483267.324177:0:18729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098782592 00000100:00100000:3.0:1788483267.324268:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098782848 00000100:00100000:3.0:1788483267.325372:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098782848 00000100:00100000:3.0:1788483267.325406:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098783360 00000100:00100000:3.0:1788483267.325409:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098783360 00000100:00100000:3.0:1788483267.325419:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098783872 00000100:00100000:3.0:1788483267.325421:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098783872 00000100:00100000:1.0:1788483267.325812:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098782464 00000100:00100000:1.0:1788483267.325818:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098782464 00000100:00100000:1.0:1788483267.325856:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098782976 00000100:00100000:1.0:1788483267.325860:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098782976 00000100:00100000:1.0:1788483267.325878:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788483267.325886:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098782464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483267.325984:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098782464:12345-0@lo:400:kworker.0 Request processed in 99us (4471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483267.325993:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788483267.326012:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788483267.326020:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098782976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483267.326049:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098782976:12345-0@lo:400:kworker.0 Request processed in 30us (3561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483267.326054:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788483267.326073:0:20364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098784000 00000100:00100000:1.0:1788483267.326076:0:20364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098784000 00000100:00100000:1.0:1788483267.326114:0:20364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788483267.326121:0:20364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098784000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788483267.326143:0:20364:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788483267.326174:0:20364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098784000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (3559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483267.326180:0:20364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788483267.326198:0:19165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098783104 00000100:00100000:1.0:1788483267.326201:0:19165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098783104 00000100:00100000:3.0:1788483267.327228:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098783488 00000100:00100000:2.0:1788483267.327234:0:18729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788483267.327236:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098783488 00000100:00100000:2.0:1788483267.327247:0:18729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098782592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483267.327296:0:18729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098782592:12345-0@lo:400:kworker.0 Request processed in 53us (4635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483267.327302:0:18729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788483267.327326:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098783616 00000100:00100000:2.0:1788483267.327331:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098783616 00000100:00100000:2.0:1788483267.327352:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788483267.327358:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098783744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483267.327396:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098783744:12345-0@lo:400:kworker.0 Request processed in 38us (6880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483267.327402:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788483267.327424:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788483267.327550:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788483267.327558:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098783360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483267.327595:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098783360:12345-0@lo:400:kworker.0 Request processed in 38us (6253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483267.327602:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788483267.327613:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788483267.327620:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098783872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483267.327646:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098783872:12345-0@lo:400:kworker.0 Request processed in 27us (6203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483267.327653:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788483267.327664:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788483267.327669:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098783616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483267.327693:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098783616:12345-0@lo:400:kworker.0 Request processed in 24us (4968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483267.327698:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788483267.327708:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788483267.327713:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098783488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483267.327739:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098783488:12345-0@lo:400:kworker.0 Request processed in 25us (5196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483267.327745:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788483267.328525:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098782848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483267.328573:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098782848:12345-0@lo:400:kworker.0 Request processed in 1144us (7265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483267.328581:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788483267.332109:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098782848:0@lo:400:kworker.0 00000100:00100000:2.0:1788483267.332131:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098783360:0@lo:400:kworker.0 00010000:00080000:2.0:1788483267.332147:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c37b3480 x1875360098783872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483267.332158:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098783872:0@lo:400:kworker.0 00000100:00100000:2.0:1788483267.332170:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098783744:0@lo:400:kworker.0 00000100:00100000:1.0:1788483267.332240:0:19165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788483267.332256:0:19165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098783104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483267.332329:0:19165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098783104:12345-0@lo:400:kworker.0 Request processed in 79us (9635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483267.332348:0:19165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788483267.332424:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788483267.332711:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788483267.332714:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788483267.332743:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098782592:0@lo:400:kworker.0 00000100:00100000:2.0:1788483267.333171:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e00d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098784128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788483267.333226:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483267.333314:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098783104:0@lo:400:kworker.0 00010000:00080000:1.0:1788483267.333332:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69efe9d880 x1875360098783616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483267.333341:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098783616:0@lo:400:kworker.0 00000100:00100000:1.0:1788483267.333359:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e00d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098784000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788483267.333370:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098782464:0@lo:400:kworker.0 00000100:00100000:1.0:1788483267.333380:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098782976:0@lo:400:kworker.0 00000100:00100000:1.0:1788483267.333392:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098783488:0@lo:400:kworker.0 00000100:00100000:3.0:1788483267.333517:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098784128 00000100:00100000:3.0:1788483267.333524:0:18732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098784128 00000100:00100000:3.0:1788483267.333575:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788483267.333583:0:18732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098784128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788483267.333609:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788483267.333649:0:18732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098784128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483267.333655:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788483267.334576:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e00d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098784128:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788483267.898305:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788483268.346354:0:20796:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788483268.356846:0:20796:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788483268.356921:0:20796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b727 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b72e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483268.356940:0:20796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b727 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b72e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483268.356948:0:20796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b727 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1b72e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483268.356955:0:20796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1b72e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483268.357674:0:20796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788483268.357685:0:20796:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788483268.357731:0:20796:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788483268.357737:0:20796:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788483268.357745:0:20796:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788483268.357786:0:20796:0:(import.c:65:import_set_state_nolock()) ffff9a69c626f000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788483268.357902:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875360098784256:0@lo:39:umount.0 00000100:00100000:3.0:1788483268.358007:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483268.358155:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098784256 00000100:00100000:0.0:1788483268.358164:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098784256 00000100:00100000:0.0:1788483268.358231:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788483268.358243:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875360098784256:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788483268.358275:0:18206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b758 00000100:00080000:0.0:1788483268.358285:0:18206:0:(import.c:65:import_set_state_nolock()) ffff9a68c27c2000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788483268.359672:0:19802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483268.359689:0:19802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1b72e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483268.359703:0:19802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77c00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:1.0:1788483268.359708:0:19802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1b72e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483268.359721:0:19802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1b72e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788483268.359755:0:19802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1b72e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483268.359761:0:19802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788483268.359764:0:19802:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788483268.359768:0:19802:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788483268.359830:0:19802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b727 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1b72e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483268.359838:0:19802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788483268.359872:0:19802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b727 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1b72e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483268.359881:0:19802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77c00/0x1d7ea3d89ea1b727 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1b72e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483268.359898:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483268.359901:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483268.359905:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483268.359930:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e00d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098784384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483268.360016:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788483268.360316:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483268.360484:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3618:x1875360098784256:12345-0@lo:39:umount.0 Request processed in 2239us (2474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483268.360492:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098784384 00000100:00100000:1.0:1788483268.360499:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788483268.360502:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098784384 00000020:00000080:1.0:1788483268.360521:0:18206:0:(genops.c:885:class_export_put()) final put ffff9a68c27c3800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1788483268.360577:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788483268.360587:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:3621:x1875360098784384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788483268.360600:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483268.360618:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ed9d8400/0x1d7ea3d89ea1b72e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b727 expref: 24 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483268.360633:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:0.0:1788483268.360677:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c27c3800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788483268.360743:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c27c2000 for lustre-MDT0000 00000100:00080000:2.0:1788483268.360976:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69c626f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788483268.361038:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875360098784256:0@lo:39:umount.0 00000100:00080000:0.0:1788483268.361348:0:20796:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788483268.361353:0:20796:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788483268.361358:0:20796:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1788483268.361480:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4be19e4a-e21c-409c-93a6-e1423c5e2099+23:3621:x1875360098784384:12345-0@lo:103:ldlm_bl.0 Request processed in 890us (1461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483268.361490:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788483268.361691:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e00d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098784384:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788483268.362738:0:20796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26400/0x1d7ea3d89ea1b678 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b67f expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483268.362753:0:20796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26400/0x1d7ea3d89ea1b678 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b67f expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483268.362773:0:20796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26400/0x1d7ea3d89ea1b678 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1b67f expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483268.362791:0:20796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26400/0x1d7ea3d89ea1b678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1b67f expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483268.362812:0:20796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483268.362818:0:20796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1ba92 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483268.362825:0:20796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1ba92 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483268.362832:0:20796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1ba92 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483268.362839:0:20796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1ba92 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483268.362863:0:20796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788483268.362868:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788483268.362872:0:20796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1bc2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bc36 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483268.362883:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26400/0x1d7ea3d89ea1b678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1b67f expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483268.362884:0:20796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1bc2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1bc36 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483268.362890:0:19802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483268.362904:0:19802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1ba92 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483268.362925:0:20796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1bc2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1bc36 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483268.362927:0:19802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6c00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788483268.362932:0:19802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1ba92 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483268.362939:0:19802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1ba92 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483268.362980:0:20796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1bc2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1bc36 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483268.362983:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26400 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788483268.362984:0:19802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1ba92 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483268.362994:0:19802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788483268.362996:0:19802:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788483268.362998:0:19802:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788483268.363001:0:20796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483268.363006:0:20796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27c00/0x1d7ea3d89ea1b66a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b671 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483268.363009:0:17210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26400/0x1d7ea3d89ea1b678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1b67f expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483268.363018:0:20796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27c00/0x1d7ea3d89ea1b66a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b671 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483268.363026:0:17210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26400/0x1d7ea3d89ea1b678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1b67f expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483268.363030:0:20796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27c00/0x1d7ea3d89ea1b66a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1b671 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483268.363042:0:17210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26400/0x1d7ea3d89ea1b678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1b67f expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483268.363045:0:20796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27c00/0x1d7ea3d89ea1b66a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1b671 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483268.363056:0:17210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788483268.363062:0:17210:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788483268.363065:0:20796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788483268.363070:0:20796:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788483268.363073:0:20796:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788483268.363136:0:20796:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788483268.363140:0:20796:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788483268.363144:0:20796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788483268.363150:0:20796:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1788483268.363156:0:20796:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a68c3318800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788483268.363162:0:20796:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a68c1d30000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788483268.363167:0:20796:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a68c24ee000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788483268.363171:0:20796:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a69d25dc800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788483268.363186:0:20796:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9a69f451f000 ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6 192.168.206.54@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:1.0:1788483268.363192:0:20796:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9a68c24d6000 0f66e931-3201-4238-a1e4-162d21e5f09a 192.168.206.54@tcp 4 (0 4 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:1.0:1788483268.363196:0:20796:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9a69c55f4d28) has exports, disconnecting them 00000020:00080000:1.0:1788483268.363200:0:20796:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a68c3318800), last request at 1788483267 00000020:00000080:1.0:1788483268.363206:0:20796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1ba5a 00000100:00080000:1.0:1788483268.363221:0:20796:0:(import.c:65:import_set_state_nolock()) ffff9a69e8fa8000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788483268.363265:0:20796:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a68c3318800): rc 0 00000020:00000080:1.0:1788483268.363268:0:20796:0:(genops.c:885:class_export_put()) final put ffff9a68c3318800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788483268.363281:0:20796:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a68c1d30000), last request at 1788483267 00000020:00000080:1.0:1788483268.363284:0:20796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b8f5 00000100:00080000:1.0:1788483268.363291:0:20796:0:(import.c:65:import_set_state_nolock()) ffff9a68c1d32000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788483268.363297:0:20796:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a68c1d30000): rc 0 00000020:00000080:1.0:1788483268.363300:0:20796:0:(genops.c:885:class_export_put()) final put ffff9a68c1d30000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788483268.363308:0:20796:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a68c24ee000), last request at 1788483188 00000020:00000080:1.0:1788483268.363311:0:20796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b846 00000100:00080000:1.0:1788483268.363315:0:20796:0:(import.c:65:import_set_state_nolock()) ffff9a68c24ed000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788483268.363321:0:20796:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a68c24ee000): rc 0 00000020:00000080:1.0:1788483268.363322:0:20796:0:(genops.c:885:class_export_put()) final put ffff9a68c24ee000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788483268.363327:0:20796:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a69d25dc800), last request at 1788483187 00000020:00000080:1.0:1788483268.363330:0:20796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b7eb 00000100:00080000:1.0:1788483268.363333:0:20796:0:(import.c:65:import_set_state_nolock()) ffff9a68c1c41000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788483268.363339:0:20796:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00010000:00010000:2.0:1788483268.363340:0:17210:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26400/0x1d7ea3d89ea1b678 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1b67f expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483268.363350:0:17210:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788483268.363371:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788483268.363381:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26400/0x1d7ea3d89ea1b678 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1b67f expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483268.363389:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26400/0x1d7ea3d89ea1b678 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1b67f expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483268.363408:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483268.363412:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27c00/0x1d7ea3d89ea1b66a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1b671 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788483268.363416:0:20796:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a69d25dc800): rc 0 00010000:00010000:2.0:1788483268.363430:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27c00 already unused, calling callback (ffffffffc1480c20) 00000004:00000080:1.0:1788483268.363430:0:20796:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb538418fbae0 00010000:00010000:0.0:1788483268.363563:0:20797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483268.363570:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1bc2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1bc36 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483268.363577:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8a800 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788483268.363580:0:17211:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1bc2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1bc36 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483268.363587:0:17211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1bc2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1bc36 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788483268.363594:0:17211:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1bc2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1bc36 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483268.363600:0:17211:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788483268.363602:0:17211:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788483268.363605:0:17211:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788483268.363622:0:17211:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1bc2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1bc36 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483268.363636:0:17211:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788483268.363660:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1bc2f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1bc36 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483268.363667:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a800/0x1d7ea3d89ea1bc2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1bc36 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483268.363676:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483268.363678:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483268.363680:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483268.363685:0:20797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483268.363686:0:20797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483268.363742:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098784640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788483268.363813:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1788483268.363883:0:17210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27c00/0x1d7ea3d89ea1b66a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1b671 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788483268.363891:0:20796:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788483268.363896:0:20796:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1788483268.363911:0:17210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27c00/0x1d7ea3d89ea1b66a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1b671 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483268.363919:0:17210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27c00/0x1d7ea3d89ea1b66a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1b671 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483268.363925:0:17210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788483268.363927:0:17210:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788483268.363930:0:17210:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788483268.363949:0:17210:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27c00/0x1d7ea3d89ea1b66a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1b671 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483268.363955:0:17210:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788483268.363971:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27c00/0x1d7ea3d89ea1b66a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1b671 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483268.364048:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27c00/0x1d7ea3d89ea1b66a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1b671 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483268.364062:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483268.364064:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483268.364065:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788483268.364161:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c3318800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788483268.364218:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c1d30000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788483268.364251:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c24ee000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788483268.364285:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69e8fa8000 for lustre-MDT0000 00000020:00000080:2.0:1788483268.364290:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c1d32000 for lustre-MDT0000 00000020:00000080:2.0:1788483268.364294:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c24ed000 for lustre-MDT0000 00000100:00100000:2.0:1788483268.364307:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788483268.364331:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098784512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483268.364397:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483268.364900:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c37b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4be19e4a-e21c-409c-93a6-e1423c5e2099:3620:1875360098784768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483268.364938:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483268.365065:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098784640 00000100:00100000:2.0:1788483268.365075:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098784640 00000100:00080000:1.0:1788483268.365166:0:20796:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788483268.365193:0:20796:0:(import.c:65:import_set_state_nolock()) ffff9a69ed823000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788483268.365234:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098784512 00000100:00100000:2.0:1788483268.365240:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098784512 00000100:00100000:2.0:1788483268.365259:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098784768 00000100:00100000:2.0:1788483268.365263:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098784768 00000100:00100000:2.0:1788483268.365286:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788483268.365300:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e00d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+25:3619:x1875360098784640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483268.365316:0:17208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483268.365339:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69edb8a200/0x1d7ea3d89ea1bc36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bc2f expref: 25 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788483268.365354:0:20796:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00010000:00010000:2.0:1788483268.365356:0:17208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483268.365360:0:20796:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1788483268.365379:0:20796:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788483268.365415:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e00d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+24:3619:x1875360098784640:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (1600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483268.365425:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788483268.365489:0:19802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1ba92 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483268.365500:0:19802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788483268.365518:0:19802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1ba92 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483268.365527:0:19802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a6a021c6c00/0x1d7ea3d89ea1ba8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1ba92 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483268.365542:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483268.365544:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483268.365546:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788483268.365546:0:20796:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788483268.365557:0:20796:0:(import.c:65:import_set_state_nolock()) ffff9a69d18c9800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788483268.365563:0:20796:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788483268.365565:0:20796:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000100:00100000:3.0:1788483268.365569:0:20710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000004:00080000:1.0:1788483268.365575:0:20796:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788483268.365582:0:20710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f7386450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4be19e4a-e21c-409c-93a6-e1423c5e2099+23:3621:x1875360098784512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788483268.365595:0:20710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483268.365612:0:20710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c29e3c00/0x1d7ea3d89ea1b67f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b678 expref: 23 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483268.365623:0:20710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483268.365680:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788483268.365691:0:20710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f7386450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4be19e4a-e21c-409c-93a6-e1423c5e2099+22:3621:x1875360098784512:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483268.365703:0:20710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788483268.365714:0:20796:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788483268.365724:0:20796:0:(import.c:65:import_set_state_nolock()) ffff9a69efd93800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788483268.365758:0:20796:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9a69c55f4d28) has no exports 00000100:00100000:2.0:1788483268.365764:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+21:3620:x1875360098784768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483268.365790:0:17208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483268.365803:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c29e2400/0x1d7ea3d89ea1b671 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b66a expref: 21 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483268.365815:0:17208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483268.365860:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4be19e4a-e21c-409c-93a6-e1423c5e2099+20:3620:x1875360098784768:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483268.365877:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788483268.365921:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4be19e4a-e21c-409c-93a6-e1423c5e2099:3619:1875360098784640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483268.365955:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788483268.365965:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4be19e4a-e21c-409c-93a6-e1423c5e2099:3622:1875360098785024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483268.366067:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483268.366188:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098784512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483268.366237:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e00d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098784896:0@lo:39:umount.0 00000100:00100000:3.0:1788483268.366256:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c37b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4be19e4a-e21c-409c-93a6-e1423c5e2099:3620:1875360098784768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483268.366280:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483268.366311:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e00d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098785152:0@lo:9:umount.0 00000100:00100000:2.0:1788483268.366337:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483268.366341:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098785024 00000100:00100000:0.0:1788483268.366346:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098785024 00000100:00100000:2.0:1788483268.366357:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e00d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098785280:0@lo:9:umount.0 00000100:00100000:0.0:1788483268.366382:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788483268.366390:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4be19e4a-e21c-409c-93a6-e1423c5e2099+20:3622:x1875360098785024:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483268.366394:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788483268.366398:0:17207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483268.366409:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6a021c6200/0x1d7ea3d89ea1ba92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1ba8b expref: 20 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483268.366419:0:17207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483268.366431:0:18729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098785152 00000100:00100000:2.0:1788483268.366436:0:18729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098785152 00000100:00100000:3.0:1788483268.366448:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098784896 00000100:00100000:3.0:1788483268.366456:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098784896 00000100:00100000:3.0:1788483268.366501:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788483268.366511:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875360098784896:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788483268.366537:0:17228:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b870 00000100:00080000:3.0:1788483268.366548:0:17228:0:(import.c:65:import_set_state_nolock()) ffff9a69efd45800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788483268.366573:0:17228:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788483268.366715:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3618:x1875360098784896:12345-0@lo:39:umount.0 Request processed in 203us (434us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788483268.366724:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00010000:3.0:1788483268.366761:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483268.366765:0:18729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098785280 00000100:00100000:2.0:1788483268.366773:0:18729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098785280 00000100:00100000:2.0:1788483268.366822:0:18729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788483268.366829:0:18729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c37b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875360098785152:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788483268.366852:0:18729:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b93b 00000100:00080000:2.0:1788483268.366861:0:18729:0:(import.c:65:import_set_state_nolock()) ffff9a68c331c800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788483268.366871:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4be19e4a-e21c-409c-93a6-e1423c5e2099+19:3622:x1875360098785024:12345-0@lo:103:ldlm_bl.0 Request processed in 481us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483268.366878:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1788483268.366902:0:20797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788483268.366906:0:18729:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788483268.367317:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788483268.367326:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875360098785280:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788483268.367342:0:18731:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1ba99 00000100:00080000:1.0:1788483268.367348:0:18731:0:(import.c:65:import_set_state_nolock()) ffff9a68c24d1800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788483268.367494:0:18731:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1788483268.367590:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3618:x1875360098785280:12345-0@lo:9:umount.0 Request processed in 265us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483268.367597:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1788483268.367733:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483268.368416:0:18729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c37b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3618:x1875360098785152:12345-0@lo:9:umount.0 Request processed in 1582us (2072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483268.368427:0:18729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788483268.368492:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4be19e4a-e21c-409c-93a6-e1423c5e2099:3622:1875360098785024:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788483268.368546:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69ed823000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788483268.368554:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e00d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098784896:0@lo:39:umount.0 00000100:00080000:2.0:1788483268.368564:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69d18c9800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788483268.368581:0:3618:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788483268.368583:0:3618:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788483268.368586:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e00d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098785152:0@lo:9:umount.0 00000100:00080000:2.0:1788483268.368597:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69efd93800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788483268.368717:0:3618:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788483268.382181:0:3618:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788483268.382196:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e00d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098785280:0@lo:9:umount.0 00000020:00080000:2.0:1788483268.386756:0:20796:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9a69c55f4d28) has no exports 00000020:00000080:2.0:1788483268.439715:0:20796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b6c5 00000020:00000080:2.0:1788483268.439729:0:20796:0:(genops.c:885:class_export_put()) final put ffff9a69d18ca000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788483268.439759:0:20796:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788483268.440123:0:20796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788483268.440134:0:20796:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788483268.440139:0:20796:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9a69f615cd28) has no exports 00000020:00000080:0.0:1788483268.440325:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69d18ca000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788483268.440466:0:20796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b6be 00000020:00000080:0.0:1788483268.440485:0:20796:0:(genops.c:885:class_export_put()) final put ffff9a69ed826800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788483268.440539:0:20796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788483268.440546:0:20796:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788483268.440549:0:20796:0:(genops.c:885:class_export_put()) final put ffff9a69ed827800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788483268.440551:0:20796:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69ed827800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788483268.440555:0:20796:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788483268.440839:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69ed826800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1788483268.856439:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788483268.856470:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098785408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788483268.856536:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483268.857392:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098785408 00000100:00100000:1.0:1788483268.857403:0:18733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098785408 00000100:00100000:1.0:1788483268.857474:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788483268.857484:0:18733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098785408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788483268.857514:0:18733:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788483268.857587:0:18733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098785408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483268.857594:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788483268.857714:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098785408:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788483268.920805:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483269.880398:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098785536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788483269.880468:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483269.880591:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098785536 00000100:00100000:1.0:1788483269.880599:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098785536 00000100:00100000:1.0:1788483269.880641:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788483269.880649:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875360098785536:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1788483269.880657:0:17227:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788483269.880706:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875360098785536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (239us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788483269.880713:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:02020000:2.0:1788483269.880795:0:3619:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1788483269.894899:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788483269.894906:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9a69ece27000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788483269.894911:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788483269.916382:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9a69ece27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788483269.916395:0:3619:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 480 00000100:00080000:2.0:1788483269.916404:0:3619:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a69ece27000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:2.0:1788483269.916513:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69ffefb800 x1875360098785664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788483269.916607:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098785664:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788483269.916682:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483269.916764:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098785664 00000100:00100000:0.0:1788483269.916779:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098785664 00000100:00100000:0.0:1788483269.916817:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788483269.916824:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3618:x1875360098785664:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1788483269.916841:0:17963:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788483269.926965:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3618:x1875360098785664:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 10132us (10275us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788483269.926994:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1788483269.932590:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69ece27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788483269.932604:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788483269.932609:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098785664:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:3.0:1788483269.944858:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788483270.909887:0:19542:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788483270.909897:0:19542:0:(genops.c:885:class_export_put()) final put ffff9a68c24d5800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788483270.909919:0:19542:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0f66e931-3201-4238-a1e4-162d21e5f09a 00000020:00000080:1.0:1788483270.909921:0:19542:0:(genops.c:885:class_export_put()) final put ffff9a68c1fc3800/0f66e931-3201-4238-a1e4-162d21e5f09a 00000020:00000080:2.0:1788483270.910006:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c24d5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788483270.910065:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c1fc3800/0f66e931-3201-4238-a1e4-162d21e5f09a for lustre-OST0001 00000020:00000080:2.0:1788483270.910085:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c24d1800 for lustre-OST0001 00000020:00000080:2.0:1788483270.910089:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c1fc6800 for lustre-OST0001 00000001:00100000:1.0:1788483270.910473:0:17955:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788483270.910483:0:17955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1788483270.910486:0:17955:0:(genops.c:885:class_export_put()) final put ffff9a69d0561000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788483270.910503:0:17955:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6 00000001:00080000:1.0:1788483270.910510:0:17955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1788483270.910512:0:17955:0:(genops.c:885:class_export_put()) final put ffff9a68c24d3000/ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6 00000001:00100000:1.0:1788483270.910517:0:17955:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0f66e931-3201-4238-a1e4-162d21e5f09a 00000001:00080000:1.0:1788483270.910522:0:17955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1788483270.910524:0:17955:0:(genops.c:885:class_export_put()) final put ffff9a68c24d4800/0f66e931-3201-4238-a1e4-162d21e5f09a 00000020:00000080:0.0:1788483270.910532:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69d0561000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788483270.910590:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c24d3000/ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6 for lustre-MDT0001 00000020:00000080:0.0:1788483270.910607:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c24d4800/0f66e931-3201-4238-a1e4-162d21e5f09a for lustre-MDT0001 00000020:00000080:0.0:1788483270.910625:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69efd45800 for lustre-MDT0001 00000020:00000080:0.0:1788483270.910629:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c24d2800 for lustre-MDT0001 00000020:00000080:0.0:1788483270.910631:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c24d1000 for lustre-MDT0001 00000001:00100000:2.0:1788483270.910876:0:17202:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788483270.910880:0:17202:0:(genops.c:885:class_export_put()) final put ffff9a69d25dc800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788483270.910900:0:17202:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6 00000001:00080000:2.0:1788483270.910906:0:17202:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:2.0:1788483270.910908:0:17202:0:(genops.c:885:class_export_put()) final put ffff9a69f451f000/ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6 00000001:00100000:2.0:1788483270.910913:0:17202:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0f66e931-3201-4238-a1e4-162d21e5f09a 00000001:00080000:2.0:1788483270.910918:0:17202:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934626 is committed 00000020:00000080:2.0:1788483270.910921:0:17202:0:(genops.c:885:class_export_put()) final put ffff9a68c24d6000/0f66e931-3201-4238-a1e4-162d21e5f09a 00000020:00000080:0.0:1788483270.910962:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69d25dc800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788483270.911002:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69f451f000/ec9ecfe9-dd42-4a25-b5ba-6d7a8de04ba6 for lustre-MDT0000 00000020:00000080:0.0:1788483270.911022:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c24d6000/0f66e931-3201-4238-a1e4-162d21e5f09a for lustre-MDT0000 00000020:00000080:0.0:1788483270.911041:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c1c41000 for lustre-MDT0000 00000020:00000080:0.0:1788483270.911046:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69f4519000 for lustre-MDT0000 00000020:00000080:0.0:1788483270.911050:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c24d3800 for lustre-MDT0000 00000040:00080000:2.0:1788483270.968908:0:17976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788483270.972434:0:20797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483271.993871:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483272.440376:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e00d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098785792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788483272.440436:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483272.440833:0:20364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098785792 00000100:00100000:1.0:1788483272.440841:0:20364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098785792 00000100:00100000:1.0:1788483272.440897:0:20364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788483272.440905:0:20364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098785792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788483272.440950:0:20364:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788483272.440991:0:20364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098785792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483272.440998:0:20364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788483272.441038:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e00d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098785792:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788483272.441147:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788483272.446214:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788483272.446220:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788483272.446223:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a69ece27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483272.446231:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 562 00000100:00080000:0.0:1788483272.446236:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788483272.446242:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a69ece27000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483272.446262:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69d0f23480 x1875360098786048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788483272.446620:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098785920:0@lo:400:kworker.0 00000100:00100000:3.0:1788483272.446681:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483272.446714:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098786560:0@lo:400:kworker.0 00000100:00100000:3.0:1788483272.446739:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483272.446772:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788483272.446779:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098786176:0@lo:400:kworker.0 00000100:00100000:3.0:1788483272.446803:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483272.446817:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098786688:0@lo:400:kworker.0 00000100:00100000:3.0:1788483272.446836:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483272.446860:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098786560 00000100:00100000:3.0:1788483272.446945:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098786560 00000100:00100000:3.0:1788483272.446990:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098786688 00000100:00100000:3.0:1788483272.446994:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098786688 00000100:00100000:3.0:1788483272.447012:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788483272.447020:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098786560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483272.447067:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098786560:12345-0@lo:400:kworker.0 Request processed in 47us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483272.447075:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788483272.447090:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788483272.447137:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3621:x1875360098786688:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788483272.447143:0:17223:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788483272.447169:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3621:x1875360098786688:12345-0@lo:400:kworker.0 Request processed in 73us (333us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788483272.447461:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1788483272.447496:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788483272.447534:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098786048:0@lo:38:kworker.0 00000100:00100000:3.0:1788483272.447624:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483272.447655:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098786048 00000100:00100000:3.0:1788483272.447659:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098786048 00000100:00100000:3.0:1788483272.447676:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788483272.447681:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1875360098786048:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1788483272.447694:0:17228:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1788483272.448074:0:3621:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788483272.448078:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9a69c5056000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788483272.448082:0:3621:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788483272.448087:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9a69c5056000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483272.448090:0:3621:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 513 00000100:00080000:0.0:1788483272.448119:0:3621:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a69c5056000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483272.448140:0:3621:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69d0f20000 x1875360098786944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788483272.448159:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098786688:0@lo:400:kworker.0 00010000:00080000:0.0:1788483272.448172:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f21f80 x1875360098786560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483272.448197:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098786560:0@lo:400:kworker.0 00000100:00100000:0.0:1788483272.448292:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1875360098786944:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788483272.448320:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483272.448354:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098786944 00000100:00100000:0.0:1788483272.448365:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098786944 00000100:00100000:0.0:1788483272.448385:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788483272.448390:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3618:x1875360098786944:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1788483272.448399:0:17223:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788483272.448428:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3618:x1875360098786944:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 37us (107us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788483272.448435:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1788483272.448457:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69c5056000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483272.448462:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788483272.448465:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1875360098786944:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788483272.449499:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098786304:0@lo:400:kworker.0 00000100:00100000:2.0:1788483272.449556:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483272.449587:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098786304 00000100:00100000:2.0:1788483272.449591:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098786304 00000100:00100000:2.0:1788483272.449619:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788483272.449625:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1875360098786304:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788483272.449631:0:17223:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788483272.449659:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1875360098786304:12345-0@lo:400:kworker.0 Request processed in 34us (103us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788483272.449665:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788483272.449693:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788483272.449697:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9a68c24ee800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788483272.449700:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788483272.449714:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9a68c24ee800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788483272.449718:0:3619:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 480 00000100:00080000:2.0:1788483272.449723:0:3619:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a68c24ee800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:2.0:1788483272.449743:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69ffefb100 x1875360098787072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788483272.449774:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098786304:0@lo:400:kworker.0 00000100:00100000:2.0:1788483272.449785:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875360098787072:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788483272.449809:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483272.449836:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098787072 00000100:00100000:2.0:1788483272.449840:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098787072 00000100:00100000:2.0:1788483272.449859:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788483272.449864:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098787072:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1788483272.449875:0:17222:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788483272.449906:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098787072:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 40us (96us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788483272.449912:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788483272.449934:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c24ee800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788483272.449949:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788483272.449952:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875360098787072:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788483272.449969:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098786816:0@lo:400:kworker.0 00000100:00100000:2.0:1788483272.449992:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483272.450011:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098786816 00000100:00100000:2.0:1788483272.450014:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098786816 00000100:00100000:2.0:1788483272.450049:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788483272.450055:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffefb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098786816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483272.450122:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffefb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098786816:12345-0@lo:400:kworker.0 Request processed in 41us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483272.450129:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:2.0:1788483272.450155:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69d0f20380 x1875360098786816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483272.450164:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098786816:0@lo:400:kworker.0 00000100:00100000:2.0:1788483272.450193:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788483272.450199:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098786432:0@lo:400:kworker.0 00000100:00100000:2.0:1788483272.450220:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483272.450239:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098786432 00000100:00100000:2.0:1788483272.450242:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098786432 00000100:00100000:2.0:1788483272.450260:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788483272.450264:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1875360098786432:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788483272.450269:0:17223:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788483272.450290:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1875360098786432:12345-0@lo:400:kworker.0 Request processed in 25us (69us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788483272.450295:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1788483272.450322:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788483272.450325:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9a68c331a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788483272.450328:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788483272.450331:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9a68c331a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788483272.450334:0:3619:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 496 00000100:00080000:2.0:1788483272.450338:0:3619:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a68c331a800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:2.0:1788483272.450350:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69ffefad80 x1875360098787200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788483272.450375:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098786432:0@lo:400:kworker.0 00000100:00100000:2.0:1788483272.450385:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1875360098787200:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788483272.450408:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483272.450430:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098787200 00000100:00100000:2.0:1788483272.450434:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098787200 00000100:00100000:2.0:1788483272.450450:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788483272.450454:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098787200:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1788483272.450462:0:17222:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788483272.450488:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098787200:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 33us (79us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788483272.450494:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788483272.450518:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c331a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788483272.450522:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788483272.450524:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1875360098787200:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1788483272.450557:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788483272.451135:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098785920 00000100:00100000:1.0:1788483272.451141:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098785920 00000100:00100000:1.0:1788483272.451191:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788483272.451199:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdbcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+19:3621:x1875360098785920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483272.451245:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdbcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4be19e4a-e21c-409c-93a6-e1423c5e2099+19:3621:x1875360098785920:12345-0@lo:400:kworker.0 Request processed in 47us (4564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483272.451251:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788483272.451282:0:18730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098786176 00000100:00100000:1.0:1788483272.451286:0:18730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098786176 00000100:00100000:1.0:1788483272.451316:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788483272.451322:0:18730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098786176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483272.451351:0:18730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098786176:12345-0@lo:400:kworker.0 Request processed in 30us (4549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483272.451357:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1788483272.451373:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788483272.451406:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098786176:0@lo:400:kworker.0 00000100:00100000:1.0:1788483272.451415:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098785920:0@lo:400:kworker.0 00000100:00100000:3.0:1788483272.482512:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1875360098786048:12345-0@lo:38:kworker.0 Request processed in 34820us (34877us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788483272.482527:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1788483272.486875:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69ece27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788483272.486886:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788483272.486890:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098786048:0@lo:38:kworker.0 00010000:00010000:3.0:1788483273.016254:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788483273.467571:0:18725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788483273.467579:0:18725:0:(genops.c:885:class_export_put()) final put ffff9a68c3319800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788483273.467824:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c3319800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788483273.467951:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c331c800 for lustre-OST0000 00000100:00100000:3.0:1788483273.976441:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788483273.976464:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098787328:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788483273.976531:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483273.978873:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098787328 00000100:00100000:0.0:1788483273.978886:0:18733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098787328 00000100:00100000:0.0:1788483273.978960:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788483273.978972:0:18733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d1cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098787328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788483273.979022:0:18733:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788483273.979133:0:18733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d1cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098787328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 164us (2601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483273.979140:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788483273.979315:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098787328:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788483274.040798:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788483274.488372:0:20796:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a68c10c65a0 - data ffff9a69e07ae0d8/ffff9a69d07d4000 00000020:01000000:1.0:1788483274.488582:0:20796:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a69f6b804e0 - data ffff9a68c21321b0/ffff9a69f6484c00 00000001:00000004:1.0:1788483274.498470:0:20796:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00080000:0.0:1788483274.549779:0:20796:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788483274.549788:0:20796:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788483274.549802:0:20796:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9a69e00d5f80 x1875360098784896/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788483278 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483274.549826:0:20796:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788483274.559352:0:20796:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788483274.559360:0:20796:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:0.0:1788483274.559454:0:20796:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788483274.559458:0:20796:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788483274.565905:0:17246:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788483274.565911:0:17246:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1788483274.565921:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1788483274.576789:0:20796:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788483274.576798:0:20796:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:0.0:1788483274.576873:0:20796:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788483274.576877:0:20796:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788483274.590327:0:17248:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788483274.590336:0:17248:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:2.0:1788483274.590354:0:17248:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788483274.598791:0:20796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b68d 00000020:00000080:0.0:1788483274.598803:0:20796:0:(genops.c:885:class_export_put()) final put ffff9a69f8ab8000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788483274.599353:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69f8ab8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788483274.600386:0:20796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b6a2 00000020:00000080:0.0:1788483274.600398:0:20796:0:(genops.c:885:class_export_put()) final put ffff9a69f8abe000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788483274.600446:0:20796:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788483274.600452:0:20796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788483274.600461:0:20796:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788483274.600465:0:20796:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9a69c55f3370) has no exports 00000004:01000000:0.0:1788483274.600716:0:20796:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788483274.600735:0:20796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b704 00000020:00000080:0.0:1788483274.600741:0:20796:0:(genops.c:885:class_export_put()) final put ffff9a69efd90800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788483274.601653:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69f8abe000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788483274.602000:0:20796:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788483274.602009:0:20796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788483274.602017:0:20796:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788483274.602021:0:20796:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9a69f61599b8) has no exports 00000020:00000080:0.0:1788483274.602029:0:20796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b6fd 00000020:00000080:0.0:1788483274.602035:0:20796:0:(genops.c:885:class_export_put()) final put ffff9a69efd95800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788483274.602396:0:20796:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788483274.602401:0:20796:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788483274.602405:0:20796:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:0.0:1788483274.602410:0:20796:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788483274.602413:0:20796:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788483274.602549:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69efd90800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788483274.602556:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69efd95800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788483274.602613:0:20796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788483274.602619:0:20796:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788483274.602626:0:20796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b6ef 00000020:00000080:0.0:1788483274.602630:0:20796:0:(genops.c:885:class_export_put()) final put ffff9a69efd94800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788483274.602634:0:20796:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788483274.602638:0:20796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788483274.602651:0:20796:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788483274.602653:0:20796:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9a68c24e0000) has no exports 00000020:00000080:0.0:1788483274.602657:0:20796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b6e8 00000020:00000080:0.0:1788483274.602661:0:20796:0:(genops.c:885:class_export_put()) final put ffff9a69efe14800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788483274.602795:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69efd93800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788483274.602802:0:36:0:(genops.c:885:class_export_put()) final put ffff9a69efd90000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788483274.602804:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69efd90000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788483274.602809:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788483274.602885:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69efd94800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788483274.602897:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69efe14800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788483274.603272:0:20796:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788483274.603276:0:20796:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788483274.603279:0:20796:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1788483274.603283:0:20796:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788483274.603284:0:20796:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788483274.603356:0:20796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788483274.603361:0:20796:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1788483274.603373:0:20796:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788483274.603379:0:20796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b6da 00000020:00000080:0.0:1788483274.603384:0:20796:0:(genops.c:885:class_export_put()) final put ffff9a69efe16000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788483274.607960:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69d18c9800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788483274.607982:0:36:0:(genops.c:885:class_export_put()) final put ffff9a69efe17000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788483274.607985:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69efe17000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788483274.607993:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788483274.608927:0:20796:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1788483274.608938:0:20796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788483274.608948:0:20796:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788483274.608953:0:20796:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9a69f615b370) has no exports 00000020:00000080:0.0:1788483274.608960:0:20796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b6d3 00000020:00000080:0.0:1788483274.608967:0:20796:0:(genops.c:885:class_export_put()) final put ffff9a69d18c8000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788483274.609417:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69efe16000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788483274.609455:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69d18c8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788483274.638709:0:20796:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788483274.638730:0:20796:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788483274.638735:0:20796:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788483274.638750:0:20796:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788483274.638809:0:20796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788483274.638819:0:20796:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788483274.638877:0:20796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788483274.638881:0:20796:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788483274.638886:0:20796:0:(genops.c:885:class_export_put()) final put ffff9a69c5054000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788483274.638891:0:20796:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69c5054000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1788483274.638918:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69ed823000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788483274.638926:0:36:0:(genops.c:885:class_export_put()) final put ffff9a69d18cd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788483274.638928:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69d18cd000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788483274.638939:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788483274.639203:0:20796:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788483274.639296:0:20796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b6a9 00000020:00000080:2.0:1788483274.639304:0:20796:0:(genops.c:885:class_export_put()) final put ffff9a69f8aba800/lustre-MDD0000_UUID 00000020:01000000:2.0:1788483274.639321:0:20796:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788483274.639326:0:20796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788483274.639333:0:20796:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788483274.639337:0:20796:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9a69c55f0000) has no exports 00000020:00000080:2.0:1788483274.639360:0:20796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788483274.639369:0:20796:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788483274.639375:0:20796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b6b0 00000020:00000080:2.0:1788483274.639380:0:20796:0:(genops.c:885:class_export_put()) final put ffff9a69f8abc800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788483274.639388:0:20796:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a69ece13000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788483274.639391:0:20796:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a69ece13000 3 00000020:01000004:2.0:1788483274.639394:0:20796:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a69ece13000 from lustre-MDT0000 00000020:00000080:2.0:1788483274.639410:0:20796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788483274.639414:0:20796:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788483274.639417:0:20796:0:(genops.c:885:class_export_put()) final put ffff9a69f8abf800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788483274.639429:0:20796:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69f8abf800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788483274.639437:0:20796:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788483274.639468:0:20796:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788483274.639480:0:20796:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788483274.639483:0:20796:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788483274.639485:0:20796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788483274.639487:0:20796:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788483274.639493:0:20796:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9a69efeba800 4be19e4a-e21c-409c-93a6-e1423c5e2099 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788483274.639499:0:20796:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9a69f6158000) has exports, disconnecting them 00000020:00080000:2.0:1788483274.639502:0:20796:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9a69efeba800), last request at 1788483172 00000020:00000080:2.0:1788483274.639515:0:20796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b655 00000020:00010000:2.0:1788483274.639518:0:20796:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a69efeba800: total 2 00000100:00080000:2.0:1788483274.639523:0:20796:0:(import.c:65:import_set_state_nolock()) ffff9a69efebc800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788483274.639536:0:20796:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a69efeba800): rc 0 00000020:00080000:2.0:1788483274.639539:0:20796:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9a69f6158000) has no exports 00000100:00100000:2.0:1788483274.639611:0:17216:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9a69f47f6600:17216] 1 exiting: rc = 0 00000100:00100000:2.0:1788483274.639697:0:17215:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9a69edbb6600:17215] 0 exiting: rc = 1 00000020:00000080:3.0:1788483274.639794:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69f8aba800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788483274.639799:0:36:0:(genops.c:885:class_export_put()) final put ffff9a69f8ab9000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788483274.639801:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69f8ab9000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788483274.639805:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788483274.639842:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69f8abc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:3.0:1788483274.639862:0:20797:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a69efeba800: total 0 00010000:00010000:3.0:1788483274.639882:0:20797:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a69efeba800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788483274.639910:0:20797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68c1f76000/0x1d7ea3d89ea1b782 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b77b expref: 14 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483274.639928:0:20797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ed9d8800/0x1d7ea3d89ea1b774 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b76d expref: 13 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483274.639941:0:20797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c29e2000/0x1d7ea3d89ea1b831 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b82a expref: 12 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483274.639952:0:20797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69edb8b800/0x1d7ea3d89ea1ba1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1ba14 expref: 11 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483274.639963:0:20797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ed9d8c00/0x1d7ea3d89ea1bc1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bc13 expref: 10 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483274.639984:0:20797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ed9d8600/0x1d7ea3d89ea1b790 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b789 expref: 9 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483274.639994:0:20797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68c1f77e00/0x1d7ea3d89ea1b663 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b65c expref: 8 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483274.640004:0:20797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68c1f76800/0x1d7ea3d89ea1b8e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b8d9 expref: 7 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483274.640015:0:20797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68c1f77a00/0x1d7ea3d89ea1bc0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bc05 expref: 6 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483274.640025:0:20797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ed9d9c00/0x1d7ea3d89ea1bc28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bc21 expref: 5 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483274.640039:0:20797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6a021c6800/0x1d7ea3d89ea1ba45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1ba3e expref: 4 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483274.640049:0:20797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6a021c7600/0x1d7ea3d89ea1ba84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1ba7d expref: 3 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483274.640061:0:20797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ed9d9800/0x1d7ea3d89ea1b8b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d7ea3d89ea1b8af expref: 2 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483274.640072:0:20797:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a69efeba800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788483274.640085:0:20797:0:(genops.c:885:class_export_put()) final put ffff9a69efeba800/4be19e4a-e21c-409c-93a6-e1423c5e2099 00010000:00010000:3.0:1788483274.640123:0:20797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483274.640125:0:20797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483274.640127:0:20797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483274.640171:0:17217:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9a69eda72e00:17217] 2 exiting: rc = 0 00000020:00000080:2.0:1788483274.642925:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69efeba800/4be19e4a-e21c-409c-93a6-e1423c5e2099 for MGS 00000020:00000080:2.0:1788483274.642982:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69efebc800 for MGS 00000100:00100000:2.0:1788483274.643019:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643027:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643032:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643036:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643041:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643046:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643052:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643057:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643064:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643070:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643077:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643082:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643087:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643092:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643116:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643122:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643146:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643151:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643158:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643164:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643169:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643175:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643186:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643192:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643196:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643201:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643206:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643211:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643216:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643222:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643228:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643234:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643239:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643244:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643249:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643254:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643259:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643265:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643270:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643274:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643280:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643285:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643290:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643295:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643299:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643305:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643310:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643314:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643319:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643324:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643329:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643342:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643347:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643352:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643358:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643362:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643368:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643372:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643378:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643382:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643388:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643393:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643398:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483274.643403:0:20796:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1788483274.644020:0:20796:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a68c24b9ae0 - data ffff9a69c6db3510/ffff9a68c2762800 00000020:01000000:2.0:1788483274.646255:0:20796:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a68c3e6cc00 - data ffff9a69d41d7000/ffff9a69c38a7000 00000020:00000080:2.0:1788483274.646977:0:20796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b639 00000020:00000080:2.0:1788483274.646988:0:20796:0:(genops.c:885:class_export_put()) final put ffff9a69efeb9000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788483274.647008:0:20796:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a69ece13000 from MGS, refs=2 00000020:01000004:2.0:1788483274.647011:0:20796:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a69ece13000 2 00000020:01000004:2.0:1788483274.647015:0:20796:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a69ece13000 from MGS 00000020:00000080:2.0:1788483274.647035:0:20796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788483274.647042:0:20796:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788483274.647045:0:20796:0:(genops.c:885:class_export_put()) final put ffff9a69efebb800/MGS 00000020:00000080:2.0:1788483274.647048:0:20796:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69efebb800/MGS for MGS 00000020:01000000:2.0:1788483274.647341:0:20796:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788483274.647404:0:20796:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788483274.647408:0:20796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788483274.647413:0:20796:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788483274.647426:0:20796:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9a69d20c8800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788483274.647432:0:20796:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9a69edaa19b8) has exports, disconnecting them 00000020:00080000:2.0:1788483274.647437:0:20796:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9a69d20c8800), last request at 1788483173 00000020:00000080:2.0:1788483274.647441:0:20796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b73c 00000020:00080000:2.0:1788483274.647460:0:20796:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a69d20c8800): rc 0 00000020:00000080:2.0:1788483274.647464:0:20796:0:(genops.c:885:class_export_put()) final put ffff9a69d20c8800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788483274.648043:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69efeb9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788483274.648054:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69d20c8800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788483274.650157:0:20796:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788483274.650167:0:20796:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788483274.650171:0:20796:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788483274.650179:0:20796:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788483274.650387:0:20796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788483274.650395:0:20796:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788483274.650402:0:20796:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a69ece13000 1 00000020:00000080:3.0:1788483274.650407:0:20796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b62b 00000020:00000080:3.0:1788483274.650414:0:20796:0:(genops.c:885:class_export_put()) final put ffff9a69efebe800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788483274.650436:0:20796:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788483274.650441:0:20796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788483274.650445:0:20796:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788483274.650448:0:20796:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9a69edaa4d28) has no exports 00000020:00000080:0.0:1788483274.662582:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69c626f000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788483274.662600:0:37:0:(genops.c:885:class_export_put()) final put ffff9a69d20cc800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788483274.662604:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69d20cc800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788483274.662612:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788483274.671534:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69efebe800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788483274.779263:0:20796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483274.779275:0:20796:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788483274.779280:0:20796:0:(genops.c:885:class_export_put()) final put ffff9a69ece14000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788483274.779284:0:20796:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69ece14000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788483274.779294:0:20796:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788483274.779399:0:20796:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a69ece12800 00000020:02000400:1.0:1788483274.779462:0:20796:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788483275.082657:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483276.088433:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483277.112214:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483277.560638:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e00d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098787456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788483277.560757:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483277.560863:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098787456 00000100:00100000:1.0:1788483277.560872:0:18732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098787456 00000100:00100000:1.0:1788483277.560961:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788483277.560970:0:18732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e00d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098787456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788483277.561009:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788483277.561058:0:18732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e00d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098787456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483277.561065:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788483277.561125:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788483277.561133:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788483277.561137:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788483277.561141:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a69ece27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788483277.561147:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 564 00000100:00080000:1.0:1788483277.561152:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788483277.561157:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a69ece27000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483277.561170:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e00d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098787456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788483277.561179:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69e00d7800 x1875360098787712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788483277.561202:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788483277.561208:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e00d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098787584:0@lo:400:kworker.0 00000100:00080000:1.0:1788483277.561224:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788483277.561227:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788483277.561229:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a68c24ee800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000400:00000100:0.0:1788483277.561232:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875360098787584 offset 0 length 224: 4 00000100:00080000:1.0:1788483277.561233:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 564 00000100:00080000:1.0:1788483277.561236:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788483277.561239:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a68c24ee800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788483277.561251:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69e00d6a00 x1875360098787968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788483277.561260:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788483277.561263:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788483277.561265:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a68c331a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788483277.561267:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e00d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098787712:0@lo:38:kworker.0 00000100:00080000:1.0:1788483277.561268:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 564 00000100:00080000:1.0:1788483277.561271:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788483277.561274:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a68c331a800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788483277.561285:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69efe9f480 x1875360098788096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788483277.561294:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788483277.561300:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788483277.561303:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788483277.561305:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a69c5056000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788483277.561308:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 564 00000100:00080000:1.0:1788483277.561310:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1788483277.561312:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e00d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875360098787968:0@lo:38:kworker.0 00000100:00080000:1.0:1788483277.561314:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a69c5056000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788483277.561324:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69efe9f800 x1875360098788352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788483277.561335:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483277.561355:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1875360098788096:0@lo:38:kworker.0 00000100:00100000:1.0:1788483277.561366:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e00d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098787840:0@lo:400:kworker.0 00000100:00100000:0.0:1788483277.561376:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483277.561392:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483277.561393:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1875360098788352:0@lo:38:kworker.0 00000100:00100000:0.0:1788483277.561410:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483277.561413:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788483277.561417:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098788224:0@lo:400:kworker.0 00000100:00100000:0.0:1788483277.561435:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098787712 00000100:00100000:1.0:1788483277.561438:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483277.561439:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098787712 00000100:00100000:0.0:1788483277.561458:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788483277.561464:0:18729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098787840 00000100:00100000:0.0:1788483277.561465:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1875360098787712:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788483277.561467:0:18729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098787840 00010000:00020000:0.0:1788483277.561483:0:17227:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788483277.561515:0:18729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788483277.561522:0:18729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098787840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483277.561558:0:18729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098787840:12345-0@lo:400:kworker.0 Request processed in 37us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483277.561565:0:18729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788483277.561583:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098787968 00000100:00100000:1.0:1788483277.561586:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098787968 00000100:00100000:1.0:1788483277.561598:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098788096 00000100:00100000:1.0:1788483277.561600:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098788096 00000100:00100000:1.0:1788483277.561607:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098788352 00000100:00100000:1.0:1788483277.561609:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098788352 00000100:00100000:1.0:1788483277.561615:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098788224 00000100:00100000:1.0:1788483277.561617:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098788224 00000100:00100000:1.0:1788483277.561634:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788483277.561640:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098788224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483277.561669:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098788224:12345-0@lo:400:kworker.0 Request processed in 29us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483277.561676:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788483277.561687:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788483277.561692:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3618:x1875360098787968:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788483277.561708:0:18206:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788483277.561755:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3618:x1875360098787968:12345-0@lo:38:kworker.0 Request processed in 61us (418us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788483277.561762:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788483277.561774:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788483277.561778:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3618:x1875360098788096:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788483277.561787:0:18206:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788483277.561811:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3618:x1875360098788096:12345-0@lo:38:kworker.0 Request processed in 31us (433us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788483277.561817:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788483277.561829:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788483277.561832:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3618:x1875360098788352:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788483277.561841:0:18206:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788483277.561863:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3618:x1875360098788352:12345-0@lo:38:kworker.0 Request processed in 28us (452us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788483277.561868:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1788483277.561886:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788483277.561890:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788483277.561907:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9a69efe9e680 x1875360098788224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483277.561917:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098788224:0@lo:400:kworker.0 00000100:00100000:1.0:1788483277.561929:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e00d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098787840:0@lo:400:kworker.0 00000100:00080000:1.0:1788483277.561957:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c331a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788483277.561962:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788483277.561972:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1875360098788096:0@lo:38:kworker.0 00000100:00080000:1.0:1788483277.561984:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69c5056000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788483277.561987:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788483277.561990:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1875360098788352:0@lo:38:kworker.0 00000100:00080000:1.0:1788483277.561998:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c24ee800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788483277.562001:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788483277.562004:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e00d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875360098787968:0@lo:38:kworker.0 00000100:00100000:1.0:1788483277.562027:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098788480:0@lo:400:kworker.0 00000100:00100000:1.0:1788483277.562051:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483277.562076:0:18206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098788480 00000100:00100000:1.0:1788483277.562080:0:18206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098788480 00000100:00100000:1.0:1788483277.562128:0:18206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788483277.562135:0:18206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098788480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483277.562168:0:18206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098788480:12345-0@lo:400:kworker.0 Request processed in 34us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483277.562174:0:18206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:1.0:1788483277.562186:0:17218:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788483277.562201:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9a69efe9d180 x1875360098788480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483277.562210:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098788480:0@lo:400:kworker.0 00000100:00100000:3.0:1788483277.604210:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1875360098787712:12345-0@lo:38:kworker.0 Request processed in 42716us (42886us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788483277.604229:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1788483277.604301:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69ece27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788483277.604307:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788483277.604311:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e00d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098787712:0@lo:38:kworker.0 00010000:00010000:0.0:1788483278.137022:0:20797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788483278.800985:0:20998:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788483278.819200:0:20998:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1788483278.819529:0:20998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27200/0x1d7ea3d89ea1b82a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b831 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.819545:0:20998:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27200/0x1d7ea3d89ea1b82a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b831 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.819552:0:20998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27200/0x1d7ea3d89ea1b82a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1b831 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.819576:0:20998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27200/0x1d7ea3d89ea1b82a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1b831 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.819602:0:20998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788483278.819607:0:20998:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788483278.819634:0:20998:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788483278.819639:0:20998:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788483278.819644:0:20998:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788483278.819650:0:20998:0:(import.c:65:import_set_state_nolock()) ffff9a68c24ee800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788483278.819654:0:20998:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788483278.819656:0:20998:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788483278.819659:0:20998:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788483278.819919:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483278.819926:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27200/0x1d7ea3d89ea1b82a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1b831 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483278.819934:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27200 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:2.0:1788483278.819938:0:17210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27200/0x1d7ea3d89ea1b82a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1b831 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483278.819946:0:17210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27200/0x1d7ea3d89ea1b82a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1b831 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483278.819953:0:17210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27200/0x1d7ea3d89ea1b82a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1b831 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483278.819959:0:17210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788483278.819962:0:17210:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788483278.819964:0:17210:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788483278.820000:0:17210:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27200/0x1d7ea3d89ea1b82a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1b831 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483278.820007:0:17210:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788483278.820042:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27200/0x1d7ea3d89ea1b82a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1b831 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483278.820049:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27200/0x1d7ea3d89ea1b82a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1b831 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483278.820061:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483278.820063:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483278.820071:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483278.820474:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788483278.820495:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098788608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788483278.820568:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483278.820735:0:20710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098788608 00000100:00100000:3.0:1788483278.820742:0:20710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098788608 00000100:00100000:3.0:1788483278.820781:0:20710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788483278.820790:0:20710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5264a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3621:x1875360098788608:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788483278.820806:0:20710:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788483278 with bad export cookie 2125316224935114325 00010000:00010000:0.0:1788483278.822695:0:20998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2800/0x1d7ea3d89ea1b789 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b790 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.822712:0:20998:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2800/0x1d7ea3d89ea1b789 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b790 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.822719:0:20998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2800/0x1d7ea3d89ea1b789 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1b790 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.822736:0:20998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2800/0x1d7ea3d89ea1b789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1b790 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.822764:0:20998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483278.822769:0:20998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1ba7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1ba84 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.822791:0:20998:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1ba7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1ba84 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.822797:0:20998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1ba7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1ba84 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.822802:0:20998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1ba7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1ba84 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.822816:0:20998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788483278.822822:0:20998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9600/0x1d7ea3d89ea1bc21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bc28 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.822828:0:20998:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9600/0x1d7ea3d89ea1bc21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1bc28 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.822835:0:20998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9600/0x1d7ea3d89ea1bc21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1bc28 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.822850:0:20998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9600/0x1d7ea3d89ea1bc21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1bc28 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.822863:0:20998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788483278.822875:0:20797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788483278.822880:0:20797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2800/0x1d7ea3d89ea1b789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1b790 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.822887:0:20797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e2800 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788483278.822896:0:20797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2800/0x1d7ea3d89ea1b789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1b790 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.822904:0:20797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2800/0x1d7ea3d89ea1b789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1b790 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788483278.822910:0:20797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2800/0x1d7ea3d89ea1b789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1b790 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483278.822915:0:20797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788483278.822918:0:20797:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1788483278.822945:0:20797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2800/0x1d7ea3d89ea1b789 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1b790 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.822951:0:20797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788483278.822970:0:20797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2800/0x1d7ea3d89ea1b789 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1b790 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.822977:0:20797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2800/0x1d7ea3d89ea1b789 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1b790 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.822990:0:20797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788483278.822994:0:20797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1ba7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1ba84 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.822999:0:20797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e3800 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788483278.823002:0:20797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1ba7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1ba84 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.823008:0:20797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1ba7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1ba84 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788483278.823024:0:20797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1ba7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1ba84 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483278.823029:0:20797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788483278.823031:0:20797:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788483278.823033:0:20797:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788483278.823046:0:20797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1ba7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1ba84 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.823052:0:20797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788483278.823057:0:20797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1ba7d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1ba84 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.823064:0:20797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3800/0x1d7ea3d89ea1ba7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1ba84 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.823076:0:20797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483278.823080:0:20797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9600/0x1d7ea3d89ea1bc21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1bc28 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.823085:0:20797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9600 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788483278.823087:0:20797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9600/0x1d7ea3d89ea1bc21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1bc28 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.823092:0:20797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9600/0x1d7ea3d89ea1bc21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1bc28 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483278.823259:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483278.823275:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4be19e4a-e21c-409c-93a6-e1423c5e2099:3620:1875360098788864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788483278.826446:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483278.826543:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788483278.826556:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4be19e4a-e21c-409c-93a6-e1423c5e2099:3620:1875360098788736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788483278.826607:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483278.826646:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098788864 00000100:00100000:1.0:1788483278.826653:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098788864 00000100:00100000:1.0:1788483278.826680:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098788736 00000100:00100000:1.0:1788483278.826683:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098788736 00000100:00100000:1.0:1788483278.826696:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788483278.826703:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3620:x1875360098788864:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788483278.826709:0:17209:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788483278 with bad export cookie 2125316224935114325 00000100:00100000:1.0:1788483278.826767:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3620:x1875360098788864:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (330us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788483278.826774:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788483278.826791:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788483278.826796:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3620:x1875360098788736:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788483278.826800:0:17209:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788483278 with bad export cookie 2125316224935114325 00000100:00100000:1.0:1788483278.826824:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3620:x1875360098788736:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (216us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788483278.826830:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788483278.826871:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.154@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788483278.826876:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9a69ece11800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788483278.826880:0:3620:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.154@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 10000000:00010000:0.0:1788483278.828272:0:20797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9600/0x1d7ea3d89ea1bc21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1bc28 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483278.828294:0:20797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788483278.828298:0:20797:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788483278.828301:0:20797:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788483278.831001:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483278.837557:0:20710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5264a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3621:x1875360098788608:12345-0@lo:103:ldlm_bl.0 Request processed in 16762us (16984us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788483278.837569:0:20710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788483278.837783:0:3621:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.154@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788483278.863834:0:3620:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.154@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788483278.863840:0:3620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788483278.863850:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69e00d5880 x1875360098787584/t0(0) o400->MGC192.168.206.154@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788483293 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483278.863865:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69ffefad80 x1875360098788608/t0(0) o103->MGC192.168.206.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788483294 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483278.863891:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69d0f21500 x1875360098788864/t0(0) o103->MGC192.168.206.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788483294 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483278.863900:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69d0f22300 x1875360098788736/t0(0) o103->MGC192.168.206.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788483294 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788483278.863908:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788483278.863911:0:3620:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788483278.863913:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:0.0:1788483278.871474:0:20797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9600/0x1d7ea3d89ea1bc21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1bc28 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.871491:0:20797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788483278.871525:0:20797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9600/0x1d7ea3d89ea1bc21 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1bc28 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.871533:0:20797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9600/0x1d7ea3d89ea1bc21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d7ea3d89ea1bc28 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.871551:0:20797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483278.871553:0:20797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483278.871556:0:20797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483278.871579:0:20998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1b77b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b782 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.871589:0:20998:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1b77b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b782 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.871596:0:20998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1b77b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1b782 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483278.871604:0:20998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1b77b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1b782 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483278.871612:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1788483278.871625:0:20998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788483278.871632:0:20998:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00000100:00100000:3.0:1788483278.871635:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4be19e4a-e21c-409c-93a6-e1423c5e2099:0:1875360098788992:0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1788483278.871649:0:20998:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1788483278.871679:0:20998:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1788483278.871683:0:20998:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1788483278.871688:0:20998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788483278.871693:0:20998:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788483278.871699:0:20998:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9a68c1c43000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788483278.871704:0:20998:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9a69e8fab800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788483278.871709:0:20998:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9a69d2878000) has exports, disconnecting them 00000020:00080000:0.0:1788483278.871712:0:20998:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9a68c1c43000), last request at 1788483277 00000020:00000080:0.0:1788483278.871719:0:20998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1ba6f 00000100:00080000:0.0:1788483278.871745:0:20998:0:(import.c:65:import_set_state_nolock()) ffff9a68c27c7000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788483278.871794:0:20998:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a68c1c43000): rc 0 00000020:00000080:0.0:1788483278.871797:0:20998:0:(genops.c:885:class_export_put()) final put ffff9a68c1c43000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1788483278.871805:0:20998:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9a69e8fab800), last request at 1788483277 00000020:00000080:0.0:1788483278.871808:0:20998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b90a 00000100:00080000:0.0:1788483278.871813:0:20998:0:(import.c:65:import_set_state_nolock()) ffff9a69e8faf800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788483278.871823:0:20998:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a69e8fab800): rc 0 00000020:00000080:0.0:1788483278.871825:0:20998:0:(genops.c:885:class_export_put()) final put ffff9a69e8fab800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1788483278.871832:0:20998:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb5384196fae0 00000100:00080000:0.0:1788483278.871849:0:20998:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788483278.871859:0:20998:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9a69f525e300 x1875360098785536/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788483285 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483278.871873:0:20998:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000020:00000080:3.0:1788483278.871964:0:14600:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c1c43000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788483278.872010:0:14600:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69e8fab800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788483278.872030:0:14600:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c27c7000 for lustre-MDT0001 00000020:00000080:3.0:1788483278.872034:0:14600:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69e8faf800 for lustre-MDT0001 00010000:00010000:3.0:1788483278.872047:0:19802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483278.872053:0:19802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1b77b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1b782 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483278.872061:0:19802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c29e3400 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788483278.872064:0:19802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1b77b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1b782 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483278.872073:0:19802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1b77b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1b782 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788483278.872079:0:19802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1b77b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1b782 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483278.872084:0:19802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788483278.872087:0:19802:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788483278.872089:0:19802:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788483278.872115:0:19802:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a69ece11800 00010000:00010000:3.0:1788483278.872119:0:19802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1b77b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1b782 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483278.872132:0:19802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c29e3400/0x1d7ea3d89ea1b77b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1b782 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483278.872146:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483278.872147:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483278.872149:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788483278.872978:0:3621:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9a69ece11800 already not connected (conn 1, was 1): DISCONN 00010000:00010000:2.0:1788483278.873016:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483278.873032:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098785536:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788483278.873058:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483278.873409:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e00d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098787584:0@lo:400:kworker.0 00000100:00100000:3.0:1788483278.873426:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4be19e4a-e21c-409c-93a6-e1423c5e2099:3621:1875360098788608:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788483278.873685:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9a69ece11800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788483278.873701:0:3620:0:(import.c:510:import_select_connection()) MGC192.168.206.154@tcp: connect to NID 0@lo last attempt 464 00000100:00080000:1.0:1788483278.873708:0:3620:0:(import.c:624:import_select_connection()) MGC192.168.206.154@tcp: import ffff9a69ece11800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788483278.873745:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69efe9e680 x1875360098789120/t0(0) o250->MGC192.168.206.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788483278.873775:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4be19e4a-e21c-409c-93a6-e1423c5e2099:3618:1875360098789120:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:1.0:1788483278.873816:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875360098789120 offset 0 length 520: 4 00000100:00100000:1.0:1788483278.873861:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4be19e4a-e21c-409c-93a6-e1423c5e2099:3620:1875360098788864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788483278.873872:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4be19e4a-e21c-409c-93a6-e1423c5e2099:3620:1875360098788736:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788483278.874811:0:20998:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788483278.874820:0:20998:0:(import.c:65:import_set_state_nolock()) ffff9a69ece27000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788483278.877140:0:20998:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788483278.877225:0:20998:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1788483278.878411:0:20998:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788483278.878482:0:20998:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788483278.878508:0:20998:0:(import.c:65:import_set_state_nolock()) ffff9a69d25dc000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788483278.878536:0:20998:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788483278.878540:0:20998:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1788483278.878549:0:20998:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788483278.878602:0:20998:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788483278.878611:0:20998:0:(import.c:65:import_set_state_nolock()) ffff9a69c2b8d000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788483278.878649:0:20998:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9a69d2878000) has no exports 00000100:00100000:2.0:1788483278.878794:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098789248:0@lo:9:umount.0 00000100:00100000:2.0:1788483278.878857:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483278.878893:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098789376:0@lo:9:umount.0 00000100:00100000:0.0:1788483278.878905:0:20063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098789248 00000100:00100000:0.0:1788483278.878914:0:20063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098789248 00000100:00100000:2.0:1788483278.878918:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483278.878962:0:20063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098789376 00000100:00100000:0.0:1788483278.878966:0:20063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098789376 00000100:00100000:2.0:1788483278.878976:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788483278.879181:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875360098789248:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788483278.879206:0:18731:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b934 00000100:00080000:2.0:1788483278.879215:0:18731:0:(import.c:65:import_set_state_nolock()) ffff9a68c1d30800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788483278.879263:0:18731:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788483278.879411:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3618:x1875360098789248:12345-0@lo:9:umount.0 Request processed in 426us (553us total) trans 0 rc 0/0 00010000:00010000:1.0:1788483278.880401:0:20797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788483278.880642:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69d25dc000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788483278.880661:0:3618:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788483278.880663:0:3618:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788483278.880667:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098789248:0@lo:9:umount.0 00000100:00100000:0.0:1788483278.885123:0:20063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788483278.885144:0:20063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1875360098789376:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788483278.885175:0:20063:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1baa0 00000100:00080000:0.0:1788483278.885185:0:20063:0:(import.c:65:import_set_state_nolock()) ffff9a69f4519800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788483278.885236:0:20063:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1788483278.886326:0:20063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3618:x1875360098789376:12345-0@lo:9:umount.0 Request processed in 1187us (7405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483278.886346:0:20063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788483278.886481:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69c2b8d000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788483278.886497:0:3618:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788483278.886500:0:3618:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788483278.886504:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098789376:0@lo:9:umount.0 00010000:00010000:0.0:1788483278.887158:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483278.891117:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000020:00080000:1.0:1788483278.923448:0:20998:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9a69d2878000) has no exports 00000020:01000000:0.0:1788483279.034548:0:20998:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a68c10c64e0 - data ffff9a69c22a6870/ffff9a69d07d7400 00000020:01000000:0.0:1788483279.035561:0:20998:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a69c7665a80 - data ffff9a69c6c35288/ffff9a69c76ce000 00000001:00000004:2.0:1788483279.055006:0:20998:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1788483279.116563:0:20998:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788483279.116572:0:20998:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788483279.116580:0:20998:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788483279.121966:0:20998:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788483279.121973:0:20998:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1788483279.121992:0:20998:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788483279.121995:0:20998:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788483279.122638:0:17964:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788483279.122643:0:17964:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1788483279.122654:0:17964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788483279.124572:0:20998:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788483279.124580:0:20998:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1788483279.124599:0:20998:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788483279.124602:0:20998:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788483279.125531:0:17966:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788483279.125536:0:17966:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1788483279.125549:0:17966:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788483279.146256:0:20998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b79e 00000020:00000080:0.0:1788483279.146268:0:20998:0:(genops.c:885:class_export_put()) final put ffff9a69ece26800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788483279.147205:0:20998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b7b3 00000020:00000080:0.0:1788483279.147213:0:20998:0:(genops.c:885:class_export_put()) final put ffff9a68c36b4000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788483279.147587:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69ece26800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788483279.147832:0:20998:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1788483279.147838:0:20998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788483279.147848:0:20998:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788483279.147852:0:20998:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9a69d287cd28) has no exports 00000004:01000000:0.0:1788483279.148005:0:20998:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788483279.148013:0:20998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b807 00000020:00000080:0.0:1788483279.148018:0:20998:0:(genops.c:885:class_export_put()) final put ffff9a69c2b88000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788483279.148043:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c36b4000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788483279.151875:0:20998:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788483279.151888:0:20998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788483279.151899:0:20998:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788483279.151903:0:20998:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9a69c76d0000) has no exports 00000020:00000080:0.0:1788483279.151912:0:20998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b800 00000020:00000080:0.0:1788483279.151920:0:20998:0:(genops.c:885:class_export_put()) final put ffff9a69c2b8c800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788483279.154737:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69c2b88000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:0.0:1788483279.155469:0:20998:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788483279.155475:0:20998:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788483279.155480:0:20998:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788483279.155485:0:20998:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788483279.155488:0:20998:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788483279.158506:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69c2b8c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788483279.158787:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69c2b8d000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788483279.158836:0:20998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788483279.158848:0:20998:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788483279.158853:0:20998:0:(genops.c:885:class_export_put()) final put ffff9a69e011c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788483279.158857:0:20998:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69e011c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1788483279.158864:0:20998:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788483279.158950:0:20998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b7f2 00000020:00000080:0.0:1788483279.158957:0:20998:0:(genops.c:885:class_export_put()) final put ffff9a69e0119800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788483279.158974:0:20998:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788483279.158978:0:20998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788483279.158984:0:20998:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788483279.158987:0:20998:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9a69d28799b8) has no exports 00000020:00000080:0.0:1788483279.158994:0:20998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b7e4 00000020:00000080:0.0:1788483279.159004:0:20998:0:(genops.c:885:class_export_put()) final put ffff9a69e0118800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788483279.159164:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69e0119800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788483279.159171:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69e0118800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788483279.159808:0:20998:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788483279.159813:0:20998:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788483279.159818:0:20998:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788483279.159823:0:20998:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788483279.159825:0:20998:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788483279.159896:0:20998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788483279.159903:0:20998:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1788483279.159917:0:20998:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788483279.159923:0:20998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b7d6 00000020:00000080:0.0:1788483279.159928:0:20998:0:(genops.c:885:class_export_put()) final put ffff9a69e011b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788483279.163320:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69d25dc000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788483279.163535:0:37:0:(genops.c:885:class_export_put()) final put ffff9a69e011a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788483279.163539:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69e011a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788483279.163547:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788483279.163674:0:20998:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1788483279.163681:0:20998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788483279.163699:0:20998:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788483279.163704:0:20998:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9a69edaa3370) has no exports 00000020:00000080:0.0:1788483279.163711:0:20998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b7cf 00000020:00000080:0.0:1788483279.163717:0:20998:0:(genops.c:885:class_export_put()) final put ffff9a69d25dd000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788483279.168011:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69e011b000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00010000:00010000:1.0:1788483279.168275:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788483279.168800:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69d25dd000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788483279.172531:0:20998:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1788483279.172553:0:20998:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788483279.172557:0:20998:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788483279.172564:0:20998:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788483279.172624:0:20998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483279.172645:0:20998:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788483279.172669:0:20998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483279.172672:0:20998:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788483279.172677:0:20998:0:(genops.c:885:class_export_put()) final put ffff9a68c36b6000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788483279.172681:0:20998:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c36b6000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1788483279.172836:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69ece27000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788483279.172844:0:37:0:(genops.c:885:class_export_put()) final put ffff9a69d25d9800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788483279.172846:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69d25d9800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788483279.172855:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788483279.173005:0:20998:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788483279.173128:0:20998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b7ba 00000020:00000080:1.0:1788483279.173136:0:20998:0:(genops.c:885:class_export_put()) final put ffff9a68c36b4800/lustre-MDD0001_UUID 00000020:01000000:1.0:1788483279.173145:0:20998:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1788483279.173150:0:20998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788483279.173155:0:20998:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788483279.173159:0:20998:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9a69d287b370) has no exports 00000020:00000080:1.0:1788483279.173179:0:20998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483279.173183:0:20998:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1788483279.173187:0:20998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b7c1 00000020:00000080:1.0:1788483279.173191:0:20998:0:(genops.c:885:class_export_put()) final put ffff9a69d20ce800/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1788483279.173197:0:20998:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a68c3dba000 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1788483279.173200:0:20998:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a68c3dba000 2 00000020:01000004:1.0:1788483279.173203:0:20998:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a68c3dba000 from lustre-MDT0001 00000020:00000080:1.0:1788483279.173220:0:20998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483279.173223:0:20998:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1788483279.173226:0:20998:0:(genops.c:885:class_export_put()) final put ffff9a69ece21800/lustre-MDT0001_UUID 00000020:00000080:1.0:1788483279.173228:0:20998:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69ece21800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1788483279.173234:0:20998:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1788483279.173260:0:20998:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1788483279.173264:0:20998:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1788483279.173266:0:20998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788483279.173269:0:20998:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788483279.173281:0:20998:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9a68c24ed800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788483279.173286:0:20998:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9a69d0463370) has exports, disconnecting them 00000020:00080000:1.0:1788483279.173290:0:20998:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9a68c24ed800), last request at 1788483188 00000020:00000080:1.0:1788483279.173293:0:20998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b83f 00000020:00080000:1.0:1788483279.173304:0:20998:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a68c24ed800): rc 0 00000020:00000080:1.0:1788483279.173307:0:20998:0:(genops.c:885:class_export_put()) final put ffff9a68c24ed800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788483279.174326:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c36b4800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788483279.174344:0:37:0:(genops.c:885:class_export_put()) final put ffff9a69ece22000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788483279.174347:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69ece22000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788483279.174351:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788483279.174468:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69d20ce800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788483279.174473:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c24ed800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1788483279.312389:0:20998:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1788483279.312398:0:20998:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788483279.312403:0:20998:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788483279.312414:0:20998:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788483279.312596:0:20998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788483279.312606:0:20998:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1788483279.312613:0:20998:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a68c3dba000 1 00000020:00000080:0.0:1788483279.312619:0:20998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b766 00000020:00000080:0.0:1788483279.312626:0:20998:0:(genops.c:885:class_export_put()) final put ffff9a68c36b3800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1788483279.312631:0:20998:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1788483279.312636:0:20998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788483279.312640:0:20998:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788483279.312643:0:20998:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9a68c24e3370) has no exports 00000020:00000080:3.0:1788483279.313329:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c24ee800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788483279.313338:0:37:0:(genops.c:885:class_export_put()) final put ffff9a69c6a80000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788483279.313341:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69c6a80000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788483279.313348:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788483279.313413:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c36b3800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788483279.475571:0:20998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788483279.475586:0:20998:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788483279.475606:0:20998:0:(genops.c:885:class_export_put()) final put ffff9a68c3db8000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788483279.475612:0:20998:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c3db8000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788483279.475626:0:20998:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788483279.475760:0:20998:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a68c3dbf800 00000020:01000000:0.0:1788483279.475779:0:20998:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788483279.475784:0:20998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788483279.475788:0:20998:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788483279.475793:0:20998:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9a68c24e4d28) has no exports 00000100:00100000:1.0:1788483279.476025:0:18206:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9a68c37f7000:18206] 3 exiting: rc = 0 00000100:00100000:0.0:1788483279.476210:0:17223:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9a69f5463800:17223] 1 exiting: rc = 0 00000100:00100000:0.0:1788483279.476500:0:17224:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9a69f8d58200:17224] 2 exiting: rc = 0 00000100:00100000:3.0:1788483279.476652:0:17222:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9a69f5463400:17222] 0 exiting: rc = 1 00000100:00100000:1.0:1788483279.476830:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476840:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476845:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476851:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476856:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476862:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476867:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476873:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476878:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476889:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476895:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476901:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476906:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476912:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476918:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476923:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476928:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476934:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476940:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476944:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476951:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476956:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476962:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476967:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476972:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476978:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.476997:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477002:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477008:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477012:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477017:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477023:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477028:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477033:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477038:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477043:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477048:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477052:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477056:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477062:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477066:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477071:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477076:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477081:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477085:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477090:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477243:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477251:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477257:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477263:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477268:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477273:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477279:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477284:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477290:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477295:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477300:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477305:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477310:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477315:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477320:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477333:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477338:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.477343:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483279.481738:0:17226:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9a69f5463200:17226] 1 exiting: rc = 0 00000100:00100000:0.0:1788483279.481875:0:17225:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9a69df31f600:17225] 0 exiting: rc = 1 00000100:00100000:3.0:1788483279.481963:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.481984:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.481991:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.481997:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482002:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482007:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482012:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482018:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482024:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482029:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482034:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482039:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482044:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482048:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482052:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482056:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482060:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482064:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482069:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482073:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482079:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482084:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482089:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482093:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482234:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482239:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482243:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482249:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482254:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482259:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482264:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482269:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482273:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482278:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482286:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482295:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482309:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482315:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482320:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482326:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482331:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482337:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482342:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482346:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482352:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482357:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482362:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482366:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482370:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482375:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482379:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482383:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482388:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482393:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482398:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482403:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482408:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482412:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482417:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482422:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482427:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482433:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482439:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.482448:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.482951:0:17963:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9a69edbb7800:17963] 2 exiting: rc = 0 00000100:00100000:2.0:1788483279.483075:0:17227:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9a69df31e000:17227] 0 exiting: rc = 1 00000100:00100000:1.0:1788483279.483465:0:17228:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9a69f5462000:17228] 1 exiting: rc = 0 00000100:00100000:3.0:1788483279.483976:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.483987:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.483996:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484002:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484008:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484014:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484020:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484043:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484050:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484055:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484061:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484066:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484072:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484077:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484084:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484092:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484126:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484134:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484141:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484177:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484185:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484191:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484396:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484402:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484410:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484416:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484421:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484427:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484433:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484439:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484445:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484452:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484460:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484465:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484471:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484479:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484502:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484510:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484515:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484521:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484528:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484533:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484657:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484667:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484673:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484678:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484683:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484688:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484709:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484728:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484735:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484741:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484747:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484753:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484759:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484765:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484771:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484776:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484782:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484786:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484813:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484819:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484824:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.484829:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.500792:0:17230:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9a69c6292600:17230] 1 exiting: rc = 0 00000100:00100000:2.0:1788483279.500805:0:17229:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9a69ed862400:17229] 0 exiting: rc = 1 00000100:00100000:1.0:1788483279.501478:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501487:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501493:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501618:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501624:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501629:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501634:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501639:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501645:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501650:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501654:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501659:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501664:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501669:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501673:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501678:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501683:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501688:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501692:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501698:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501703:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501708:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501712:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501728:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501734:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501739:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501744:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501748:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501753:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501757:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501762:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501782:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501787:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501791:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501796:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501805:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501810:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501824:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501830:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501834:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501840:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501845:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501850:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501854:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501859:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501871:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501877:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501888:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501893:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501897:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501902:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501907:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501917:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501922:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501927:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501931:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501936:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501940:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501945:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501950:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501954:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501959:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501964:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.501968:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483279.503192:0:17232:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9a69f62c8800:17232] 1 exiting: rc = 0 00000100:00100000:3.0:1788483279.503569:0:17231:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9a69f62c9000:17231] 0 exiting: rc = 1 00000100:00100000:1.0:1788483279.503673:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503680:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503698:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503702:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503707:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503711:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503726:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503735:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503742:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503748:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503753:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503759:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503764:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503772:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503779:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503786:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503791:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503802:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503807:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503927:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503935:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503940:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503945:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503950:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503956:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503961:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503965:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503970:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503975:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503980:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503985:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503990:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.503995:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504000:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504005:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504010:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504015:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504028:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504033:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504039:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504044:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504049:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504053:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504058:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504063:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504068:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504073:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504078:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504084:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504089:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504130:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504137:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504142:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504188:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504441:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504450:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504455:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504460:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504464:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504469:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504474:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504478:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504482:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.504488:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.506650:0:17234:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9a69f62c9600:17234] 1 exiting: rc = 0 00000100:00100000:3.0:1788483279.506796:0:17233:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9a69f4508400:17233] 0 exiting: rc = 1 00000100:00100000:1.0:1788483279.506896:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.506903:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.506908:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.506912:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.506917:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.506923:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.506928:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.506933:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.506952:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.506956:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.506961:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.506966:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.506970:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.506976:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.506981:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.506986:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.506991:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.506996:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507001:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507008:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507012:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507017:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507022:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507027:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507032:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507037:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507042:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507047:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507052:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507057:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507061:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507066:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507071:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507076:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507081:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507086:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507091:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507218:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507225:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507229:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507234:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507239:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507243:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507254:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507259:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507264:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507268:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507272:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507278:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507282:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507287:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507291:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507295:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507300:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507305:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507310:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507315:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507320:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507325:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507329:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507334:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507339:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507343:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483279.507348:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483279.511266:0:17235:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9a69f62c8000:17235] 0 exiting: rc = 1 00000100:00100000:1.0:1788483279.511755:0:17236:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9a69f62c9400:17236] 1 exiting: rc = 0 00000100:00100000:1.0:1788483279.515838:0:17237:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9a69f62c8c00:17237] 2 exiting: rc = 0 00000100:00100000:0.0:1788483279.516555:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516563:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516568:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516573:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516579:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516584:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516589:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516608:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516614:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516619:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516625:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516630:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516635:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516641:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516646:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516652:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516657:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516662:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516667:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516672:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516677:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516708:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516713:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516728:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516734:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516739:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516743:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516749:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516754:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516759:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516765:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516785:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516791:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516797:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516803:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516808:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516814:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516819:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516825:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516831:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516837:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516842:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516847:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516853:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516858:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516864:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516870:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516875:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516881:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516887:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516892:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516898:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516904:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516912:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516918:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516939:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516953:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516958:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516964:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516969:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516975:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516981:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516986:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483279.516991:0:20998:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788483279.528380:0:20998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483279.528393:0:20998:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788483279.528399:0:20998:0:(genops.c:885:class_export_put()) final put ffff9a69f47c5800/MDS_uuid 00000020:00000080:1.0:1788483279.528403:0:20998:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69f47c5800/MDS_uuid for MDS 00000020:01000000:1.0:1788483279.528410:0:20998:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788483279.528538:0:20998:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1788483280.185420:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483281.208420:0:20797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483282.237079:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788483282.680246:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4be19e4a-e21c-409c-93a6-e1423c5e2099->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788483282.680256:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4be19e4a-e21c-409c-93a6-e1423c5e2099->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788483282.680259:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788483282.680270:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788483282.680273:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a68c331a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788483282.680281:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 569 00000100:00080000:1.0:1788483282.680286:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788483282.680292:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a68c331a800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788483282.680327:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69efe9ed80 x1875360098789504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788483282.680370:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788483282.680373:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788483282.680375:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a69c5056000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788483282.680379:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 569 00000100:00080000:1.0:1788483282.680381:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788483282.680385:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a69c5056000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788483282.680396:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69efe9f800 x1875360098789760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788483282.680434:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788483282.680449:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098789632:0@lo:400:kworker.0 00000400:00000100:1.0:1788483282.680497:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360098789632 offset 0 length 224: 4 00000100:00100000:1.0:1788483282.680571:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098789888:0@lo:400:kworker.0 00000400:00000100:1.0:1788483282.680590:0:3619:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360098789888 offset 0 length 224: 4 00000100:00100000:0.0:1788483282.685913:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1875360098789504:0@lo:38:kworker.0 00000400:00000100:0.0:1788483282.687119:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360098789504 offset 0 length 520: 4 00000100:00100000:0.0:1788483282.687168:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1875360098789760:0@lo:38:kworker.0 00000400:00000100:0.0:1788483282.687193:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360098789760 offset 0 length 520: 4 00010000:00010000:2.0:1788483283.257274:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788483283.744039:0:21199:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788483283.773259:0:21199:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788483283.773317:0:21199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76a00/0x1d7ea3d89ea1b8d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b8e0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483283.773330:0:21199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76a00/0x1d7ea3d89ea1b8d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b8e0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483283.773353:0:21199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76a00/0x1d7ea3d89ea1b8d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1b8e0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483283.773360:0:21199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76a00/0x1d7ea3d89ea1b8d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1b8e0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483283.773385:0:21199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788483283.773391:0:21199:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788483283.773414:0:21199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788483283.773424:0:21199:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69efe9ed80 x1875360098789504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788483302 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483283.773446:0:21199:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788483283.773452:0:21199:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788483283.773458:0:21199:0:(import.c:65:import_set_state_nolock()) ffff9a68c331a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788483283.773463:0:21199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788483283.773466:0:21199:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69efe9ed80 x1875360098789504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788483302 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483283.773473:0:21199:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788483283.773476:0:21199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:0.0:1788483283.773693:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1875360098789504:0@lo:38:kworker.0 00010000:00010000:2.0:1788483283.773843:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483283.773856:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76a00/0x1d7ea3d89ea1b8d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1b8e0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483283.773864:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76a00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:2.0:1788483283.773868:0:17210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76a00/0x1d7ea3d89ea1b8d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1b8e0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483283.773877:0:17210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76a00/0x1d7ea3d89ea1b8d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1b8e0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483283.773885:0:17210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76a00/0x1d7ea3d89ea1b8d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1b8e0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483283.773891:0:17210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788483283.773893:0:17210:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788483283.773895:0:17210:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788483283.773909:0:17210:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a69ece11800 00010000:00010000:2.0:1788483283.773913:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76a00/0x1d7ea3d89ea1b8d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1b8e0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483283.773919:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a68c1f76a00/0x1d7ea3d89ea1b8d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1b8e0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483283.773929:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483283.773931:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483283.773932:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788483283.775044:0:21199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788483283.775055:0:21199:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69efe9d880 x1875360098789632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483298 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483283.775084:0:21199:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788483283.775128:0:21199:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788483283.775150:0:21199:0:(import.c:65:import_set_state_nolock()) ffff9a69e011f800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788483283.775347:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098789632:0@lo:400:kworker.0 00000100:00100000:0.0:1788483283.775417:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3618:1875360098790016:0@lo:39:umount.0 00000400:00000100:0.0:1788483283.775464:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360098790016 offset 0 length 224: 4 00010000:00010000:1.0:1788483284.280944:0:20797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788483284.728224:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4be19e4a-e21c-409c-93a6-e1423c5e2099->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788483284.728234:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4be19e4a-e21c-409c-93a6-e1423c5e2099->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788483284.728237:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788483284.728241:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788483284.728412:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788483284.728430:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098790144:0@lo:400:kworker.0 00000400:00000100:1.0:1788483284.728485:0:3619:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360098790144 offset 0 length 224: 4 00000001:00100000:1.0:1788483284.733327:0:19542:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788483284.733336:0:19542:0:(genops.c:885:class_export_put()) final put ffff9a69f4518800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788483284.733431:0:18725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788483284.733435:0:18725:0:(genops.c:885:class_export_put()) final put ffff9a68c1d34000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788483284.733569:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69f4518800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788483284.733612:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c1d34000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788483284.733628:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69f4519800 for lustre-OST0001 00000020:00000080:0.0:1788483284.733633:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c1d30800 for lustre-OST0000 00010000:00010000:0.0:1788483285.308630:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483286.328302:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483287.352982:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788483287.736311:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4be19e4a-e21c-409c-93a6-e1423c5e2099->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788483287.736349:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4be19e4a-e21c-409c-93a6-e1423c5e2099->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788483287.736353:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788483287.736356:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788483287.736598:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788483287.736627:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098790272:0@lo:400:kworker.0 00000400:00000100:3.0:1788483287.736735:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360098790272 offset 0 length 224: 4 00010000:00010000:1.0:1788483288.377947:0:20797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483288.888454:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483278/real 1788483278] req@ffff9a69efe9e680 x1875360098789120/t0(0) o250->MGC192.168.206.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788483288 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483288.888493:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a69efe9e680 x1875360098789120/t0(0) o250->MGC192.168.206.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788483288 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788483288.888518:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69ece11800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788483288.888545:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788483288.888550:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4be19e4a-e21c-409c-93a6-e1423c5e2099:3618:1875360098789120:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1788483288.888617:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4be19e4a-e21c-409c-93a6-e1423c5e2099->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788483288.888623:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788483288.888626:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a69ece11800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483288.888632:0:36:0:(import.c:510:import_select_connection()) MGC192.168.206.154@tcp: connect to NID 0@lo last attempt 571 00000100:00080000:0.0:1788483288.888638:0:36:0:(import.c:589:import_select_connection()) MGC192.168.206.154@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788483288.888645:0:36:0:(import.c:624:import_select_connection()) MGC192.168.206.154@tcp: import ffff9a69ece11800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483288.888714:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69d0f22300 x1875360098790400/t0(0) o250->MGC192.168.206.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788483288.888742:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788483288.888747:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788483288.888915:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4be19e4a-e21c-409c-93a6-e1423c5e2099:3618:1875360098790400:0@lo:250:kworker.0 00000400:00000100:3.0:1788483288.888980:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875360098790400 offset 0 length 520: 4 00000100:00100000:1.0:1788483288.889317:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098790528:0@lo:400:kworker.0 00000400:00000100:1.0:1788483288.889365:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360098790528 offset 0 length 224: 4 00010000:00010000:0.0:1788483289.417804:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483290.427883:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483291.448422:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483292.472741:0:20797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483293.496513:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788483293.946272:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4be19e4a-e21c-409c-93a6-e1423c5e2099->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788483293.946284:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4be19e4a-e21c-409c-93a6-e1423c5e2099->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788483293.946287:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788483293.946290:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788483293.947509:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098790656:0@lo:400:kworker.0 00000400:00000100:0.0:1788483293.947586:0:3619:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360098790656 offset 0 length 224: 4 00000100:00100000:2.0:1788483294.008425:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483283/real 1788483283] req@ffff9a69efe9df80 x1875360098790016/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788483293 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483294.008465:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a69efe9df80 x1875360098790016/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788483293 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788483294.008488:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69e011f800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788483294.008509:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3618:1875360098790016:0@lo:39:umount.0 00000100:00080000:1.0:1788483294.008588:0:21199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788483294.008597:0:21199:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788483294.008604:0:21199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788483294.009505:0:21199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77400/0x1d7ea3d89ea1b8af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1b8b6 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483294.009519:0:21199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77400/0x1d7ea3d89ea1b8af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1b8b6 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483294.009526:0:21199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77400/0x1d7ea3d89ea1b8af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1b8b6 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483294.009534:0:21199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77400/0x1d7ea3d89ea1b8af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1b8b6 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483294.009558:0:21199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483294.009578:0:21199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1bc13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bc1a expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483294.009584:0:21199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1bc13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1bc1a expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483294.009590:0:21199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1bc13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1bc1a expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483294.009596:0:21199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1bc13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1bc1a expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483294.009625:0:21199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788483294.009629:0:21199:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788483294.009664:0:21199:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788483294.009668:0:21199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788483294.009672:0:21199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788483294.009677:0:21199:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788483294.009681:0:21199:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9a69d0464d28) has no exports 00000020:00080000:1.0:1788483294.009701:0:21199:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9a69d0464d28) has no exports 00010000:00010000:2.0:1788483294.010752:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788483294.010769:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77400/0x1d7ea3d89ea1b8af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1b8b6 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483294.010785:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77400 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:2.0:1788483294.010790:0:17211:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77400/0x1d7ea3d89ea1b8af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1b8b6 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483294.010802:0:17211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77400/0x1d7ea3d89ea1b8af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1b8b6 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483294.010811:0:17211:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77400/0x1d7ea3d89ea1b8af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1b8b6 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483294.010818:0:17211:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788483294.010839:0:17211:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788483294.010844:0:17211:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788483294.010868:0:17211:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a69ece11800 00010000:00010000:2.0:1788483294.010873:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77400/0x1d7ea3d89ea1b8af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1b8b6 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483294.010982:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77400/0x1d7ea3d89ea1b8af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1b8b6 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483294.011002:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483294.011007:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1bc13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1bc1a expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483294.011013:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ed9d9e00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:2.0:1788483294.011016:0:17211:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1bc13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1bc1a expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483294.011024:0:17211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1bc13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1bc1a expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483294.011030:0:17211:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1bc13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1bc1a expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483294.011035:0:17211:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788483294.011037:0:17211:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788483294.011039:0:17211:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788483294.011047:0:17211:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a69ece11800 00010000:00010000:2.0:1788483294.011050:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1bc13 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1bc1a expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483294.011058:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ed9d9e00/0x1d7ea3d89ea1bc13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1bc1a expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483294.011075:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483294.011077:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483294.011079:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788483294.011325:0:21199:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a69f61b4420 - data ffff9a69c6cc30d8/ffff9a69c7732c00 00010000:00010000:3.0:1788483294.019227:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788483294.022763:0:21199:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a68c1eb70c0 - data ffff9a69c9018a20/ffff9a69ed20a800 00100000:10000000:1.0:1788483294.034602:0:21199:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788483294.044506:0:21199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b8c4 00000020:00000080:0.0:1788483294.044517:0:21199:0:(genops.c:885:class_export_put()) final put ffff9a69e8fa9000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788483294.044537:0:21199:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a69d0564000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788483294.044541:0:21199:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a69d0564000 2 00000020:01000004:0.0:1788483294.044544:0:21199:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a69d0564000 from lustre-OST0000 00000020:00000080:0.0:1788483294.044567:0:21199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788483294.044586:0:21199:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788483294.044590:0:21199:0:(genops.c:885:class_export_put()) final put ffff9a69e8fac800/lustre-OST0000_UUID 00000020:00000080:0.0:1788483294.044593:0:21199:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69e8fac800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788483294.044599:0:21199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:2.0:1788483294.044755:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69e8fa9000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:2.0:1788483294.045151:0:21199:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788483294.045156:0:21199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788483294.045160:0:21199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788483294.045165:0:21199:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788483294.045171:0:21199:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9a68c331d000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788483294.045177:0:21199:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff9a69c55f19b8) has exports, disconnecting them 00000020:00080000:2.0:1788483294.045182:0:21199:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9a68c331d000), last request at 1788483203 00000020:00000080:2.0:1788483294.045186:0:21199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b8ee 00000020:00080000:2.0:1788483294.045196:0:21199:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a68c331d000): rc 0 00000020:00000080:2.0:1788483294.045200:0:21199:0:(genops.c:885:class_export_put()) final put ffff9a68c331d000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788483294.045848:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c331d000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788483294.045871:0:21199:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788483294.045875:0:21199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788483294.045879:0:21199:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788483294.045884:0:21199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788483294.046018:0:21199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788483294.046023:0:21199:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1788483294.046036:0:21199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788483294.046039:0:21199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788483294.046043:0:21199:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788483294.046047:0:21199:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9a68c36e7000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788483294.046052:0:21199:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9a69c76d4d28) has exports, disconnecting them 00000020:00080000:3.0:1788483294.046056:0:21199:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9a68c36e7000), last request at 1788483203 00000020:00000080:3.0:1788483294.046059:0:21199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b903 00000020:00080000:3.0:1788483294.046069:0:21199:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a68c36e7000): rc 0 00000020:00000080:3.0:1788483294.046073:0:21199:0:(genops.c:885:class_export_put()) final put ffff9a68c36e7000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788483294.046876:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c331a800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788483294.046886:0:37:0:(genops.c:885:class_export_put()) final put ffff9a68c331a000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788483294.046890:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c331a000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788483294.046896:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788483294.046953:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c36e7000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1788483294.077197:0:21199:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788483294.077207:0:21199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788483294.077211:0:21199:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788483294.077218:0:21199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788483294.077256:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69e011f800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788483294.077420:0:21199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788483294.077428:0:21199:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1788483294.077433:0:21199:0:(genops.c:885:class_export_put()) final put ffff9a68c1c46000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1788483294.077437:0:21199:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c1c46000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1788483294.077445:0:21199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1788483294.077505:0:21199:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a69d0564000 1 00000020:00000080:0.0:1788483294.077510:0:21199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b8a1 00000020:00000080:0.0:1788483294.077516:0:21199:0:(genops.c:885:class_export_put()) final put ffff9a69c6a87800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788483294.077524:0:21199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788483294.077530:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69c6a87800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788483294.077539:0:21199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788483294.077543:0:21199:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788483294.077547:0:21199:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9a68c24e19b8) has no exports 00000020:00000080:3.0:1788483294.169407:0:21199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788483294.169420:0:21199:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788483294.169425:0:21199:0:(genops.c:885:class_export_put()) final put ffff9a69d0567000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788483294.169430:0:21199:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69d0567000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788483294.169441:0:21199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788483294.169551:0:21199:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a69d0563000 00000020:02000400:3.0:1788483294.169607:0:21199:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788483294.520303:0:20797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483295.553606:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483296.569062:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483297.592247:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788483297.782872:0:21402:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788483297.795293:0:21402:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788483297.795370:0:21402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1ba3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1ba45 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483297.795386:0:21402:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1ba3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1ba45 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483297.795393:0:21402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1ba3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1ba45 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483297.795400:0:21402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1ba3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1ba45 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483297.795422:0:21402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788483297.795427:0:21402:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788483297.795461:0:21402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788483297.795472:0:21402:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69efe9f800 x1875360098789760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788483302 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483297.795543:0:21402:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788483297.795550:0:21402:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788483297.795556:0:21402:0:(import.c:65:import_set_state_nolock()) ffff9a69c5056000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788483297.795561:0:21402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788483297.795565:0:21402:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69efe9f800 x1875360098789760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788483302 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788483297.795608:0:20797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483297.795615:0:20797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1ba3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1ba45 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483297.795630:0:20797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8bc00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:1.0:1788483297.795634:0:20797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1ba3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1ba45 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483297.795650:0:20797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1ba3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1ba45 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788483297.795656:0:20797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1ba3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1ba45 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483297.795662:0:20797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788483297.795664:0:20797:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788483297.795666:0:20797:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788483297.795680:0:20797:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a69ece11800 00010000:00010000:1.0:1788483297.795683:0:20797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1ba3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1ba45 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483297.795688:0:20797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1ba3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1ba45 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483297.795698:0:20797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483297.795699:0:20797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483297.795701:0:20797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483297.798197:0:21402:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788483297.800001:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1875360098789760:0@lo:38:kworker.0 00000100:00100000:0.0:1788483297.800236:0:21402:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788483297.801259:0:21402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788483297.801270:0:21402:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69efe9ca80 x1875360098789888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483298 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483297.801304:0:21402:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69f5267800 x1875360098790144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483300 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483297.801313:0:21402:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69ffefb480 x1875360098790272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483303 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483297.801425:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098790144:0@lo:400:kworker.0 00000100:00100000:0.0:1788483297.801450:0:21402:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69d0f21500 x1875360098790528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483304 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483297.801459:0:21402:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69f5264700 x1875360098790656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483309 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483297.801467:0:21402:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788483297.801472:0:21402:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788483297.801670:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098789888:0@lo:400:kworker.0 00000100:00100000:2.0:1788483297.801691:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098790656:0@lo:400:kworker.0 00000100:00100000:1.0:1788483297.801779:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098790272:0@lo:400:kworker.0 00000100:00100000:1.0:1788483297.801796:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3622:1875360098790528:0@lo:400:kworker.0 00000100:00080000:0.0:1788483297.801845:0:21402:0:(import.c:65:import_set_state_nolock()) ffff9a68c1fc5800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788483297.801898:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3618:1875360098790784:0@lo:39:umount.0 00000400:00000100:2.0:1788483297.801943:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360098790784 offset 0 length 224: 4 00010000:00010000:0.0:1788483298.617348:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788483299.067624:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4be19e4a-e21c-409c-93a6-e1423c5e2099->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788483299.067634:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4be19e4a-e21c-409c-93a6-e1423c5e2099->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788483299.640724:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483300.664781:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483301.692421:0:20797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483302.712789:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483303.736620:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483303.928234:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483288/real 1788483288] req@ffff9a69d0f22300 x1875360098790400/t0(0) o250->MGC192.168.206.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788483303 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483303.928266:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a69d0f22300 x1875360098790400/t0(0) o250->MGC192.168.206.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788483303 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788483303.928285:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69ece11800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483303.928313:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788483303.928317:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4be19e4a-e21c-409c-93a6-e1423c5e2099:3618:1875360098790400:0@lo:250:kworker.0 00000100:00080000:2.0:1788483303.929167:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4be19e4a-e21c-409c-93a6-e1423c5e2099->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788483303.929174:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788483303.929177:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a69ece11800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788483303.929198:0:37:0:(import.c:510:import_select_connection()) MGC192.168.206.154@tcp: connect to NID 0@lo last attempt 581 00000100:00080000:2.0:1788483303.929203:0:37:0:(import.c:589:import_select_connection()) MGC192.168.206.154@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788483303.929208:0:37:0:(import.c:624:import_select_connection()) MGC192.168.206.154@tcp: import ffff9a69ece11800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:2.0:1788483303.929235:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69ffef9500 x1875360098790912/t0(0) o250->MGC192.168.206.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788483303.929317:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4be19e4a-e21c-409c-93a6-e1423c5e2099:3618:1875360098790912:0@lo:250:kworker.0 00000400:00000100:0.0:1788483303.929363:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875360098790912 offset 0 length 520: 4 00010000:00010000:3.0:1788483304.760247:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483305.784306:0:20797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483306.813834:0:19802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483307.001111:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483297/real 1788483297] req@ffff9a69d0f20380 x1875360098790784/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788483307 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483307.001144:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a69d0f20380 x1875360098790784/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788483307 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788483307.001164:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c1fc5800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788483307.001202:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3618:1875360098790784:0@lo:39:umount.0 00000100:00080000:2.0:1788483307.003389:0:21402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788483307.003398:0:21402:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788483307.003405:0:21402:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788483307.005612:0:21402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7c00/0x1d7ea3d89ea1ba14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1ba1b expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483307.005629:0:21402:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7c00/0x1d7ea3d89ea1ba14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1ba1b expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483307.005636:0:21402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7c00/0x1d7ea3d89ea1ba14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1ba1b expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483307.005643:0:21402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7c00/0x1d7ea3d89ea1ba14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1ba1b expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483307.005671:0:21402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483307.005678:0:21402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77200/0x1d7ea3d89ea1bc05 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bc0c expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483307.005684:0:21402:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77200/0x1d7ea3d89ea1bc05 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1bc0c expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483307.005690:0:21402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77200/0x1d7ea3d89ea1bc05 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1bc0c expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483307.005712:0:21402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77200/0x1d7ea3d89ea1bc05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d7ea3d89ea1bc0c expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483307.005738:0:21402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788483307.005743:0:21402:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788483307.005771:0:21402:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788483307.005775:0:21402:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788483307.005779:0:21402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788483307.005784:0:21402:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788483307.005790:0:21402:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9a68c44019b8) has no exports 00000020:00080000:2.0:1788483307.005813:0:21402:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9a68c44019b8) has no exports 00010000:00010000:3.0:1788483307.006379:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788483307.006387:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7c00/0x1d7ea3d89ea1ba14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1ba1b expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483307.006395:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c7c00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788483307.006398:0:17211:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7c00/0x1d7ea3d89ea1ba14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1ba1b expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483307.006419:0:17211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7c00/0x1d7ea3d89ea1ba14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1ba1b expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788483307.006426:0:17211:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7c00/0x1d7ea3d89ea1ba14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1ba1b expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483307.006432:0:17211:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788483307.006434:0:17211:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788483307.006436:0:17211:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1788483307.006448:0:17211:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a69ece11800 00010000:00010000:3.0:1788483307.006452:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7c00/0x1d7ea3d89ea1ba14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1ba1b expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483307.006457:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a6a021c7c00/0x1d7ea3d89ea1ba14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1ba1b expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483307.006475:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483307.006479:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77200/0x1d7ea3d89ea1bc05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1bc0c expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483307.006484:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77200 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:3.0:1788483307.006487:0:17211:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77200/0x1d7ea3d89ea1bc05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d7ea3d89ea1bc0c expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483307.006492:0:17211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77200/0x1d7ea3d89ea1bc05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1bc0c expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788483307.006498:0:17211:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77200/0x1d7ea3d89ea1bc05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1bc0c expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483307.006521:0:17211:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788483307.006523:0:17211:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788483307.006524:0:17211:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788483307.006531:0:17211:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a69ece11800 00010000:00010000:3.0:1788483307.006534:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77200/0x1d7ea3d89ea1bc05 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1bc0c expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483307.007557:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483307.007664:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a68c1f77200/0x1d7ea3d89ea1bc05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1bc0c expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483307.007686:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483307.007688:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483307.007690:0:17211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788483307.014591:0:21402:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a69f61b4d20 - data ffff9a69c6f73798/ffff9a69f52a5c00 00000020:01000000:2.0:1788483307.014738:0:21402:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a68c10c6960 - data ffff9a69e04b7e58/ffff9a68c2659c00 00100000:10000000:2.0:1788483307.021878:0:21402:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788483307.030723:0:21402:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1ba29 00000020:00000080:2.0:1788483307.030734:0:21402:0:(genops.c:885:class_export_put()) final put ffff9a69f45ff000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788483307.030751:0:21402:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a68c331b000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788483307.030755:0:21402:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a68c331b000 2 00000020:01000004:2.0:1788483307.030758:0:21402:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a68c331b000 from lustre-OST0001 00000020:00000080:2.0:1788483307.030782:0:21402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788483307.030791:0:21402:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788483307.030794:0:21402:0:(genops.c:885:class_export_put()) final put ffff9a69f45fa000/lustre-OST0001_UUID 00000020:00000080:2.0:1788483307.030797:0:21402:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69f45fa000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788483307.030802:0:21402:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788483307.030899:0:21402:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 4be19e4a-e21c-409c-93a6-e1423c5e2099->MGS 00010000:00010000:2.0:1788483307.030913:0:21402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b76d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1b774 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483307.030924:0:21402:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b76d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1b774 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483307.030939:0:21402:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788483307.030942:0:21402:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788483307.030945:0:21402:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788483307.030960:0:21402:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a69ece11800 00010000:00010000:2.0:1788483307.030963:0:21402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2a00/0x1d7ea3d89ea1b76d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1b774 expref: -99 pid: 17954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483307.030979:0:21402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2600/0x1d7ea3d89ea1b65c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d7ea3d89ea1b663 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483307.030986:0:21402:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2600/0x1d7ea3d89ea1b65c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d7ea3d89ea1b663 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483307.030991:0:21402:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788483307.030993:0:21402:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788483307.030995:0:21402:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788483307.031003:0:21402:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a69ece11800 00010000:00010000:2.0:1788483307.031006:0:21402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c29e2600/0x1d7ea3d89ea1b65c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d7ea3d89ea1b663 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788483307.031021:0:21402:0:(import.c:65:import_set_state_nolock()) ffff9a69ece11800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788483307.031025:0:21402:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788483307.031028:0:21402:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788483307.031029:0:21402:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788483307.031033:0:21402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788483307.031044:0:21402:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a69ffef9500 x1875360098790912/t0(0) o250->MGC192.168.206.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788483323 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788483307.031057:0:21402:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788483307.031060:0:21402:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000020:00000080:0.0:1788483307.031726:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69f45ff000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1788483307.031760:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4be19e4a-e21c-409c-93a6-e1423c5e2099:3618:1875360098790912:0@lo:250:kworker.0 10000000:01000000:2.0:1788483307.031834:0:21402:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788483307.031849:0:21402:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1b647 00000020:00000080:2.0:1788483307.031854:0:21402:0:(genops.c:885:class_export_put()) final put ffff9a69f47c1800/4be19e4a-e21c-409c-93a6-e1423c5e2099 00000020:01000000:2.0:1788483307.031869:0:21402:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.154@tcp (flags='') 00000020:00000080:2.0:1788483307.031875:0:21402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788483307.031879:0:21402:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.154@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788483307.031883:0:21402:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9a69edaa0000) has no exports 10000000:01000000:2.0:1788483307.031898:0:17219:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788483307.031946:0:21402:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.154@tcp: client import never connected 00000100:00080000:2.0:1788483307.031949:0:21402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788483307.031951:0:21402:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788483307.031953:0:21402:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788483307.031955:0:21402:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788483307.031986:0:21402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788483307.031991:0:21402:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.154@tcp (uuid 4be19e4a-e21c-409c-93a6-e1423c5e2099) 00000020:01000000:2.0:1788483307.031996:0:21402:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788483307.031999:0:21402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788483307.032002:0:21402:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788483307.032006:0:21402:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9a68c1c47000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788483307.032011:0:21402:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9a69c76d19b8) has exports, disconnecting them 00000020:00080000:2.0:1788483307.032015:0:21402:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9a68c1c47000), last request at 1788483220 00000020:00000080:2.0:1788483307.032019:0:21402:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1ba53 00000020:00080000:2.0:1788483307.032030:0:21402:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a68c1c47000): rc 0 00000020:00000080:2.0:1788483307.032034:0:21402:0:(genops.c:885:class_export_put()) final put ffff9a68c1c47000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788483307.033123:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69f47c1800/4be19e4a-e21c-409c-93a6-e1423c5e2099 for MGC192.168.206.154@tcp 00000020:00000080:0.0:1788483307.033135:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69ece11800 for MGC192.168.206.154@tcp 00000020:00000080:0.0:1788483307.033141:0:37:0:(genops.c:885:class_export_put()) final put ffff9a69ece15800/4be19e4a-e21c-409c-93a6-e1423c5e2099 00000020:00000080:0.0:1788483307.033143:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69ece15800/4be19e4a-e21c-409c-93a6-e1423c5e2099 for MGC192.168.206.154@tcp 00000020:01000000:0.0:1788483307.033157:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.154@tcp (4be19e4a-e21c-409c-93a6-e1423c5e2099) 00000020:00000080:0.0:1788483307.033431:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c1c47000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788483307.033833:0:21402:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788483307.033838:0:21402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788483307.033841:0:21402:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788483307.033847:0:21402:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788483307.033992:0:21402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788483307.033999:0:21402:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788483307.034004:0:21402:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788483307.034009:0:21402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788483307.034013:0:21402:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788483307.034018:0:21402:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9a68c1fc7800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788483307.034023:0:21402:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff9a69e009cd28) has exports, disconnecting them 00000020:00080000:0.0:1788483307.034028:0:21402:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9a68c1fc7800), last request at 1788483220 00000020:00000080:0.0:1788483307.034031:0:21402:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1ba68 00000020:00080000:0.0:1788483307.034044:0:21402:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a68c1fc7800): rc 0 00000020:00000080:0.0:1788483307.034048:0:21402:0:(genops.c:885:class_export_put()) final put ffff9a68c1fc7800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788483307.034980:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a69c5056000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788483307.034988:0:37:0:(genops.c:885:class_export_put()) final put ffff9a68c36e7800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788483307.034998:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c36e7800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788483307.035006:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788483307.035055:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c1fc7800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1788483307.035075:0:21402:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788483307.035079:0:21402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788483307.035081:0:21402:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788483307.035085:0:21402:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788483307.035119:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68c1fc5800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1788483307.035158:0:20797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788483307.035271:0:19802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788483307.035348:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1788483307.035897:0:17211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1788483307.036071:0:17206:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9a69ed86b200:17206] 1 exiting: rc = 0 00000100:00100000:2.0:1788483307.036226:0:17205:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9a69ed86b000:17205] 0 exiting: rc = 1 00000100:00100000:1.0:1788483307.036348:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.036610:0:17208:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9a69c455cc00:17208] 1 exiting: rc = 0 00000100:00100000:1.0:1788483307.036668:0:17209:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9a69c455c800:17209] 2 exiting: rc = 0 00000100:00100000:1.0:1788483307.037197:0:17207:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9a69d47b4800:17207] 0 exiting: rc = 1 00000100:00100000:3.0:1788483307.037539:0:20710:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9a68c461c000:20710] 3 exiting: rc = 0 00000100:00100000:1.0:1788483307.037859:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.037866:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.037872:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.037877:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.037884:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.037890:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.037895:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.037900:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.037906:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.037911:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.037917:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.037921:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.037927:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.037932:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.037937:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.037954:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.037960:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.037965:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.037971:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.037976:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.037982:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.037987:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.037992:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.037998:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038003:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038008:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038014:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038019:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038024:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038029:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038034:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038040:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038045:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038050:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038055:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038061:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038065:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038070:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038076:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038081:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038085:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038090:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038114:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038120:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038126:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038131:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038136:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038141:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038146:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038151:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038164:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038181:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038188:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038193:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038197:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038202:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038207:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038211:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038216:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038221:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038226:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038231:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038236:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.038248:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788483307.039232:0:21402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483307.039253:0:21402:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1788483307.039259:0:21402:0:(genops.c:885:class_export_put()) final put ffff9a68c1fc6000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1788483307.039263:0:21402:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c1fc6000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1788483307.039268:0:21402:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1788483307.039317:0:21402:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a68c331b000 1 00000020:00000080:1.0:1788483307.039324:0:21402:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d7ea3d89ea1ba0d 00000020:00000080:1.0:1788483307.039330:0:21402:0:(genops.c:885:class_export_put()) final put ffff9a69e8faf000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788483307.039342:0:21402:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788483307.039353:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69e8faf000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788483307.039648:0:21402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788483307.039654:0:21402:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788483307.039659:0:21402:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff9a69e00999b8) has no exports 00000020:00000080:1.0:1788483307.137288:0:21402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483307.137302:0:21402:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788483307.137307:0:21402:0:(genops.c:885:class_export_put()) final put ffff9a68c331e000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788483307.137311:0:21402:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68c331e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788483307.137322:0:21402:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788483307.137687:0:21402:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a68c331f000 00000020:01000000:1.0:1788483307.137723:0:21402:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788483307.137727:0:21402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788483307.137731:0:21402:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788483307.137735:0:21402:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9a69d0460000) has no exports 00000020:00000080:1.0:1788483307.137760:0:21402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483307.137766:0:21402:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788483307.137769:0:21402:0:(genops.c:885:class_export_put()) final put ffff9a69c6a86000/OSS_uuid 00000020:00000080:1.0:1788483307.137772:0:21402:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69c6a86000/OSS_uuid for OSS 00000020:01000000:1.0:1788483307.137776:0:21402:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788483307.137861:0:18730:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9a69edb52a00:18730] 1 exiting: rc = 0 00000100:00100000:1.0:1788483307.137947:0:18729:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9a69ece3de00:18729] 0 exiting: rc = 1 00000100:00100000:1.0:1788483307.138002:0:20063:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9a68c329ce00:20063] 4 exiting: rc = 0 00000100:00100000:1.0:1788483307.138052:0:19165:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9a68c3c1ae00:19165] 3 exiting: rc = 0 00000100:00080000:2.0:1788483307.139453:0:17218:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788483307.139616:0:18731:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9a69edb90600:18731] 2 exiting: rc = 0 00000100:00100000:1.0:1788483307.139711:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139721:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139726:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139731:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139736:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139744:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139749:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139753:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139758:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139763:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139768:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139773:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139777:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139782:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139787:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139792:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139797:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139803:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139809:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139814:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139819:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139838:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139844:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139849:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139854:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139859:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139865:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139870:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139875:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139880:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139885:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139891:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139897:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139903:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139908:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139914:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139919:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139924:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139930:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139935:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139940:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139946:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139951:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139956:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139961:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139966:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139971:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139977:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139982:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139988:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139994:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.139999:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.140004:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.140010:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.140015:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.140021:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.140033:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.140038:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.140043:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.140049:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.140053:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.140057:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.140062:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483307.140066:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.142590:0:18733:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9a69c120b600:18733] 1 exiting: rc = 0 00000100:00100000:0.0:1788483307.142701:0:20364:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9a69f5308400:20364] 2 exiting: rc = 0 00000100:00100000:1.0:1788483307.151238:0:18732:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9a69edb91600:18732] 0 exiting: rc = 1 00000100:00100000:2.0:1788483307.152313:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152321:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152326:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152331:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152337:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152342:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152361:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152365:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152371:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152376:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152380:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152385:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152390:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152396:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152401:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152407:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152411:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152416:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152421:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152426:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152431:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152437:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152442:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152448:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152453:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152459:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152465:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152470:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152475:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152481:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152486:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152491:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152495:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152500:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152505:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152509:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152514:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152520:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152525:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152530:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152534:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152732:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152738:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152743:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152748:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152752:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152758:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152764:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152783:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152790:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152795:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152801:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152806:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152812:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152817:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152822:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152832:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152839:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152844:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152849:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152854:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152859:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152864:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.152869:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.154892:0:18736:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9a69c77a9200:18736] 2 exiting: rc = 0 00000100:00100000:2.0:1788483307.155049:0:18735:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9a69c77a9e00:18735] 1 exiting: rc = 0 00000100:00100000:0.0:1788483307.155077:0:18734:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9a69d99df000:18734] 0 exiting: rc = 1 00000100:00100000:2.0:1788483307.155661:0:20363:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9a69c7512a00:20363] 3 exiting: rc = 0 00000100:00100000:0.0:1788483307.155814:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155823:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155828:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155834:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155839:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155845:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155851:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155857:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155878:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155883:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155889:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155894:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155899:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155905:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155911:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155916:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155922:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155946:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155953:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155959:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155964:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155970:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155976:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155982:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155987:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155992:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.155997:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156002:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156007:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156012:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156017:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156023:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156028:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156033:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156037:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156042:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156047:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156052:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156058:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156063:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156068:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156086:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156093:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156124:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156129:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156135:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156141:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156146:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156152:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156158:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156163:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156167:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156173:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156178:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156184:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156189:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156194:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156200:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156213:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156220:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156225:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156230:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156235:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.156241:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483307.164018:0:18737:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9a69c77a8c00:18737] 0 exiting: rc = 1 00000100:00100000:2.0:1788483307.165197:0:18738:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9a69c77a8a00:18738] 1 exiting: rc = 0 00000100:00100000:0.0:1788483307.165440:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165448:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165465:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165472:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165478:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165483:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165488:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165492:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165497:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165502:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165514:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165520:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165525:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165529:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165633:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165639:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165644:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165648:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165653:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165659:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165664:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165670:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165676:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165680:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165685:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165690:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165695:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165700:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165704:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165709:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165714:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165718:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165722:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165727:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165732:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165738:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165744:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165750:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165755:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165760:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165765:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165771:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165776:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165785:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165789:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165794:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165799:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165804:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165808:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165819:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165827:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165832:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165836:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165841:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165846:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165851:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165856:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165861:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165865:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165870:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165875:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165880:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165885:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.165891:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.167203:0:18740:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9a69ed20e800:18740] 1 exiting: rc = 0 00000100:00100000:2.0:1788483307.169153:0:18739:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9a69ed20f000:18739] 0 exiting: rc = 1 00000100:00100000:0.0:1788483307.169533:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170758:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170773:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170778:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170786:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170791:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170797:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170803:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170834:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170841:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170846:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170851:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170856:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170862:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170867:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170872:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170878:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170883:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170888:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170905:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170921:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170927:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170933:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170938:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170943:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170948:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170954:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170959:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170966:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170971:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170976:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170981:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.170998:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171003:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171009:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171014:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171020:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171026:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171031:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171036:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171042:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171047:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171053:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171058:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171075:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171081:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171086:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171091:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171110:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171116:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171124:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171131:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171136:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171141:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171153:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171159:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171179:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171187:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171194:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171200:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171207:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171212:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171218:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483307.171224:0:21402:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788483307.187146:0:21402:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788483326.539202:0:22167:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg654-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788483337.954834:0:22767:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788483337.954839:0:22767:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788483337.954840:0:22767:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788483337.956508:0:22767:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a68c4d04800 00000020:01000004:2.0:1788483337.956527:0:22767:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788483337.956630:0:22767:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788483337.956654:0:22767:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9a69c76d3370) 00000020:00000080:2.0:1788483337.956667:0:22767:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788483338.055166:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788483338.056597:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788483338.061637:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1788483338.061916:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1788483338.062180:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788483338.062499:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788483338.062754:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788483338.063344:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788483338.063610:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788483338.063879:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1788483338.064222:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788483338.064558:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788483338.064808:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1788483338.065324:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788483338.065699:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788483338.065969:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788483338.066300:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1788483338.066576:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1788483338.066829:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788483338.067135:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1788483338.067396:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788483338.067793:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788483338.068130:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788483338.068469:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788483338.068827:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788483338.069236:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1788483338.069543:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788483338.069791:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788483338.070122:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788483338.070449:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1788483338.070632:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788483338.071029:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788483338.071380:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788483338.071625:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788483338.072594:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1788483338.072896:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788483338.073493:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788483338.074656:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788483338.075058:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1788483338.075316:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1788483338.075576:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1788483338.075850:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788483338.077816:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788483338.078301:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788483338.078540:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788483338.078772:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788483338.082272:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788483338.091235:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788483338.091770:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1788483338.092067:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788483338.092464:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788483338.093323:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788483338.093597:0:22767:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:3.0:1788483338.094595:0:22767:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788483338.094817:0:22767:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788483338.094825:0:22767:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788483338.094836:0:22767:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d7ea3d89ea1beba 00000020:01000004:3.0:1788483338.094843:0:22767:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788483338.094847:0:22767:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788483338.094851:0:22767:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a68c4d04800 from MGS 00000020:01000004:3.0:1788483338.094854:0:22767:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788483338.094874:0:22767:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9a69d0463370) 00000020:00000080:3.0:1788483338.094884:0:22767:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788483338.094959:0:22767:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a68c4d04800 from MGS, refs=2 00080000:01000000:3.0:1788483338.094964:0:22767:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788483338.094968:0:22767:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d7ea3d89ea1bec8 00000100:00100000:3.0:1788483338.095072:0:22767:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788483338.095236:0:22767:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788483338.095466:0:22767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788483338.096155:0:22767:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788483338.096163:0:22767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788483338.097014:0:22767:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788483338.097783:0:22767:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788483338.097795:0:22767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788483338.102409:0:22767:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788483338.102432:0:22767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788483338.105346:0:22767:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788483338.106502:0:22767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788483338.108076:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483338.108080:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483338.108082:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483338.109368:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483338.109371:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483338.109373:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483338.110327:0:22767:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788483338.120685:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788483338.129308:0:22767:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788483338.130092:0:22779:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788483338.130226:0:22767:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788483338.130264:0:22767:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788483338.132481:0:22767:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788483338.132862:0:22767:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788483338.134408:0:22767:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788483338.134424:0:22767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788483338.143402:0:22767:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788483338.143424:0:22767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788483338.143861:0:22767:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788483338.143867:0:22767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788483338.144476:0:22767:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788483338.144493:0:22767:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.154@tcp' 00000020:01000004:1.0:1788483338.144495:0:22767:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788483338.144521:0:22767:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.154@tcp (typ=mgc) 00000020:00000080:1.0:1788483338.144533:0:22767:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.154@tcp (ffff9a69e00999b8) 00000020:00000080:1.0:1788483338.144546:0:22767:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788483338.144614:0:22767:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a68c36e7000@MGC192.168.206.154@tcp: add connection 192.168.206.154@tcp at head 00010000:00010000:1.0:1788483338.144762:0:22767:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.154@tcp-0 is initialized 00000040:01000000:1.0:1788483338.144767:0:22767:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.154@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788483338.144856:0:22784:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788483338.150664:0:22785:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788483338.150842:0:22767:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.154@tcp (uuid 0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1) 00000020:00000080:2.0:1788483338.150864:0:22767:0:(genops.c:1385:class_connect()) connect: client 0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1, cookie 0x1d7ea3d89ea1bed6 00000100:00080000:2.0:1788483338.150876:0:22767:0:(import.c:510:import_select_connection()) MGC192.168.206.154@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788483338.150881:0:22767:0:(import.c:624:import_select_connection()) MGC192.168.206.154@tcp: import ffff9a68c36e7000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:2.0:1788483338.150913:0:22767:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69ffefaa00 x1875360098791040/t0(0) o250->MGC192.168.206.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788483338.151053:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3618:1875360098791040:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788483338.151145:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788483338.151226:0:22767:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1->MGS 00000020:01000004:2.0:1788483338.151250:0:22767:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788483338.151256:0:22767:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788483338.151268:0:22767:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9a69c76d19b8) 00000020:00000080:2.0:1788483338.151286:0:22767:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788483338.152203:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098791040 00000100:00100000:1.0:1788483338.152212:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098791040 00000100:00100000:1.0:1788483338.152245:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788483338.152253:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3618:x1875360098791040:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788483338.152275:0:22780:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1@0@lo t0 exp 0000000000000000 cur 630 last 0 00000020:00000080:1.0:1788483338.152300:0:22780:0:(genops.c:1385:class_connect()) connect: client 0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1, cookie 0x1d7ea3d89ea1bee4 00000100:00080000:1.0:1788483338.152432:0:22780:0:(import.c:65:import_set_state_nolock()) ffff9a68c36e5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788483338.162699:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+5:3618:x1875360098791040:12345-0@lo:250:mount.lustre.0 Request processed in 10437us (11545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483338.162713:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788483338.162794:0:3618:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.154@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788483338.162804:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.154@tcp: connect to target with instance 0 00000100:00080000:1.0:1788483338.162811:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788483338.162815:0:3618:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788483338.162819:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c36e7000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788483338.162822:0:3618:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788483338.162835:0:3618:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788483338.162841:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3618:1875360098791040:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788483338.173234:0:22767:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788483338.173485:0:22767:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788483338.173492:0:22767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788483338.178928:0:22767:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788483338.178940:0:22767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788483338.183075:0:22767:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788483338.183087:0:22767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788483338.186710:0:22767:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788483338.186896:0:22767:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788483338.186903:0:22767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788483338.188177:0:22767:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788483338.188190:0:22767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788483338.233926:0:22767:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788483338.234127:0:22767:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788483338.234133:0:22767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788483338.240556:0:22767:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788483338.240572:0:22767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788483338.244428:0:22767:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788483338.244691:0:22767:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788483338.244697:0:22767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788483338.252520:0:22767:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788483338.252535:0:22767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788483338.253978:0:22767:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788483338.254236:0:22767:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788483338.254243:0:22767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788483338.257378:0:22767:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788483338.257391:0:22767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788483338.261179:0:22767:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788483338.261346:0:22767:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788483338.261351:0:22767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788483338.261853:0:22767:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788483338.261860:0:22767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788483338.285048:0:22767:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788483338.289767:0:22767:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788483338.289774:0:22767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788483338.291455:0:22767:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788483338.291467:0:22767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788483338.292818:0:22767:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788483338.292827:0:22767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788483338.295840:0:22767:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788483338.295878:0:22767:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788483338.295883:0:22767:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788483338.295971:0:22767:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788483338.295999:0:22767:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.154@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788483338.296004:0:22767:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788483338.296005:0:22767:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788483338.296006:0:22767:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788483338.296007:0:22767:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788483338.296008:0:22767:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788483338.296009:0:22767:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788483338.296010:0:22767:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788483338.296012:0:22767:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788483338.296013:0:22767:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788483338.296014:0:22767:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788483338.296016:0:22767:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788483338.296018:0:22767:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788483338.296019:0:22767:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788483338.296024:0:22767:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788483338.296025:0:22767:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788483338.296026:0:22767:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788483338.296027:0:22767:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788483338.296028:0:22767:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788483338.296029:0:22767:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788483338.296030:0:22767:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788483338.296031:0:22767:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788483338.296053:0:22767:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788483338.296070:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5264e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098791168:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788483338.296264:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483338.296330:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed85f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788483338.296363:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098791168 00000100:00100000:1.0:1788483338.296370:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098791168 00000100:00100000:1.0:1788483338.296448:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788483338.296457:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+5:22767:x1875360098791168:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788483338.296496:0:22783:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788483338.296500:0:22783:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788483338.296514:0:22783:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788483338.296811:0:22804:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788483338.297357:0:22783:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1788483338.303581:0:22805:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788483338.303590:0:22805:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788483338.303593:0:22805:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788483338.303596:0:22805:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788483338.303780:0:22805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788483338.305683:0:22783:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788483338.305695:0:22783:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788483338.314987:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+5:22767:x1875360098791168:12345-0@lo:253:mount.lustre.0 Request processed in 18522us (18714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483338.315026:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788483338.315278:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5264e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098791168:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788483338.315294:0:22767:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788483338.315297:0:22767:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788483338.315298:0:22767:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788483338.315299:0:22767:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788483338.315301:0:22767:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788483338.315309:0:22767:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788483338.315311:0:22767:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788483338.315312:0:22767:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788483338.315314:0:22767:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788483338.315315:0:22767:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788483338.315316:0:22767:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788483338.315338:0:22767:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a68c4d04800 from lustre-MDT0000 10000000:01000000:2.0:1788483338.315368:0:22767:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788483338.315371:0:22767:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788483338.315375:0:22767:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a69e00999b8 10000000:01000000:2.0:1788483338.315379:0:22767:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788483338.315397:0:22767:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a69e00999b8 from 1 10000000:01000000:2.0:1788483338.315400:0:22767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788483338.315445:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27400/0x1d7ea3d89ea1beeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483338.315457:0:22767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27400/0x1d7ea3d89ea1beeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483338.315466:0:22767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27400/0x1d7ea3d89ea1beeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483338.315486:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098791296:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788483338.315538:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483338.315616:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c6940000 going to sleep for 11 seconds 00000100:00100000:1.0:1788483338.315914:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098791296 00000100:00100000:1.0:1788483338.315920:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098791296 00000100:00100000:0.0:1788483338.319653:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788483338.319667:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+5:22767:x1875360098791296:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788483338.319685:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483338.319706:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69d0400c00/0x1d7ea3d89ea1bef2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1beeb expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483338.319733:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69d0400c00/0x1d7ea3d89ea1bef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1beeb expref: 6 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483338.319744:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69d0400c00/0x1d7ea3d89ea1bef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1beeb expref: 6 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483338.319766:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69d0400c00, rc 0) 00000100:00100000:0.0:1788483338.319855:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+6:22767:x1875360098791296:12345-0@lo:101:mount.lustre.0 Request processed in 190us (4315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483338.319861:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788483338.320524:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098791296:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788483338.320541:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27400/0x1d7ea3d89ea1beeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bef2 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483338.320550:0:22767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27400/0x1d7ea3d89ea1beeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1bef2 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483338.320633:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098791424:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483338.320669:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483338.320706:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c6940000 going to sleep for 11 seconds 00000100:00100000:0.0:1788483338.321838:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098791424 00000100:00100000:0.0:1788483338.321849:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098791424 00000100:00100000:0.0:1788483338.321899:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788483338.321909:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+6:22767:x1875360098791424:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483338.322012:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+6:22767:x1875360098791424:12345-0@lo:501:mount.lustre.0 Request processed in 105us (1343us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788483338.322019:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788483338.322321:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098791424:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788483338.322354:0:22767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788483338.322373:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27400/0x1d7ea3d89ea1beeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bef2 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483338.322389:0:22767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27400/0x1d7ea3d89ea1beeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bef2 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483338.322398:0:22767:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a68c4d04800 10000000:01000000:2.0:1788483338.322403:0:22767:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788483338.322407:0:22767:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a68c4d04800 10000000:01000000:2.0:1788483338.322409:0:22767:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788483338.322420:0:22767:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9a68c4d04800 from 1 10000000:01000000:2.0:1788483338.322423:0:22767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788483338.322447:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26200/0x1d7ea3d89ea1bef9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483338.322454:0:22767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26200/0x1d7ea3d89ea1bef9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483338.322464:0:22767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26200/0x1d7ea3d89ea1bef9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483338.322479:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098791552:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788483338.322526:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483338.322557:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c6940000 going to sleep for 11 seconds 00000100:00100000:1.0:1788483338.322670:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098791552 00000100:00100000:1.0:1788483338.322675:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098791552 00000100:00100000:1.0:1788483338.322705:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788483338.322712:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+6:22767:x1875360098791552:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483338.322720:0:22782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483338.322733:0:22782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69edb8ae00/0x1d7ea3d89ea1bf00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1bef9 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483338.322756:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69edb8ae00/0x1d7ea3d89ea1bf00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bef9 expref: 7 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483338.322764:0:22782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69edb8ae00/0x1d7ea3d89ea1bf00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bef9 expref: 7 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483338.322771:0:22782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8ae00, rc 0) 00000100:00100000:1.0:1788483338.322809:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+7:22767:x1875360098791552:12345-0@lo:101:mount.lustre.0 Request processed in 98us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483338.322815:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788483338.322945:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098791552:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483338.322957:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26200/0x1d7ea3d89ea1bef9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bf00 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483338.322965:0:22767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26200/0x1d7ea3d89ea1bef9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1bf00 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483338.322976:0:22767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788483338.322980:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26200/0x1d7ea3d89ea1bef9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bf00 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483338.322986:0:22767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26200/0x1d7ea3d89ea1bef9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bf00 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483338.322992:0:22767:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788483338.323002:0:22767:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788483338.323007:0:22767:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a68c4d04800 10000000:01000000:3.0:1788483338.323010:0:22767:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788483338.323014:0:22767:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788483338.323016:0:22767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788483338.323032:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1800/0x1d7ea3d89ea1bf07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483338.323039:0:22767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1800/0x1d7ea3d89ea1bf07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483338.323047:0:22767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1800/0x1d7ea3d89ea1bf07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483338.323058:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098791680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788483338.323083:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483338.323155:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed85f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788483338.323297:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098791680 00000100:00100000:1.0:1788483338.323302:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098791680 00000100:00100000:1.0:1788483338.323334:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788483338.323341:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+7:22767:x1875360098791680:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483338.323348:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483338.323357:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69edb8aa00/0x1d7ea3d89ea1bf0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1bf07 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483338.323371:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69edb8aa00/0x1d7ea3d89ea1bf0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bf07 expref: 8 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483338.323391:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69edb8aa00/0x1d7ea3d89ea1bf0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bf07 expref: 8 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483338.323400:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8aa00, rc 0) 00000100:00100000:1.0:1788483338.323446:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+8:22767:x1875360098791680:12345-0@lo:101:mount.lustre.0 Request processed in 106us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483338.323453:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788483338.323654:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098791680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483338.323665:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1800/0x1d7ea3d89ea1bf07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bf0e expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483338.323672:0:22767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1800/0x1d7ea3d89ea1bf07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1bf0e expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483338.323725:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098791808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483338.323752:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483338.323775:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed85f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788483338.323846:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098791808 00000100:00100000:2.0:1788483338.323851:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098791808 00000100:00100000:2.0:1788483338.323883:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788483338.323890:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ca988050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+8:22767:x1875360098791808:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483338.324014:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ca988050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+9:22767:x1875360098791808:12345-0@lo:501:mount.lustre.0 Request processed in 124us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483338.324022:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788483338.324236:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098791808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483338.324273:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098791936:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788483338.324313:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483338.324339:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed85f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788483338.324461:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098791936 00000100:00100000:2.0:1788483338.324466:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098791936 00000100:00100000:2.0:1788483338.324542:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788483338.324550:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d463fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+9:22767:x1875360098791936:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788483338.330529:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d463fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+9:22767:x1875360098791936:12345-0@lo:503:mount.lustre.0 Request processed in 5973us (6208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483338.330542:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788483338.330629:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098791936:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788483338.330825:0:22806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22806:1875360098792064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788483338.330874:0:22806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483338.339317:0:22806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed85f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483338.344043:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098792064 00000100:00100000:0.0:1788483338.344057:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098792064 00000100:00100000:0.0:1788483338.347086:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788483338.347134:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d463d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+9:22806:x1875360098792064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788483338.348583:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d463d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+9:22806:x1875360098792064:12345-0@lo:502:llog_process_th.0 Request processed in 1456us (17704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483338.348593:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788483338.355769:0:22806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22806:1875360098792064:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788483338.357040:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483338.357058:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483338.357061:0:22806:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788483338.357068:0:22806:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788483338.357072:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788483338.357087:0:22806:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9a69d04619b8) 00000020:00000080:3.0:1788483338.357117:0:22806:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788483338.357123:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788483338.357198:0:22806:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788483338.357205:0:22806:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d7ea3d89ea1bf1c 00000020:00000080:3.0:1788483338.357661:0:22806:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788483338.357666:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483338.357670:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483338.357672:0:22806:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788483338.357674:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483338.357677:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483338.357679:0:22806:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788483338.357682:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788483338.357689:0:22806:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9a69d0460000) 00000020:00000080:3.0:1788483338.357700:0:22806:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788483338.357716:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788483338.357718:0:22806:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788483338.357720:0:22806:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788483338.357727:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788483338.357784:0:22806:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a68c4d04800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788483338.357797:0:22806:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9a69d0464d28) 00000020:00000080:3.0:1788483338.357805:0:22806:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788483338.358540:0:22806:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788483338.358550:0:22806:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d7ea3d89ea1bf31 00000020:00000080:3.0:1788483338.358661:0:22806:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788483338.358668:0:22806:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788483338.358673:0:22806:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1d7ea3d89ea1bf38 00080000:01000000:3.0:1788483338.358679:0:22806:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788483338.358683:0:22806:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d7ea3d89ea1bf3f 00010000:00010000:1.0:1788483338.428623:0:22806:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788483338.429123:0:22806:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934627 00000001:00080000:1.0:1788483338.429446:0:22806:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788483338.429998:0:22806:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9a69e009cd28) 00000020:00000080:1.0:1788483338.430017:0:22806:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788483338.430138:0:22806:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788483338.430147:0:22806:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d7ea3d89ea1bf4d 00000020:00000080:1.0:1788483338.430658:0:22806:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788483338.434642:0:22806:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1d7ea3d89ea1bf54 00000020:00000080:1.0:1788483338.435899:0:22806:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788483338.435910:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788483338.435917:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483338.435919:0:22806:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788483338.435922:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788483338.435925:0:22806:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1788483338.435926:0:22806:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788483338.435927:0:22806:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788483338.435929:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788483338.435931:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483338.435932:0:22806:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788483338.435934:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788483338.435939:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483338.435940:0:22806:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788483338.435944:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788483338.435982:0:22806:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788483338.435997:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788483338.436001:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483338.436002:0:22806:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788483338.436005:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788483338.436009:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483338.436010:0:22806:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788483338.436013:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788483338.436017:0:22806:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.154@tcp to nid 0x20000c0a8ce9a (192.168.206.154@tcp) 00000020:00000080:1.0:1788483338.436049:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788483338.436062:0:22806:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9a69e0098000) 00000020:00000080:1.0:1788483338.436074:0:22806:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788483338.436079:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788483338.436152:0:22806:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788483338.436157:0:22806:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788483338.436163:0:22806:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d7ea3d89ea1bf62 00010000:00080000:1.0:1788483338.436192:0:22806:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a69d25dd000@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.154@tcp at head 00010000:00010000:1.0:1788483338.437758:0:22806:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1788483338.443965:0:22806:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788483338.443979:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788483338.444035:0:22806:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788483338.444055:0:22806:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d7ea3d89ea1bf69 00000100:00080000:1.0:1788483338.444066:0:22806:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788483338.444072:0:22806:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a69d25dd000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788483338.444308:0:22806:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69efe9e300 x1875360098792192/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788483338.444368:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098792192:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788483338.444456:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483338.444608:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098792192 00000100:00100000:3.0:1788483338.444616:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098792192 00000100:00100000:3.0:1788483338.444645:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788483338.444652:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1875360098792192:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788483338.444666:0:22793:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1788483338.447585:0:22806:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788483338.447692:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788483338.447699:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483338.447701:0:22806:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788483338.447705:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788483338.447708:0:22806:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1788483338.447709:0:22806:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788483338.447711:0:22806:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788483338.447712:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788483338.447715:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483338.447716:0:22806:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788483338.447718:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788483338.447723:0:22806:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788483338.447726:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483338.447739:0:22806:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788483338.447743:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788483338.447747:0:22806:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.154@tcp to nid 0x20000c0a8ce9a (192.168.206.154@tcp) 00000020:01000000:1.0:1788483338.447771:0:22806:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788483338.447774:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788483338.447788:0:22806:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a69e009b370) 00000020:00000080:1.0:1788483338.447804:0:22806:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788483338.447809:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788483338.448136:0:22806:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788483338.448143:0:22806:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788483338.448150:0:22806:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d7ea3d89ea1bf77 00010000:00080000:1.0:1788483338.448178:0:22806:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a68c27c2000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.154@tcp at head 00010000:00010000:1.0:1788483338.448398:0:22806:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788483338.449435:0:22806:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788483338.449657:0:22806:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788483338.451164:0:22806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788483338.451340:0:22806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1788483338.458603:0:22806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1788483338.462319:0:22812:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788483338.462328:0:22812:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1788483338.462725:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1875360098792192:12345-0@lo:38:llog_process_th.0 Request processed in 18067us (18264us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788483338.462738:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788483338.462887:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69d25dd000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788483338.462893:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788483338.462897:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098792192:0@lo:38:llog_process_th.0 00000020:00000080:1.0:1788483338.464022:0:22806:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788483338.464035:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788483338.464074:0:22806:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788483338.464218:0:22806:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d7ea3d89ea1bf7e 00000100:00080000:1.0:1788483338.464228:0:22806:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788483338.464233:0:22806:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a68c27c2000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788483338.464267:0:22806:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69efe9f100 x1875360098792320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788483338.464318:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098792320:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788483338.464366:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875360098792320 offset 0 length 520: 4 00000100:00080000:1.0:1788483338.464491:0:22806:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788483338.464543:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788483338.464548:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483338.464549:0:22806:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788483338.464562:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788483338.464565:0:22806:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1788483338.464567:0:22806:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788483338.464568:0:22806:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788483338.464570:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788483338.464572:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483338.464574:0:22806:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788483338.464576:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788483338.464580:0:22806:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788483338.464583:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483338.464585:0:22806:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788483338.464587:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788483338.464591:0:22806:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.154@tcp to nid 0x20000c0a8ce9a (192.168.206.154@tcp) 00000020:01000000:1.0:1788483338.464613:0:22806:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788483338.464615:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788483338.464627:0:22806:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a69df0b19b8) 00000020:00000080:1.0:1788483338.464644:0:22806:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788483338.464650:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788483338.464715:0:22806:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788483338.464720:0:22806:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788483338.464727:0:22806:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d7ea3d89ea1bf8c 00010000:00080000:1.0:1788483338.464753:0:22806:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a69f8ab9000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.154@tcp at head 00010000:00010000:1.0:1788483338.464953:0:22806:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788483338.465016:0:22806:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788483338.465030:0:22806:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788483338.466575:0:22806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788483338.466772:0:22806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788483338.466962:0:22806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:0.0:1788483338.467612:0:22814:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788483338.467617:0:22814:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788483338.468631:0:22806:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788483338.468644:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788483338.468681:0:22806:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788483338.468698:0:22806:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d7ea3d89ea1bf93 00000100:00080000:1.0:1788483338.468707:0:22806:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788483338.468719:0:22806:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a69f8ab9000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788483338.468750:0:22806:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69efe9c700 x1875360098792448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788483338.468815:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098792448:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788483338.468933:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875360098792448 offset 0 length 520: 4 00000100:00080000:1.0:1788483338.468994:0:22806:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788483338.469051:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788483338.469055:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483338.469057:0:22806:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788483338.469060:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788483338.469063:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483338.469065:0:22806:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788483338.469068:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788483338.469069:0:22806:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788483338.469071:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788483338.469074:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483338.469075:0:22806:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788483338.469077:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788483338.469079:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483338.469081:0:22806:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788483338.469084:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788483338.469135:0:22806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22806:1875360098792576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788483338.469185:0:22806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483338.469205:0:22806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d2f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788483338.469316:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098792576 00000100:00100000:0.0:1788483338.469323:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098792576 00000100:00100000:0.0:1788483338.469373:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788483338.469397:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d463f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+9:22806:x1875360098792576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788483338.469521:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d463f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+9:22806:x1875360098792576:12345-0@lo:502:llog_process_th.0 Request processed in 126us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483338.469530:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788483338.469617:0:22806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22806:1875360098792576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788483338.469643:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483338.469647:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483338.469649:0:22806:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788483338.469654:0:22806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788483338.469700:0:22767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788483338.469721:0:22767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788483338.469742:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1800/0x1d7ea3d89ea1bf07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bf0e expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483338.469758:0:22767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1800/0x1d7ea3d89ea1bf07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bf0e expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483338.469766:0:22767:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a68c4d04800 from 1 10000000:01000000:3.0:1788483338.469769:0:22767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788483338.469793:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1a00/0x1d7ea3d89ea1bf9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483338.469801:0:22767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1a00/0x1d7ea3d89ea1bf9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483338.469809:0:22767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1a00/0x1d7ea3d89ea1bf9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483338.469823:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098792704:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788483338.469865:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483338.469885:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed85fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788483338.470180:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098792704 00000100:00100000:1.0:1788483338.470186:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098792704 00000100:00100000:1.0:1788483338.470217:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788483338.470224:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c998f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+9:22767:x1875360098792704:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483338.470233:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483338.470247:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69edb8a600/0x1d7ea3d89ea1bfa1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1bf9a expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483338.470277:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69edb8a600/0x1d7ea3d89ea1bfa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bf9a expref: 10 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483338.470287:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69edb8a600/0x1d7ea3d89ea1bfa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bf9a expref: 10 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483338.470296:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8a600, rc 0) 00000100:00100000:1.0:1788483338.470335:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c998f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+10:22767:x1875360098792704:12345-0@lo:101:mount.lustre.0 Request processed in 111us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483338.470341:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788483338.470419:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098792704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483338.470431:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1a00/0x1d7ea3d89ea1bf9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bfa1 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483338.470440:0:22767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1a00/0x1d7ea3d89ea1bf9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1bfa1 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483338.471077:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098792832:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788483338.471146:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483338.471173:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed85fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788483338.471281:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098792832 00000100:00100000:0.0:1788483338.471287:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098792832 00000100:00100000:0.0:1788483338.471311:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788483338.471317:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+10:22767:x1875360098792832:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788483338.471332:0:22782:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788483338.471338:0:22782:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788483338.471429:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+10:22767:x1875360098792832:12345-0@lo:256:mount.lustre.0 Request processed in 111us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483338.471437:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788483338.471596:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098792832:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788483338.472255:0:22767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788483338.472272:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1a00/0x1d7ea3d89ea1bf9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bfa1 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483338.472282:0:22767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1a00/0x1d7ea3d89ea1bf9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bfa1 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483338.472290:0:22767:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a68c4d04800 from 1 10000000:01000000:3.0:1788483338.472292:0:22767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788483338.472317:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1bfa8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483338.472325:0:22767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1bfa8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483338.472333:0:22767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1bfa8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483338.472348:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098792960:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788483338.472572:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483338.472631:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed85fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788483338.472801:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098792960 00000100:00100000:0.0:1788483338.472808:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098792960 00000100:00100000:0.0:1788483338.472941:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788483338.472950:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+10:22767:x1875360098792960:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788483338.472960:0:22782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483338.472973:0:22782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69d0400600/0x1d7ea3d89ea1bfaf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1bfa8 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483338.472993:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69d0400600/0x1d7ea3d89ea1bfaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bfa8 expref: 11 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483338.473003:0:22782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69d0400600/0x1d7ea3d89ea1bfaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bfa8 expref: 11 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483338.473011:0:22782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69d0400600, rc 0) 00000100:00100000:0.0:1788483338.473063:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+11:22767:x1875360098792960:12345-0@lo:101:mount.lustre.0 Request processed in 115us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483338.473070:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788483338.473324:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098792960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483338.473339:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1bfa8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bfaf expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483338.473348:0:22767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1bfa8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1bfaf expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483338.473441:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098793088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483338.473468:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483338.473710:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed85fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788483338.473772:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098793088 00000100:00100000:1.0:1788483338.473778:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098793088 00000100:00100000:1.0:1788483338.473801:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788483338.473807:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+11:22767:x1875360098793088:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483338.473988:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+11:22767:x1875360098793088:12345-0@lo:501:mount.lustre.0 Request processed in 180us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483338.473995:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788483338.474180:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098793088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483338.474211:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098793216:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788483338.474250:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483338.474266:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed85fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788483338.474329:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098793216 00000100:00100000:1.0:1788483338.474333:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098793216 00000100:00100000:1.0:1788483338.474351:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788483338.474357:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+11:22767:x1875360098793216:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788483338.474547:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+11:22767:x1875360098793216:12345-0@lo:503:mount.lustre.0 Request processed in 189us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483338.474553:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788483338.474621:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098793216:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788483338.475246:0:22816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22816:1875360098793344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788483338.475283:0:22816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483338.475341:0:22816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e0135b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788483338.475377:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098793344 00000100:00100000:1.0:1788483338.475450:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098793344 00000100:00100000:1.0:1788483338.475522:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788483338.475530:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+11:22816:x1875360098793344:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788483338.476000:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+11:22816:x1875360098793344:12345-0@lo:502:llog_process_th.0 Request processed in 469us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483338.476008:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788483338.476082:0:22816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22816:1875360098793344:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788483338.476129:0:22816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788483338.476137:0:22816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483338.476140:0:22816:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788483338.476147:0:22816:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a68c4d04800 00000020:00000080:0.0:1788483338.476150:0:22816:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788483338.476159:0:22816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788483338.476162:0:22816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483338.476163:0:22816:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788483338.476166:0:22816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788483338.476168:0:22816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483338.476169:0:22816:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788483338.476173:0:22816:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a68c4d04800 00000020:00000080:0.0:1788483338.476175:0:22816:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788483338.476227:0:22816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788483338.476230:0:22816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483338.476232:0:22816:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788483338.476234:0:22816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788483338.476236:0:22816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483338.476237:0:22816:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788483338.476241:0:22816:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a68c4d04800 00000020:00000080:0.0:1788483338.476243:0:22816:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788483338.476259:0:22816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788483338.476262:0:22816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483338.476264:0:22816:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788483338.476273:0:22816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788483338.476276:0:22816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483338.476277:0:22816:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788483338.476281:0:22816:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a68c4d04800 00000020:00000080:0.0:1788483338.476283:0:22816:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788483338.476319:0:22816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22816:1875360098793472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788483338.476351:0:22816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483338.479000:0:22816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e0135b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788483338.480213:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098793472 00000100:00100000:2.0:1788483338.480224:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098793472 00000100:00100000:2.0:1788483338.480276:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788483338.480285:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+11:22816:x1875360098793472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788483338.480521:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+11:22816:x1875360098793472:12345-0@lo:502:llog_process_th.0 Request processed in 236us (4168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483338.480529:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788483338.480631:0:22816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22816:1875360098793472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788483338.480667:0:22816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483338.480675:0:22816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483338.480677:0:22816:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788483338.480683:0:22816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788483338.480927:0:22767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788483338.480955:0:22767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788483338.481012:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1bfa8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bfaf expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483338.481025:0:22767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1bfa8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bfaf expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483338.481074:0:22767:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788483338.481077:0:22767:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a68c4d04800 10000000:01000000:2.0:1788483338.481079:0:22767:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a68c4d04800 10000000:01000000:2.0:1788483338.481084:0:22767:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788483338.481089:0:22767:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a68c4d04800 from 1 10000000:01000000:2.0:1788483338.481092:0:22767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788483338.481150:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27200/0x1d7ea3d89ea1bfb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483338.481159:0:22767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27200/0x1d7ea3d89ea1bfb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483338.481169:0:22767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27200/0x1d7ea3d89ea1bfb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483338.481199:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098793600:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788483338.481262:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483338.481296:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788483338.481314:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098793600 00000100:00100000:2.0:1788483338.481318:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098793600 00000100:00100000:2.0:1788483338.481349:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788483338.481358:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+11:22767:x1875360098793600:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788483338.481367:0:22783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483338.481644:0:22783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecf27600/0x1d7ea3d89ea1bfbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1bfb6 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483338.481667:0:22783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecf27600/0x1d7ea3d89ea1bfbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bfb6 expref: 12 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483338.481676:0:22783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecf27600/0x1d7ea3d89ea1bfbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bfb6 expref: 12 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483338.481684:0:22783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf27600, rc 0) 00000100:00100000:2.0:1788483338.481717:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:22767:x1875360098793600:12345-0@lo:101:mount.lustre.0 Request processed in 361us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483338.481723:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788483338.481761:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098793600:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788483338.481772:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27200/0x1d7ea3d89ea1bfb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bfbd expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483338.481781:0:22767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27200/0x1d7ea3d89ea1bfb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1bfbd expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483338.481913:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098793728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483338.481939:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483338.481952:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788483338.481965:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098793728 00000100:00100000:2.0:1788483338.481968:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098793728 00000100:00100000:2.0:1788483338.481991:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788483338.481998:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:22767:x1875360098793728:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483338.482119:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:22767:x1875360098793728:12345-0@lo:501:mount.lustre.0 Request processed in 99us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483338.482125:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788483338.482158:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098793728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483338.482182:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098793856:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788483338.482217:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483338.482231:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788483338.482243:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098793856 00000100:00100000:2.0:1788483338.482247:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098793856 00000100:00100000:2.0:1788483338.482269:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788483338.482275:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:22767:x1875360098793856:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788483338.482350:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:22767:x1875360098793856:12345-0@lo:503:mount.lustre.0 Request processed in 74us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483338.482355:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788483338.482474:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098793856:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788483338.482762:0:22819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22819:1875360098793984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788483338.482802:0:22819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483338.482824:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098793984 00000100:00100000:2.0:1788483338.482828:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098793984 00000100:00100000:2.0:1788483338.482933:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788483338.482942:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:22819:x1875360098793984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788483338.483030:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:22819:x1875360098793984:12345-0@lo:502:llog_process_th.0 Request processed in 90us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483338.483037:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788483338.483080:0:22819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788483338.483113:0:22819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22819:1875360098793984:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788483338.483165:0:22819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788483338.483180:0:22819:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9a69c76d4d28) 00000020:00000080:2.0:1788483338.483197:0:22819:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788483338.483283:0:22819:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a68c4d04800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788483338.483288:0:22819:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a68c4d04800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788483338.483291:0:22819:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a68c4d04800 4 00010000:00080000:2.0:1788483338.483330:0:22819:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a68c331b800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.154@tcp at head 00010000:00010000:2.0:1788483338.486197:0:22819:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1788483338.486927:0:22819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788483338.486970:0:22819:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788483338.486982:0:22819:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1d7ea3d89ea1bfcb 00000100:00080000:2.0:1788483338.486991:0:22819:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788483338.486997:0:22819:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a68c331b800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:2.0:1788483338.487029:0:22819:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69ffefa680 x1875360098794112/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788483338.487118:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875360098794112:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788483338.487189:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483338.487229:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098794112 00000100:00100000:1.0:1788483338.487237:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098794112 00000100:00100000:1.0:1788483338.487271:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788483338.487279:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098794112:12345-0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788483338.487368:0:22819:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788483338.488681:0:22819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22819:1875360098794240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788483338.488746:0:22819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483338.488770:0:22819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788483338.493170:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098794112:12345-0@lo:38:llog_process_th.0 Request processed in 5881us (5971us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788483338.493185:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788483338.493221:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098794240 00000100:00100000:1.0:1788483338.493229:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098794240 00000100:00100000:1.0:1788483338.493267:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788483338.493276:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:22819:x1875360098794240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788483338.493484:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:22819:x1875360098794240:12345-0@lo:502:llog_process_th.0 Request processed in 208us (4737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483338.493493:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788483338.493672:0:22819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22819:1875360098794240:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788483338.493737:0:22819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22819:1875360098794368:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788483338.493780:0:22819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483338.493809:0:22819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c2bc1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483338.493825:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098794368 00000100:00100000:1.0:1788483338.493829:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098794368 00000100:00100000:1.0:1788483338.493851:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788483338.493864:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:22819:x1875360098794368:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788483338.493924:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:22819:x1875360098794368:12345-0@lo:502:llog_process_th.0 Request processed in 60us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483338.493930:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788483338.493966:0:22819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22819:1875360098794368:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788483338.493984:0:22819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788483338.494940:0:22767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788483338.494972:0:22767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788483338.494993:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27200/0x1d7ea3d89ea1bfb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bfbd expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483338.495004:0:22767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27200/0x1d7ea3d89ea1bfb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bfbd expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788483338.495054:0:22767:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788483338.495056:0:22767:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788483338.495057:0:22767:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788483338.495058:0:22767:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788483338.495059:0:22767:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788483338.495061:0:22767:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788483338.495062:0:22767:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788483338.495064:0:22767:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788483338.495065:0:22767:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788483338.495067:0:22767:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788483338.495070:0:22767:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788483338.495072:0:22767:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788483338.495074:0:22767:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788483338.495075:0:22767:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788483338.495076:0:22767:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788483338.495077:0:22767:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788483338.495078:0:22767:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788483338.495079:0:22767:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788483338.495081:0:22767:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788483338.495082:0:22767:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788483338.495083:0:22767:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788483338.495117:0:22767:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788483338.495131:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffef8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098794496:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788483338.495179:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483338.495210:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098794496 00000100:00100000:1.0:1788483338.495217:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098794496 00000100:00100000:2.0:1788483338.495219:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483338.495255:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788483338.495263:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:22767:x1875360098794496:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788483338.495285:0:22783:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788483338.495298:0:22783:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788483338.495657:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788483338.495666:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c331b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483338.495670:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788483338.495674:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875360098794112:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1788483338.497718:0:22783:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788483338.499572:0:22783:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788483338.499778:0:22804:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788483338.499784:0:22804:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788483338.499806:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1bfd2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483338.499825:0:22804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69edb8a600/0x1d7ea3d89ea1bfa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bf9a expref: 12 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483338.500020:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:22767:x1875360098794496:12345-0@lo:253:mount.lustre.0 Request processed in 4755us (4837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483338.500030:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788483338.500090:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffef8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22767:1875360098794496:0@lo:253:mount.lustre.0 00010000:00010000:2.0:1788483338.500214:0:22804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1bfd2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483338.500250:0:22804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69edb8a600/0x1d7ea3d89ea1bfa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1bf9a expref: 11 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483338.500264:0:22804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69edb8a600/0x1d7ea3d89ea1bfa1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1bf9a expref: 11 pid: 22780 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483338.500277:0:22804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefa680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875360098794624:0@lo:104: 00000100:00100000:2.0:1788483338.500308:0:22804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483338.500341:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483338.500369:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098794624 10000000:01000000:1.0:1788483338.500549:0:22767:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788483338.500553:0:22767:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788483338.500554:0:22767:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788483338.500555:0:22767:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788483338.500557:0:22767:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788483338.500558:0:22767:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788483338.500559:0:22767:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788483338.500560:0:22767:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788483338.500562:0:22767:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788483338.500564:0:22767:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788483338.500565:0:22767:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788483338.500586:0:22767:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788483338.501591:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098794624 00000100:00100000:3.0:1788483338.501655:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788483338.501666:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffefa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+3:22804:x1875360098794624:12345-0@lo:104: 00010000:00010000:3.0:1788483338.501682:0:22771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1a00/0x1d7ea3d89ea1bf9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1bfa1 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483338.501761:0:22771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788483338.501767:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffefa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+3:22804:x1875360098794624:12345-0@lo:104: Request processed in 104us (1458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483338.501774:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788483338.501805:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483338.501811:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1a00/0x1d7ea3d89ea1bf9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1bfa1 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483338.501818:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1a00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788483338.501822:0:22777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1a00/0x1d7ea3d89ea1bf9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1bfa1 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483338.501830:0:22777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1a00/0x1d7ea3d89ea1bf9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1bfa1 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483338.501832:0:22804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefa680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875360098794624:0@lo:104: 00010000:00010000:3.0:1788483338.501850:0:22804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1bfd2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788483338.501916:0:22777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1a00/0x1d7ea3d89ea1bf9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1bfa1 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483338.501922:0:22777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788483338.501963:0:22777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1a00/0x1d7ea3d89ea1bf9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1bfa1 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483338.501970:0:22777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788483338.501989:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1a00/0x1d7ea3d89ea1bf9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1bfa1 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483338.501995:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1a00/0x1d7ea3d89ea1bf9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1bfa1 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483338.502011:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483338.502013:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483338.502015:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483338.502047:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3620:1875360098794752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788483338.502080:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483338.502150:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098794752 00000100:00100000:0.0:1788483338.502154:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098794752 00010000:00010000:0.0:1788483338.502171:0:22773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69edb8a600/0x1d7ea3d89ea1bfa1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1bf9a expref: 12 pid: 22780 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483338.502190:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788483338.502196:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:3620:x1875360098794752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788483338.502205:0:22773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483338.502210:0:22773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69edb8a600/0x1d7ea3d89ea1bfa1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1bf9a expref: 12 pid: 22780 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483338.502219:0:22773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69edb8a600/0x1d7ea3d89ea1bfa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1bf9a expref: 12 pid: 22780 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483338.502231:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69edb8a600/0x1d7ea3d89ea1bfa1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1bf9a expref: 12 pid: 22780 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483338.502251:0:22773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1bfd2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483338.502259:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1bfd2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788483338.502271:0:22773:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002488290s 00010000:00010000:0.0:1788483338.502274:0:22773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1bfd2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483338.502281:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1bfd2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483338.502287:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1bfd2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483338.502292:0:22773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1bfd2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483338.502298:0:22773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26e00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483338.502301:0:22773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1bfd2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483338.502308:0:22773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1bfd2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483338.502320:0:22773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1bfd2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483338.502328:0:22773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483338.502362:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+11:3620:x1875360098794752:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483338.502368:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788483338.502616:0:22804:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1bfd2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483338.502624:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1bfd2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483338.502630:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ecf26e00/0x1d7ea3d89ea1bfd2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483338.504976:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3620:1875360098794752:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788483338.514276:0:22767:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:1.0:1788483338.514952:0:22767:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788483338.515131:0:22827:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:0.0:1788483338.515136:0:22827:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:0.0:1788483338.519976:0:22828:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1788483338.520543:0:22828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788483338.522785:0:22767:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:2.0:1788483338.523797:0:22830:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9a69ffefbb80 x1875360098794880/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483338.523809:0:22830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e840 going to sleep for 0 seconds 00000040:00080000:0.0:1788483338.526084:0:22828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788483338.526163:0:22828:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1788483338.527150:0:22767:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788483338.527194:0:22767:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788483338.527653:0:22767:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788483338.527660:0:22767:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788483338.527693:0:22767:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788483338.528779:0:22767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788483338.530144:0:22767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788483338.530203:0:22767:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788483338.532724:0:22767:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1788483338.533245:0:22767:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:0.0:1788483338.539555:0:22767:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1788483338.543151:0:22767:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788483338.543199:0:22767:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb53840d87988 00100000:10000000:0.0:1788483338.543206:0:22767:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788483338.544817:0:22767:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788483338.544831:0:22767:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.154@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788483338.544861:0:22767:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788483338.544875:0:22767:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788483338.545661:0:22767:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788483338.545868:0:22767:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788483339.128222:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788483339.449141:0:22785:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788483339.449146:0:22785:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a68c4d04800 from 11 10000000:01000000:3.0:1788483339.449151:0:22785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788483339.449192:0:22785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1bfd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483339.449203:0:22785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1bfd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483339.449214:0:22785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1bfd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483339.449238:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098795008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788483339.449296:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483339.449345:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed85f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483339.449948:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098795008 00000100:00100000:1.0:1788483339.449957:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098795008 00000100:00100000:1.0:1788483339.450005:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788483339.450014:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+11:22785:x1875360098795008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788483339.450028:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483339.450044:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1bfe0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1bfd9 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483339.450067:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1bfe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bfd9 expref: 12 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483339.450078:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1bfe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bfd9 expref: 12 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483339.450087:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8a400, rc 0) 00000100:00100000:1.0:1788483339.450160:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:22785:x1875360098795008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483339.450177:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788483339.450243:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098795008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788483339.453212:0:22785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1bfd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bfe0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483339.453470:0:22785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1bfd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1bfe0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483339.454775:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098795136:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788483339.454843:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483339.454883:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69df3779c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483339.455448:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098795136 00000100:00100000:1.0:1788483339.455459:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098795136 00000100:00100000:0.0:1788483339.455539:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788483339.455549:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:22785:x1875360098795136:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788483339.455581:0:22783:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788483339.455599:0:22783:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788483339.455607:0:22783:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1788483339.455700:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:22785:x1875360098795136:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 151us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483339.455709:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788483339.455730:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098795136:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788483339.455778:0:22785:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788483339.455786:0:22785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1bfd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bfe0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483339.455796:0:22785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1bfd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bfe0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788483339.514186:0:22826:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788483339.514196:0:22826:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788483339.515440:0:22826:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788483339.515450:0:22826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788483339.577383:0:22830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e840 going to sleep for 0 seconds 00010000:00010000:0.0:1788483340.158787:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788483340.548128:0:22826:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788483340.548137:0:22826:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788483340.548250:0:22826:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:2.0:1788483340.548713:0:22826:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788483340.548844:0:22826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1788483340.603302:0:22830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e840 going to sleep for 0 seconds 00010000:00010000:1.0:1788483341.179758:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483341.625190:0:22830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e840 going to sleep for 0 seconds 00010000:00010000:0.0:1788483342.200316:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483342.649064:0:22830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e840 going to sleep for 0 seconds 00000001:02000400:3.0:1788483343.223462:0:23072:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg654-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788483343.224265:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788483343.610072:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788483343.610078:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788483343.610082:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a69d25dd000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483343.610090:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 630 00000100:00080000:0.0:1788483343.610120:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788483343.610127:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a69d25dd000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483343.610150:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69d0f23100 x1875360098795392/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788483343.610172:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483343.610176:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483343.610207:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1788483343.610210:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098795392:0@lo:38:kworker.0 00000100:00080000:0.0:1788483343.610210:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483343.610213:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788483343.610216:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788483343.610217:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a68c331b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483343.610222:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a68c331b800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483343.610246:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69d0f22680 x1875360098795520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788483343.610290:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788483343.610294:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483343.610298:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3622:1875360098795264:0@lo:400:kworker.0 00000100:00100000:0.0:1788483343.610342:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483343.610343:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875360098795520:0@lo:38:kworker.0 00000100:00100000:0.0:1788483343.610432:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098795392 00000100:00100000:0.0:1788483343.610439:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098795392 00000100:00100000:0.0:1788483343.610474:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788483343.610481:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1875360098795392:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788483343.610498:0:22794:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788483343.610750:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483343.610772:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1875360098795392:12345-0@lo:38:kworker.0 Request processed in 290us (476us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788483343.610779:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788483343.610785:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69d25dd000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788483343.610790:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788483343.610793:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098795392:0@lo:38:kworker.0 00000100:00100000:0.0:1788483343.610804:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098795264 00000100:00100000:0.0:1788483343.610808:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098795264 00000100:00100000:0.0:1788483343.610832:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788483343.610839:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:3622:x1875360098795264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483343.610893:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:3622:x1875360098795264:12345-0@lo:400:kworker.0 Request processed in 53us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483343.610900:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788483343.610938:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3622:1875360098795264:0@lo:400:kworker.0 00000100:00100000:0.0:1788483343.610982:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098795520 00000100:00100000:0.0:1788483343.610986:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098795520 00000100:00100000:0.0:1788483343.611015:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788483343.611019:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3618:x1875360098795520:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788483343.611035:0:22790:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 635 last 0 00000020:00000080:0.0:1788483343.611073:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1d7ea3d89ea1bfe7 00000004:00100000:0.0:1788483343.611088:0:22790:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788483343.611238:0:22790:0:(import.c:65:import_set_state_nolock()) ffff9a68c3dba000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788483343.611285:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875360098795520:12345-0@lo:38:kworker.0 Request processed in 264us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483343.611292:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788483343.612351:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a69d0f22680 x1875360098795520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788483353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788483343.612367:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788483343.612374:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788483343.612378:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788483343.612381:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c331b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788483343.612407:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875360098795520:0@lo:38:kworker.0 00000100:00100000:2.0:1788483343.672526:0:22830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e840 going to sleep for 0 seconds 00000020:00000004:3.0:1788483344.148689:0:23125:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788483344.154066:0:23125:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788483344.249259:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483344.702287:0:22830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e840 going to sleep for 0 seconds 00000020:00000004:3.0:1788483345.005069:0:23175:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788483345.005610:0:23175:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788483345.274586:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483345.723325:0:22830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e840 going to sleep for 0 seconds 00010000:00010000:1.0:1788483346.298252:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483346.744961:0:22830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e840 going to sleep for 0 seconds 00010000:00010000:3.0:1788483347.321029:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483347.774978:0:22830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e840 going to sleep for 0 seconds 00010000:00010000:1.0:1788483348.344251:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483348.728199:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483338/real 1788483338] req@ffff9a69efe9c700 x1875360098792448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483348 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483348.728228:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a69efe9c700 x1875360098792448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483348 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483348.728239:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483338/real 1788483338] req@ffff9a69efe9f100 x1875360098792320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483348 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483348.728250:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a69efe9f100 x1875360098792320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483348 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788483348.728280:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69f8ab9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788483348.728301:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788483348.728305:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098792448:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788483348.728311:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c27c2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788483348.728316:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788483348.728318:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098792320:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788483348.728523:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788483348.728527:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788483348.728530:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a69d25dd000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788483348.728535:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 635 00000100:00080000:3.0:1788483348.728540:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788483348.728546:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a69d25dd000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:3.0:1788483348.728567:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69f5264e00 x1875360098795776/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788483348.728579:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788483348.728582:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788483348.728583:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a68c27c2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788483348.728586:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 630 00000100:00080000:3.0:1788483348.728589:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788483348.728592:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a68c27c2000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:3.0:1788483348.728602:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69f5266680 x1875360098795904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788483348.728609:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788483348.728612:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788483348.728613:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a69f8ab9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788483348.728616:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 630 00000100:00080000:3.0:1788483348.728618:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788483348.728621:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a69f8ab9000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:3.0:1788483348.728639:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69f5266300 x1875360098796032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788483348.728794:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788483348.728807:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3621:1875360098795648:0@lo:400:kworker.0 00000100:00100000:2.0:1788483348.728864:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483348.728921:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098796160:0@lo:400:kworker.0 00000100:00100000:2.0:1788483348.728952:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483348.728987:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098796160 00000100:00100000:2.0:1788483348.728994:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098796160 00000100:00100000:2.0:1788483348.729033:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788483348.729041:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffefaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098796160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483348.729088:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffefaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098796160:12345-0@lo:400:kworker.0 Request processed in 48us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483348.729117:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788483348.729151:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a69f5265500 x1875360098796160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483348.729175:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098796160:0@lo:400:kworker.0 00000100:00100000:1.0:1788483348.729282:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098795776:0@lo:38:kworker.0 00000100:00100000:1.0:1788483348.729312:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483348.729346:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098795904:0@lo:8:kworker.0 00000400:00000100:1.0:1788483348.729388:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875360098795904 offset 0 length 520: 4 00000100:00100000:1.0:1788483348.729406:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098796032:0@lo:8:kworker.0 00000400:00000100:1.0:1788483348.729426:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875360098796032 offset 0 length 520: 4 00000100:00100000:2.0:1788483348.729690:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098795776 00000100:00100000:2.0:1788483348.729696:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098795776 00000100:00100000:2.0:1788483348.729758:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788483348.729764:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1875360098795776:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788483348.729780:0:22794:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788483348.729821:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3618:x1875360098795776:12345-0@lo:38:kworker.0 Request processed in 55us (507us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788483348.729827:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788483348.729854:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69d25dd000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788483348.729859:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788483348.729862:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098795776:0@lo:38:kworker.0 00000100:00100000:3.0:1788483348.729951:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098795648 00000100:00100000:3.0:1788483348.729955:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098795648 00000100:00100000:3.0:1788483348.730001:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788483348.730008:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdabbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:3621:x1875360098795648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483348.730044:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdabbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:3621:x1875360098795648:12345-0@lo:400:kworker.0 Request processed in 37us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483348.730050:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788483348.730287:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3621:1875360098795648:0@lo:400:kworker.0 00000100:00100000:1.0:1788483348.797969:0:22830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e840 going to sleep for 0 seconds 00010000:00010000:3.0:1788483349.372972:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483349.816213:0:22830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e840 going to sleep for 0 seconds 00010000:00010000:1.0:1788483350.392576:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788483350.778014:0:22826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788483350.842443:0:22830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e840 going to sleep for 0 seconds 00010000:00010000:3.0:1788483351.423192:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483351.867465:0:22830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e840 going to sleep for 0 seconds 00000020:01000004:1.0:1788483351.969440:0:23521:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788483351.969444:0:23521:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788483351.969445:0:23521:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788483351.969577:0:23521:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a69efd92000 00000020:01000004:1.0:1788483351.969593:0:23521:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1788483351.969603:0:23521:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788483351.969616:0:23521:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9a69df0b0000) 00000020:00000080:1.0:1788483351.969631:0:23521:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788483352.068028:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1788483352.069459:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788483352.073714:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788483352.075544:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788483352.075884:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1788483352.076594:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1788483352.077425:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788483352.077755:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788483352.078243:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788483352.078517:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788483352.078817:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788483352.079369:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788483352.080718:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788483352.081088:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1788483352.088608:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1788483352.089508:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788483352.089784:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1788483352.091483:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788483352.091925:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788483352.092413:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1788483352.092693:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1788483352.094923:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788483352.095448:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788483352.095887:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1788483352.097444:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1788483352.099157:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788483352.099874:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788483352.100167:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788483352.100707:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788483352.102201:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788483352.102902:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788483352.103240:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788483352.103616:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788483352.103942:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1788483352.104418:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1788483352.104955:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788483352.105288:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1788483352.106088:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1788483352.119930:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788483352.120850:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788483352.121742:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788483352.122053:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788483352.123426:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788483352.124089:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788483352.124419:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788483352.124739:0:23521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00080000:01000000:3.0:1788483352.125526:0:23521:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788483352.126092:0:23521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788483352.126212:0:23521:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788483352.126223:0:23521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1d7ea3d89ea1bff5 00000020:01000004:3.0:1788483352.126230:0:23521:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788483352.126251:0:23521:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.154@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788483352.126254:0:23521:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788483352.126260:0:23521:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788483352.126286:0:23521:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788483352.126290:0:23521:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.154@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788483352.150968:0:23521:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788483352.151022:0:23521:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.154@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788483352.151027:0:23521:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788483352.151028:0:23521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788483352.151029:0:23521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788483352.151030:0:23521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788483352.151031:0:23521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788483352.151032:0:23521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788483352.151034:0:23521:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788483352.151035:0:23521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788483352.151036:0:23521:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788483352.151040:0:23521:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788483352.151042:0:23521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788483352.151043:0:23521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788483352.151044:0:23521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788483352.151045:0:23521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788483352.151046:0:23521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788483352.151047:0:23521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788483352.151048:0:23521:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788483352.151049:0:23521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788483352.151049:0:23521:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788483352.151088:0:23521:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788483352.151143:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5265c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098796288:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788483352.151222:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483352.151256:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd2300 going to sleep for 11 seconds 00000100:00100000:0.0:1788483352.151695:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098796288 00000100:00100000:0.0:1788483352.151703:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098796288 00000100:00100000:0.0:1788483352.151785:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788483352.151796:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdabb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:23521:x1875360098796288:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788483352.151848:0:22782:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788483352.151851:0:22782:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788483352.151857:0:22782:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788483352.153079:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdabb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:23521:x1875360098796288:12345-0@lo:253:mount.lustre.0 Request processed in 1280us (1851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483352.153091:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788483352.155536:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5265c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098796288:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788483352.155570:0:23521:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788483352.155573:0:23521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788483352.155575:0:23521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788483352.155576:0:23521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788483352.155577:0:23521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788483352.155578:0:23521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788483352.155579:0:23521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788483352.155580:0:23521:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788483352.155582:0:23521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788483352.155583:0:23521:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788483352.155613:0:23521:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a69efd92000 from lustre-MDT0001 10000000:01000000:1.0:1788483352.155648:0:23521:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788483352.155651:0:23521:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788483352.155659:0:23521:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a69e00999b8 local copy 00010000:00010000:1.0:1788483352.155668:0:23521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27400/0x1d7ea3d89ea1beeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bef2 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483352.155768:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098796416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483352.155821:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483352.155868:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d78c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788483352.156210:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098796416 00000100:00100000:2.0:1788483352.156218:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098796416 00000100:00100000:2.0:1788483352.156259:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788483352.156268:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdaba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:23521:x1875360098796416:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483352.156409:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdaba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:23521:x1875360098796416:12345-0@lo:501:mount.lustre.0 Request processed in 141us (586us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788483352.156417:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788483352.157382:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098796416:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788483352.157406:0:23521:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788483352.157437:0:23521:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788483352.157445:0:23521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27400/0x1d7ea3d89ea1beeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bef2 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483352.157456:0:23521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27400/0x1d7ea3d89ea1beeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bef2 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483352.157483:0:23521:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a69efd92000 10000000:01000000:1.0:1788483352.157500:0:23521:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788483352.157505:0:23521:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a69e00999b8 10000000:01000000:1.0:1788483352.157508:0:23521:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788483352.157511:0:23521:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9a69e00999b8 from 1 10000000:01000000:1.0:1788483352.157514:0:23521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788483352.157552:0:23521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b000/0x1d7ea3d89ea1bffc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483352.157561:0:23521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b000/0x1d7ea3d89ea1bffc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483352.157570:0:23521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b000/0x1d7ea3d89ea1bffc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483352.157721:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098796544:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788483352.157768:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483352.157802:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d78c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788483352.158025:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098796544 00000100:00100000:3.0:1788483352.158033:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098796544 00000100:00100000:3.0:1788483352.158079:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788483352.158088:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdabb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+12:23521:x1875360098796544:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483352.158122:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483352.158138:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecee1200/0x1d7ea3d89ea1c003 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1bffc expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483352.158158:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecee1200/0x1d7ea3d89ea1c003 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bffc expref: 13 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483352.158180:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecee1200/0x1d7ea3d89ea1c003 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bffc expref: 13 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483352.158190:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1200, rc 0) 00000100:00100000:3.0:1788483352.158232:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdabb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+13:23521:x1875360098796544:12345-0@lo:101:mount.lustre.0 Request processed in 146us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483352.158238:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788483352.158495:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098796544:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483352.158508:0:23521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b000/0x1d7ea3d89ea1bffc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c003 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483352.158516:0:23521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b000/0x1d7ea3d89ea1bffc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1c003 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483352.159068:0:23521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788483352.159085:0:23521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b000/0x1d7ea3d89ea1bffc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c003 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483352.159118:0:23521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b000/0x1d7ea3d89ea1bffc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c003 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483352.159143:0:23521:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a69efd92000 10000000:01000000:1.0:1788483352.159147:0:23521:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788483352.159151:0:23521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9a69efd92000 from 1 10000000:01000000:1.0:1788483352.159154:0:23521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788483352.159177:0:23521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1c00a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483352.159185:0:23521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1c00a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483352.159193:0:23521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1c00a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483352.159210:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098796672:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788483352.159246:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483352.159281:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d78c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788483352.160238:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098796672 00000100:00100000:0.0:1788483352.160247:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098796672 00000100:00100000:0.0:1788483352.160290:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788483352.160299:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+13:23521:x1875360098796672:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788483352.160324:0:22782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483352.160357:0:22782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69d0401200/0x1d7ea3d89ea1c011 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1c00a expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483352.160378:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69d0401200/0x1d7ea3d89ea1c011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c00a expref: 14 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483352.160400:0:22782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69d0401200/0x1d7ea3d89ea1c011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c00a expref: 14 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483352.160408:0:22782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69d0401200, rc 0) 00000100:00100000:0.0:1788483352.160456:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+14:23521:x1875360098796672:12345-0@lo:101:mount.lustre.0 Request processed in 158us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483352.160463:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788483352.162263:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098796672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483352.162290:0:23521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1c00a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c011 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483352.162302:0:23521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1c00a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1c011 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483352.162320:0:23521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788483352.162348:0:23521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1c00a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c011 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483352.162355:0:23521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69edb8bc00/0x1d7ea3d89ea1c00a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c011 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483352.162377:0:23521:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788483352.162382:0:23521:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788483352.162388:0:23521:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a69efd92000 10000000:01000000:1.0:1788483352.162391:0:23521:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788483352.162394:0:23521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788483352.162396:0:23521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788483352.162424:0:23521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a600/0x1d7ea3d89ea1c018 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483352.162431:0:23521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a600/0x1d7ea3d89ea1c018 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483352.162439:0:23521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a600/0x1d7ea3d89ea1c018 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483352.162459:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098796800:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788483352.162509:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483352.162552:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d78c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788483352.163153:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098796800 00000100:00100000:3.0:1788483352.163161:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098796800 00000100:00100000:3.0:1788483352.163201:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788483352.163209:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdaba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+14:23521:x1875360098796800:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483352.163221:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483352.163234:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecee0a00/0x1d7ea3d89ea1c01f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1c018 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483352.163253:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecee0a00/0x1d7ea3d89ea1c01f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c018 expref: 15 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483352.163262:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecee0a00/0x1d7ea3d89ea1c01f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c018 expref: 15 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483352.163269:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee0a00, rc 0) 00000100:00100000:3.0:1788483352.163311:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdaba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+15:23521:x1875360098796800:12345-0@lo:101:mount.lustre.0 Request processed in 102us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483352.163318:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788483352.164035:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098796800:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483352.164050:0:23521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a600/0x1d7ea3d89ea1c018 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c01f expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483352.164059:0:23521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a600/0x1d7ea3d89ea1c018 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1c01f expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788483352.166477:0:23521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:1.0:1788483352.167276:0:23521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788483352.173873:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788483352.173936:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:1.0:1788483352.173952:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:1.0:1788483352.173964:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:1.0:1788483352.173976:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:1.0:1788483352.173989:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:1.0:1788483352.174000:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:1.0:1788483352.174013:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:1.0:1788483352.174027:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:1.0:1788483352.174040:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:1.0:1788483352.174053:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:1.0:1788483352.174067:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:1.0:1788483352.174083:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:1.0:1788483352.174137:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:1.0:1788483352.174157:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:1.0:1788483352.174171:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:1.0:1788483352.174187:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:1.0:1788483352.174201:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:1.0:1788483352.174214:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:1.0:1788483352.174227:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:1.0:1788483352.174239:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:1.0:1788483352.174251:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:1.0:1788483352.174275:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:1.0:1788483352.174294:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:1.0:1788483352.174307:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1788483352.174881:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1788483352.174902:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1788483352.174916:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1788483352.174954:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1788483352.174972:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1788483352.174986:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1788483352.174999:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1788483352.175011:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1788483352.175023:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1788483352.175036:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1788483352.175048:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1788483352.175060:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1788483352.175073:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1788483352.175086:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1788483352.175133:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1788483352.175150:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1788483352.175166:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1788483352.175179:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1788483352.175190:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1788483352.175220:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1788483352.175227:0:23521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1788483352.175472:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffef9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098796928:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483352.175872:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483352.175986:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed85fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788483352.178763:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098796928 00000100:00100000:3.0:1788483352.178776:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098796928 00000100:00100000:2.0:1788483352.179022:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788483352.179032:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+15:23521:x1875360098796928:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483352.179360:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+15:23521:x1875360098796928:12345-0@lo:501:mount.lustre.0 Request processed in 329us (3488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483352.179369:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788483352.179709:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffef9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098796928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483352.179758:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5266a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098797056:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788483352.179811:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483352.179847:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788483352.179915:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098797056 00000100:00100000:0.0:1788483352.179920:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098797056 00000100:00100000:0.0:1788483352.179956:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788483352.179964:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdabb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+15:23521:x1875360098797056:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788483352.180843:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdabb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+15:23521:x1875360098797056:12345-0@lo:503:mount.lustre.0 Request processed in 877us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483352.180851:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788483352.180992:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5266a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098797056:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788483352.181863:0:23521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788483352.181951:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5266a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098797184:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788483352.182004:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483352.182087:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788483352.182208:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098797184 00000100:00100000:2.0:1788483352.182216:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098797184 00000100:00100000:2.0:1788483352.182250:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788483352.182258:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+15:23521:x1875360098797184:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483352.183391:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+15:23521:x1875360098797184:12345-0@lo:502:mount.lustre.0 Request processed in 1129us (1383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483352.183402:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788483352.183721:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5266a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098797184:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788483352.183955:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788483352.183986:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1788483352.183999:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1788483352.184012:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1788483352.184025:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1788483352.184040:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1788483352.184052:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1788483352.184064:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1788483352.184076:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1788483352.184088:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1788483352.184139:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1788483352.184156:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1788483352.184173:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1788483352.184188:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1788483352.184200:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1788483352.184213:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1788483352.184225:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1788483352.184237:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1788483352.184263:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1788483352.184276:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1788483352.184287:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1788483352.184301:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1788483352.184328:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1788483352.184354:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1788483352.184370:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1788483352.184381:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1788483352.184392:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1788483352.184403:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1788483352.184415:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1788483352.184432:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1788483352.184445:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1788483352.184459:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1788483352.184471:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1788483352.184483:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1788483352.184497:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1788483352.184511:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1788483352.184525:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1788483352.184539:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1788483352.184551:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1788483352.184564:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1788483352.184577:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1788483352.184604:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1788483352.184620:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1788483352.184633:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1788483352.184669:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5266a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098797312:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788483352.184729:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483352.184761:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788483352.185752:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098797312 00000100:00100000:2.0:1788483352.185761:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098797312 00000100:00100000:2.0:1788483352.185799:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788483352.185807:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+15:23521:x1875360098797312:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483352.185997:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+15:23521:x1875360098797312:12345-0@lo:502:mount.lustre.0 Request processed in 190us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483352.186005:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788483352.186892:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5266a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098797312:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788483352.186969:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1788483352.186990:0:23521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1788483352.188583:0:23525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788483352.188898:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483352.188901:0:23525:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788483352.188908:0:23525:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788483352.188911:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788483352.188923:0:23525:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9a69c76d0000) 00000020:00000080:2.0:1788483352.188942:0:23525:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1788483352.188947:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788483352.189015:0:23525:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788483352.189021:0:23525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1d7ea3d89ea1c02d 00000020:00000080:2.0:1788483352.189442:0:23525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788483352.189449:0:23525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483352.189453:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483352.189454:0:23525:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788483352.189457:0:23525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788483352.189461:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483352.189462:0:23525:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788483352.189465:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788483352.189473:0:23525:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9a69c55f19b8) 00000020:00000080:2.0:1788483352.189485:0:23525:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1788483352.189498:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788483352.189499:0:23525:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788483352.189502:0:23525:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788483352.189507:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788483352.189569:0:23525:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a69efd92000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788483352.189581:0:23525:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9a69c55f0000) 00000020:00000080:2.0:1788483352.189668:0:23525:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1788483352.189727:0:23525:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788483352.189732:0:23525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1d7ea3d89ea1c042 00000020:00000080:2.0:1788483352.189820:0:23525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788483352.189826:0:23525:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788483352.189831:0:23525:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x1d7ea3d89ea1c049 00080000:01000000:2.0:1788483352.189836:0:23525:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788483352.189839:0:23525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1d7ea3d89ea1c050 00010000:00010000:3.0:1788483352.312065:0:23525:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1788483352.315484:0:23525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:3.0:1788483352.316218:0:23525:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788483352.319170:0:23525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788483352.319184:0:23525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483352.319191:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483352.319193:0:23525:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788483352.319196:0:23525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483352.319203:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483352.319204:0:23525:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788483352.319207:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788483352.319211:0:23525:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.154@tcp to nid 0x20000c0a8ce9a (192.168.206.154@tcp) 00000020:00000080:3.0:1788483352.319239:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788483352.319254:0:23525:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9a69d287b370) 00000020:00000080:3.0:1788483352.319281:0:23525:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788483352.319287:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788483352.321303:0:23525:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788483352.324879:0:23525:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788483352.325011:0:23525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1d7ea3d89ea1c05e 00010000:00080000:2.0:1788483352.325057:0:23525:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a68c24ef800@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.154@tcp at head 00010000:00010000:2.0:1788483352.329253:0:23525:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788483352.346366:0:23525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788483352.350223:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788483352.351163:0:23525:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788483352.351201:0:23525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1d7ea3d89ea1c065 00000100:00080000:2.0:1788483352.351217:0:23525:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788483352.351225:0:23525:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a68c24ef800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:2.0:1788483352.351289:0:23525:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69ffef9180 x1875360098797440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788483352.351337:0:23525:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1788483352.351468:0:23525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483352.351477:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483352.351480:0:23525:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788483352.351486:0:23525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788483352.351489:0:23525:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788483352.351491:0:23525:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788483352.351493:0:23525:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788483352.351516:0:23525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000100:00080000:0.0:1788483352.352018:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788483352.352025:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788483352.352029:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a69d25dd000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483352.352036:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 640 00000100:00080000:0.0:1788483352.352041:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788483352.352047:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a69d25dd000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483352.352078:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69d0f21500 x1875360098797568/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788483352.352092:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483352.352135:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483352.352153:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483352.352157:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788483352.352204:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788483352.352217:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098797696:0@lo:400:kworker.0 00000100:00100000:0.0:1788483352.352289:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483352.352351:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098797696 00000100:00100000:0.0:1788483352.352359:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098797696 00000100:00100000:0.0:1788483352.352405:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788483352.352413:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098797696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483352.352465:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098797696:12345-0@lo:400:kworker.0 Request processed in 52us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483352.352472:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788483352.352507:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a69d0f23b80 x1875360098797696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:2.0:1788483352.352721:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483352.352723:0:23525:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788483352.352730:0:23525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788483352.352735:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483352.352736:0:23525:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788483352.352740:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788483352.352804:0:23525:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788483352.352828:0:23525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483352.352832:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483352.352833:0:23525:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788483352.352836:0:23525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788483352.352838:0:23525:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788483352.352839:0:23525:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788483352.352841:0:23525:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788483352.352843:0:23525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788483352.352845:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483352.352847:0:23525:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000100:00100000:0.0:1788483352.352927:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098797696:0@lo:400:kworker.0 00000100:00100000:1.0:1788483352.353015:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098797440:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788483352.353055:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483352.353090:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098797568:0@lo:38:kworker.0 00000100:00100000:1.0:1788483352.353135:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483352.353440:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098797440 00000100:00100000:3.0:1788483352.353446:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098797440 00000100:00100000:3.0:1788483352.353463:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098797568 00000100:00100000:3.0:1788483352.353465:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098797568 00000100:00100000:3.0:1788483352.353477:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788483352.353482:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1875360098797440:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788483352.353503:0:22793:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 644 last 0 00000020:00000080:3.0:1788483352.353546:0:22793:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1d7ea3d89ea1c06c 00000004:00100000:3.0:1788483352.353558:0:22793:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788483352.353563:0:22793:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000020:01000000:2.0:1788483352.353729:0:23525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788483352.353734:0:23525:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788483352.353740:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483352.353741:0:23525:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788483352.353745:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788483352.353748:0:23525:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.154@tcp to nid 0x20000c0a8ce9a (192.168.206.154@tcp) 00000020:01000000:2.0:1788483352.353769:0:23525:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788483352.353772:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788483352.353785:0:23525:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9a69c55f4d28) 00000020:00000080:2.0:1788483352.353799:0:23525:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788483352.353805:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1788483352.353970:0:22794:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788483352.353979:0:22794:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000004:00080000:2.0:1788483352.354148:0:23525:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788483352.354154:0:23525:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788483352.354161:0:23525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1d7ea3d89ea1c07a 00010000:00080000:2.0:1788483352.354197:0:23525:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a68c1d33000@lustre-OST0000-osc-MDT0001: add connection 192.168.206.154@tcp at head 00010000:00010000:2.0:1788483352.354990:0:23525:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:1.0:1788483352.356502:0:23530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788483352.356512:0:23530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3618:x1875360098797568:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788483352.356611:0:23530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3618:x1875360098797568:12345-0@lo:38:kworker.0 Request processed in 98us (3474us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788483352.356626:0:23530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788483352.356871:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788483352.356879:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69d25dd000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788483352.356883:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788483352.356887:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098797568:0@lo:38:kworker.0 00000040:01000000:2.0:1788483352.360367:0:23525:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00080000:1.0:1788483352.363024:0:22793:0:(import.c:65:import_set_state_nolock()) ffff9a69c6a83800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788483352.363150:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1875360098797440:12345-0@lo:38:llog_process_th.0 Request processed in 9665us (10093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483352.363161:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788483352.363346:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788483352.363355:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788483352.363363:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788483352.363368:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788483352.363371:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c24ef800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788483352.363390:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098797440:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788483352.364535:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788483352.364551:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098797824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788483352.364600:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483352.364706:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098797824 00000100:00100000:0.0:1788483352.364713:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098797824 00000100:00100000:0.0:1788483352.364759:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788483352.364769:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1875360098797824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788483352.364798:0:22794:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788483352.364841:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1875360098797824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483352.364848:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:01000000:0.0:1788483352.364881:0:23525:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1788483352.366625:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098797824:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788483352.368228:0:23525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788483352.368842:0:23525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1788483352.368985:0:23525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788483352.369656:0:23531:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788483352.369661:0:23531:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788483352.370727:0:23525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788483352.370745:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788483352.370807:0:23525:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788483352.370835:0:23525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1d7ea3d89ea1c081 00000100:00080000:2.0:1788483352.370848:0:23525:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788483352.370854:0:23525:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a68c1d33000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:2.0:1788483352.370887:0:23525:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69ffef9180 x1875360098797952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788483352.370907:0:23525:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788483352.371014:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483352.371019:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483352.371021:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483352.371023:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1788483352.371091:0:23525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483352.371123:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483352.371125:0:23525:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788483352.371129:0:23525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788483352.371132:0:23525:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1788483352.371134:0:23525:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788483352.371136:0:23525:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788483352.371137:0:23525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788483352.371139:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483352.371141:0:23525:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788483352.371143:0:23525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788483352.371147:0:23525:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788483352.371157:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483352.371159:0:23525:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788483352.371162:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788483352.371165:0:23525:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.154@tcp to nid 0x20000c0a8ce9a (192.168.206.154@tcp) 00000020:01000000:2.0:1788483352.371188:0:23525:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788483352.371191:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788483352.371202:0:23525:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9a69c55f3370) 00000020:00000080:2.0:1788483352.371214:0:23525:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788483352.371219:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788483352.371442:0:23525:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788483352.371448:0:23525:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788483352.371454:0:23525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1d7ea3d89ea1c08f 00010000:00080000:2.0:1788483352.371483:0:23525:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a69e8faa800@lustre-OST0001-osc-MDT0001: add connection 192.168.206.154@tcp at head 00010000:00010000:2.0:1788483352.371673:0:23525:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788483352.371733:0:23525:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788483352.371748:0:23525:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1788483352.371989:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098797952:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788483352.372060:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875360098797952 offset 0 length 520: 4 00000040:00080000:2.0:1788483352.378727:0:23525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788483352.378979:0:23525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1788483352.379142:0:23525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1788483352.380194:0:23533:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788483352.380200:0:23533:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788483352.382933:0:23525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788483352.382948:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788483352.382996:0:23525:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788483352.383032:0:23525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1d7ea3d89ea1c096 00000100:00080000:0.0:1788483352.383043:0:23525:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788483352.383049:0:23525:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a69e8faa800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483352.383081:0:23525:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69d0f23b80 x1875360098798080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788483352.383702:0:23525:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788483352.383781:0:23525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788483352.383787:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483352.383789:0:23525:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788483352.383792:0:23525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788483352.383796:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483352.383797:0:23525:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788483352.383800:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788483352.383802:0:23525:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788483352.383805:0:23525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788483352.383807:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483352.383808:0:23525:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788483352.383824:0:23525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788483352.383828:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483352.383829:0:23525:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788483352.383833:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788483352.383870:0:23525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788483352.383873:0:23525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788483352.383875:0:23525:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788483352.383878:0:23525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:1.0:1788483352.384277:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483352.384283:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788483352.384285:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483352.384288:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788483352.386458:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098798080:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788483352.386565:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875360098798080 offset 0 length 520: 4 00000020:01000000:3.0:1788483352.386661:0:23521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1788483352.386711:0:23521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788483352.386747:0:23521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a600/0x1d7ea3d89ea1c018 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c01f expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483352.386761:0:23521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a600/0x1d7ea3d89ea1c018 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c01f expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483352.386772:0:23521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a69efd92000 from 1 10000000:01000000:3.0:1788483352.386776:0:23521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788483352.386818:0:23521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0e00/0x1d7ea3d89ea1c09d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483352.386827:0:23521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0e00/0x1d7ea3d89ea1c09d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483352.386840:0:23521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0e00/0x1d7ea3d89ea1c09d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483352.386865:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5266a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098798208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788483352.386934:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483352.386979:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd2240 going to sleep for 11 seconds 00000100:00100000:1.0:1788483352.387290:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098798208 00000100:00100000:1.0:1788483352.387301:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098798208 00000100:00100000:1.0:1788483352.387399:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788483352.387414:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdaba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+15:23521:x1875360098798208:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483352.387431:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483352.387449:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69edb8b800/0x1d7ea3d89ea1c0a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1c09d expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483352.387481:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69edb8b800/0x1d7ea3d89ea1c0a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c09d expref: 16 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483352.387495:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69edb8b800/0x1d7ea3d89ea1c0a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c09d expref: 16 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483352.387520:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8b800, rc 0) 00000100:00100000:1.0:1788483352.387574:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdaba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+16:23521:x1875360098798208:12345-0@lo:101:mount.lustre.0 Request processed in 164us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483352.388016:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788483352.389284:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5266a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098798208:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483352.389710:0:23521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0e00/0x1d7ea3d89ea1c09d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c0a4 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483352.389725:0:23521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0e00/0x1d7ea3d89ea1c09d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1c0a4 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483352.390363:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5266a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098798336:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788483352.390431:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483352.390465:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd2240 going to sleep for 11 seconds 00000100:00100000:1.0:1788483352.390839:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098798336 00000100:00100000:1.0:1788483352.390848:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098798336 00000100:00100000:1.0:1788483352.390906:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788483352.390915:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+16:23521:x1875360098798336:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788483352.390934:0:22782:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788483352.390953:0:22782:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788483352.390956:0:22782:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1788483352.391049:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+16:23521:x1875360098798336:12345-0@lo:256:mount.lustre.0 Request processed in 134us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483352.391057:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788483352.393216:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5266a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098798336:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788483352.394294:0:23521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788483352.394330:0:23521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0e00/0x1d7ea3d89ea1c09d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c0a4 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483352.394350:0:23521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0e00/0x1d7ea3d89ea1c09d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c0a4 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483352.394357:0:23521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69efd92000 from 1 10000000:01000000:3.0:1788483352.394360:0:23521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788483352.394392:0:23521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0400/0x1d7ea3d89ea1c0ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483352.394398:0:23521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0400/0x1d7ea3d89ea1c0ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483352.394420:0:23521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0400/0x1d7ea3d89ea1c0ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483352.394441:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5266a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098798464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788483352.394496:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483352.394529:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd2240 going to sleep for 11 seconds 00000100:00100000:1.0:1788483352.395241:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098798464 00000100:00100000:1.0:1788483352.395250:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098798464 00000100:00100000:1.0:1788483352.395316:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788483352.395327:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+16:23521:x1875360098798464:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483352.395349:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483352.395364:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69edb8a200/0x1d7ea3d89ea1c0b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1c0ab expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483352.395391:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69edb8a200/0x1d7ea3d89ea1c0b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c0ab expref: 17 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483352.395402:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69edb8a200/0x1d7ea3d89ea1c0b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c0ab expref: 17 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483352.395426:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8a200, rc 0) 00000100:00100000:1.0:1788483352.395482:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+17:23521:x1875360098798464:12345-0@lo:101:mount.lustre.0 Request processed in 157us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483352.395489:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788483352.395873:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5266a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098798464:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483352.395889:0:23521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0400/0x1d7ea3d89ea1c0ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c0b2 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483352.395899:0:23521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0400/0x1d7ea3d89ea1c0ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1c0b2 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788483352.397621:0:23521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1788483352.397894:0:23521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788483352.398062:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788483352.398088:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1788483352.398125:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1788483352.398157:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1788483352.398173:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1788483352.398187:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1788483352.398201:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1788483352.398215:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1788483352.398229:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788483352.398251:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1788483352.398264:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1788483352.398281:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1788483352.398286:0:23521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1788483352.398380:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffef8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098798592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483352.398441:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483352.398715:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483352.400910:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098798592 00000100:00100000:3.0:1788483352.400924:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098798592 00000100:00100000:2.0:1788483352.401124:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788483352.401135:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+17:23521:x1875360098798592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483352.401379:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+17:23521:x1875360098798592:12345-0@lo:501:mount.lustre.0 Request processed in 245us (2937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483352.401388:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788483352.401981:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffef8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098798592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483352.402031:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5266a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098798720:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788483352.402090:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483352.402193:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c546f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788483352.402383:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098798720 00000100:00100000:2.0:1788483352.402389:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098798720 00000100:00100000:2.0:1788483352.402418:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788483352.402425:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+17:23521:x1875360098798720:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788483352.402573:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+17:23521:x1875360098798720:12345-0@lo:503:mount.lustre.0 Request processed in 147us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483352.402580:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788483352.403801:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5266a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098798720:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788483352.405191:0:23521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788483352.405273:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffef9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098798848:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483352.405363:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483352.405404:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788483352.405536:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098798848 00000100:00100000:0.0:1788483352.405543:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098798848 00000100:00100000:0.0:1788483352.405588:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788483352.405724:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3666c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+17:23521:x1875360098798848:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483352.405847:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3666c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+17:23521:x1875360098798848:12345-0@lo:502:mount.lustre.0 Request processed in 127us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483352.405855:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788483352.406003:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffef9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098798848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788483352.406768:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788483352.406799:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1788483352.406826:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1788483352.406842:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1788483352.406873:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1788483352.406887:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1788483352.406898:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1788483352.406910:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1788483352.406922:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788483352.406932:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1788483352.406944:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1788483352.406976:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffef9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098798976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483352.407027:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483352.407062:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788483352.407208:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098798976 00000100:00100000:0.0:1788483352.407214:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098798976 00000100:00100000:0.0:1788483352.407294:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788483352.407303:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3667c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+17:23521:x1875360098798976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483352.407413:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3667c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+17:23521:x1875360098798976:12345-0@lo:502:mount.lustre.0 Request processed in 110us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483352.407421:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788483352.407502:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffef9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098798976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788483352.407546:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1788483352.407554:0:23521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788483352.409742:0:23535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788483352.409755:0:23535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483352.409758:0:23535:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788483352.409765:0:23535:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a69efd92000 00000020:00000080:2.0:1788483352.409768:0:23535:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788483352.409778:0:23535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483352.409781:0:23535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483352.409782:0:23535:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788483352.409785:0:23535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788483352.409787:0:23535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483352.409788:0:23535:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788483352.409792:0:23535:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a69efd92000 00000020:00000080:2.0:1788483352.409794:0:23535:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788483352.410111:0:23535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483352.410116:0:23535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483352.410118:0:23535:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788483352.410129:0:23535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788483352.410133:0:23535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483352.410134:0:23535:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788483352.410138:0:23535:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a69efd92000 00000020:00000080:2.0:1788483352.410140:0:23535:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788483352.417732:0:23535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483352.417744:0:23535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483352.417746:0:23535:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788483352.417751:0:23535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788483352.417755:0:23535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483352.417757:0:23535:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788483352.417761:0:23535:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a69efd92000 00000020:00000080:2.0:1788483352.417763:0:23535:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788483352.417823:0:23535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483352.417827:0:23535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483352.417829:0:23535:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788483352.417832:0:23535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:3.0:1788483352.423642:0:23521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788483352.423690:0:23521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788483352.423714:0:23521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0400/0x1d7ea3d89ea1c0ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c0b2 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483352.423726:0:23521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0400/0x1d7ea3d89ea1c0ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c0b2 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483352.423801:0:23521:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788483352.423805:0:23521:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a69efd92000 10000000:01000000:3.0:1788483352.423808:0:23521:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a69efd92000 10000000:01000000:3.0:1788483352.423812:0:23521:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788483352.423818:0:23521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a69efd92000 from 1 10000000:01000000:3.0:1788483352.423820:0:23521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788483352.423856:0:23521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1000/0x1d7ea3d89ea1c0b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483352.423864:0:23521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1000/0x1d7ea3d89ea1c0b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483352.423875:0:23521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1000/0x1d7ea3d89ea1c0b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483352.423898:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5266a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098799104:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788483352.423958:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483352.423998:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098799104 00000100:00100000:3.0:1788483352.424004:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098799104 00000100:00100000:3.0:1788483352.424044:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788483352.424053:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+17:23521:x1875360098799104:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483352.424066:0:22783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483352.424078:0:22783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecee1e00/0x1d7ea3d89ea1c0c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1c0b9 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483352.424126:0:22783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecee1e00/0x1d7ea3d89ea1c0c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c0b9 expref: 18 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483352.424150:0:22783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecee1e00/0x1d7ea3d89ea1c0c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c0b9 expref: 18 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483352.424159:0:22783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1e00, rc 0) 00000100:00100000:3.0:1788483352.424193:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:23521:x1875360098799104:12345-0@lo:101:mount.lustre.0 Request processed in 140us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483352.424200:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788483352.424241:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c35f7540 going to sleep for 11 seconds 00000100:00100000:3.0:1788483352.424261:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5266a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098799104:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483352.424287:0:23521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1000/0x1d7ea3d89ea1c0b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c0c0 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483352.424296:0:23521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1000/0x1d7ea3d89ea1c0b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1c0c0 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788483352.443055:0:23521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1788483352.443393:0:23521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788483352.443581:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788483352.444007:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1788483352.444022:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1788483352.444052:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1788483352.444066:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1788483352.444078:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1788483352.444089:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1788483352.444132:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1788483352.444148:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1788483352.444161:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1788483352.444174:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1788483352.444188:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1788483352.444200:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1788483352.444213:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1788483352.444235:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1788483352.444248:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1788483352.444273:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1788483352.444302:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1788483352.444440:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1788483352.444468:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1788483352.444482:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1788483352.444494:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1788483352.444506:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1788483352.444520:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1788483352.444533:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1788483352.444545:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1788483352.444557:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1788483352.444569:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1788483352.444582:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1788483352.444684:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1788483352.444696:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1788483352.444708:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1788483352.444720:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1788483352.444731:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1788483352.444744:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1788483352.444769:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1788483352.444783:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1788483352.444794:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1788483352.444803:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1788483352.444814:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1788483352.444827:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1788483352.444839:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1788483352.444851:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1788483352.444863:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1788483352.444875:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1788483352.444888:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1788483352.444899:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1788483352.444922:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1788483352.445053:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1788483352.445083:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1788483352.445130:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1788483352.445137:0:23521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1788483352.445225:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffef9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098799232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483352.445293:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483352.445441:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098799232 00000100:00100000:1.0:1788483352.445449:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098799232 00000100:00100000:1.0:1788483352.445500:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788483352.445509:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3664850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:23521:x1875360098799232:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483352.450241:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3664850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:23521:x1875360098799232:12345-0@lo:501:mount.lustre.0 Request processed in 4723us (4939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483352.450254:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788483352.453762:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788483352.453801:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffef9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098799232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483352.453851:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffef9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098799360:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788483352.453912:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483352.453940:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788483352.454022:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098799360 00010000:00010000:1.0:1788483352.454025:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483352.454028:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098799360 00000100:00100000:3.0:1788483352.454088:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788483352.454119:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3667450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:23521:x1875360098799360:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788483352.454237:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3667450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:23521:x1875360098799360:12345-0@lo:503:mount.lustre.0 Request processed in 141us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483352.454244:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788483352.454444:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffef9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098799360:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788483352.454918:0:23521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788483352.454983:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffef9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098799488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483352.455024:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483352.455058:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788483352.455271:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098799488 00000100:00100000:3.0:1788483352.455277:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098799488 00000100:00100000:3.0:1788483352.455307:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788483352.455402:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3666050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:23521:x1875360098799488:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788483352.455504:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3666050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:23521:x1875360098799488:12345-0@lo:502:mount.lustre.0 Request processed in 104us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483352.455511:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788483352.455557:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffef9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098799488:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788483352.456472:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1788483352.456504:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1788483352.456515:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1788483352.456526:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1788483352.456537:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1788483352.456548:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1788483352.457622:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1788483352.457662:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1788483352.457679:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1788483352.457691:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1788483352.457703:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1788483352.457714:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1788483352.457728:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1788483352.457742:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1788483352.457756:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1788483352.457770:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1788483352.457782:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1788483352.457796:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1788483352.457809:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1788483352.457822:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1788483352.457836:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1788483352.457850:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1788483352.457880:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1788483352.457896:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1788483352.457910:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1788483352.457924:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1788483352.457948:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1788483352.457963:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1788483352.457977:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1788483352.457991:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1788483352.458003:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1788483352.458016:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1788483352.458029:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1788483352.458043:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1788483352.458057:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1788483352.458071:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1788483352.458085:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1788483352.458418:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1788483352.458451:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1788483352.458467:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1788483352.458481:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1788483352.458494:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1788483352.458506:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1788483352.458520:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1788483352.458533:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1788483352.458547:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1788483352.458561:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1788483352.458576:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1788483352.458631:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5266a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098799616:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788483352.458702:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483352.458793:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c35f7780 going to sleep for 11 seconds 00000100:00100000:0.0:1788483352.459004:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098799616 00000100:00100000:0.0:1788483352.459012:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098799616 00000100:00100000:0.0:1788483352.459056:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788483352.459065:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:23521:x1875360098799616:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483352.459207:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:23521:x1875360098799616:12345-0@lo:502:mount.lustre.0 Request processed in 143us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483352.459215:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788483352.459524:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5266a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098799616:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788483352.459695:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1788483352.459720:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1788483352.459746:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098799744:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483352.459783:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483352.459907:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483352.459939:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098799744 00000100:00100000:3.0:1788483352.459944:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098799744 00000100:00100000:3.0:1788483352.459981:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788483352.459988:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:23521:x1875360098799744:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788483352.460127:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:23521:x1875360098799744:12345-0@lo:502:mount.lustre.0 Request processed in 139us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483352.460142:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788483352.460455:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098799744:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788483352.460498:0:23521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1788483352.460512:0:23521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788483352.461446:0:23541:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788483352.461460:0:23541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9a69df0b4d28) 00000020:00000080:1.0:1788483352.461481:0:23541:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788483352.461563:0:23541:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a69efd92000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788483352.461568:0:23541:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a69efd92000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788483352.461570:0:23541:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a69efd92000 3 00010000:00080000:1.0:1788483352.461680:0:23541:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a69efe12800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.154@tcp at head 00010000:00010000:1.0:1788483352.463487:0:23541:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788483352.463714:0:23541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788483352.463749:0:23541:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788483352.463759:0:23541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x1d7ea3d89ea1c0ce 00000100:00080000:1.0:1788483352.463769:0:23541:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788483352.463774:0:23541:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a69efe12800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788483352.463805:0:23541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69efe9d500 x1875360098799872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788483352.463872:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875360098799872:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788483352.463931:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483352.464024:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098799872 00000100:00100000:0.0:1788483352.464031:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098799872 00000100:00100000:0.0:1788483352.464057:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788483352.464064:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3618:x1875360098799872:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788483352.464083:0:22789:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 644 last 0 00000020:00000080:0.0:1788483352.464127:0:22789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x1d7ea3d89ea1c0d5 00000004:00100000:0.0:1788483352.464139:0:22789:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788483352.464163:0:22789:0:(import.c:65:import_set_state_nolock()) ffff9a68c36b1800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788483352.464228:0:23541:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788483352.464249:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483352.464253:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788483352.464255:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483352.464258:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788483352.464503:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875360098799872:12345-0@lo:38:llog_process_th.0 Request processed in 437us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483352.464510:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:1.0:1788483352.464650:0:23541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:2.0:1788483352.466010:0:23521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788483352.466209:0:23521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788483352.466227:0:23521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1000/0x1d7ea3d89ea1c0b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c0c0 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483352.466239:0:23521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1000/0x1d7ea3d89ea1c0b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c0c0 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788483352.466304:0:23521:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788483352.466307:0:23521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788483352.466308:0:23521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788483352.466309:0:23521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788483352.466310:0:23521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788483352.466312:0:23521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788483352.466313:0:23521:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788483352.466315:0:23521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788483352.466317:0:23521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788483352.466320:0:23521:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788483352.466323:0:23521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788483352.466324:0:23521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788483352.466325:0:23521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788483352.466326:0:23521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788483352.466327:0:23521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788483352.466328:0:23521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788483352.466329:0:23521:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788483352.466330:0:23521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788483352.466331:0:23521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788483352.466362:0:23521:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788483352.466380:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098800000:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788483352.466435:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483352.466468:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098800000 00000100:00100000:2.0:1788483352.466474:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098800000 00000100:00100000:2.0:1788483352.466512:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788483352.466519:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3666850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:23521:x1875360098800000:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788483352.466549:0:22782:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788483352.466561:0:22782:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788483352.466749:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd93c0 going to sleep for 11 seconds 00010000:00080000:3.0:1788483352.467023:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a69efe9d500 x1875360098799872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788483362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483352.467035:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788483352.467042:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788483352.467049:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788483352.467053:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788483352.467056:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69efe12800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788483352.467063:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875360098799872:0@lo:38:llog_process_th.0 00000001:00100000:2.0:1788483352.473927:0:22768:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788483352.474483:0:22782:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788483352.474521:0:22782:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788483352.474787:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3666850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:23521:x1875360098800000:12345-0@lo:253:mount.lustre.0 Request processed in 8262us (8346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483352.474800:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788483352.474861:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:23521:1875360098800000:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788483352.474873:0:23521:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788483352.474876:0:23521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788483352.474878:0:23521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788483352.474879:0:23521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788483352.474880:0:23521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788483352.474881:0:23521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788483352.474882:0:23521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788483352.474884:0:23521:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788483352.474885:0:23521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788483352.474886:0:23521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788483352.474901:0:23521:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788483352.478447:0:22804:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788483352.478454:0:22804:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788483352.478474:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a69ecf27c00/0x1d7ea3d89ea1c0dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483352.478492:0:22804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1bfe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bfd9 expref: 17 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483352.478499:0:22804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69edb8b800/0x1d7ea3d89ea1c0a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c09d expref: 17 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483352.478507:0:22804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a69ecf27c00/0x1d7ea3d89ea1c0dc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483352.478700:0:22804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69edb8b800/0x1d7ea3d89ea1c0a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1c09d expref: 17 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483352.478782:0:22804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69edb8b800/0x1d7ea3d89ea1c0a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c09d expref: 17 pid: 22780 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483352.478797:0:22804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffef9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875360098800128:0@lo:104: 00000100:00100000:2.0:1788483352.478971:0:22804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788483352.479017:0:22804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1bfe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1bfd9 expref: 17 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483352.479026:0:22804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1bfe0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1bfd9 expref: 17 pid: 22780 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483352.479044:0:22804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffef9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875360098800256:0@lo:104: 00000100:00100000:2.0:1788483352.479573:0:22804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483352.479712:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483352.479753:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098800128 00000100:00100000:0.0:1788483352.479760:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098800128 00000100:00100000:0.0:1788483352.479791:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098800256 00000100:00100000:0.0:1788483352.479794:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098800256 00000100:00100000:0.0:1788483352.479806:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788483352.479814:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffef8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+4:22804:x1875360098800128:12345-0@lo:104: 00010000:00010000:0.0:1788483352.479825:0:22771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0e00/0x1d7ea3d89ea1c09d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1c0a4 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483352.479886:0:22771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788483352.479892:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffef8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+4:22804:x1875360098800128:12345-0@lo:104: Request processed in 79us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483352.479899:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788483352.479914:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788483352.479920:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffefb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+3:22804:x1875360098800256:12345-0@lo:104: 00010000:00010000:0.0:1788483352.479927:0:22771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1bfd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1bfe0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483352.479950:0:22804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffef9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875360098800128:0@lo:104: 00010000:00010000:0.0:1788483352.479976:0:22771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788483352.479978:0:22804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffef9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875360098800256:0@lo:104: 00000100:00100000:0.0:1788483352.479981:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffefb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+3:22804:x1875360098800256:12345-0@lo:104: Request processed in 62us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483352.479987:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788483352.479997:0:22804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a69ecf27c00/0x1d7ea3d89ea1c0dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483352.480002:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788483352.480007:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0e00/0x1d7ea3d89ea1c09d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1c0a4 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483352.480014:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0e00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788483352.480018:0:22776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0e00/0x1d7ea3d89ea1c09d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1c0a4 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483352.480026:0:22776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0e00/0x1d7ea3d89ea1c09d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1c0a4 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788483352.480033:0:22776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0e00/0x1d7ea3d89ea1c09d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1c0a4 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483352.480039:0:22776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788483352.480068:0:22776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0e00/0x1d7ea3d89ea1c09d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c0a4 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483352.480074:0:22776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788483352.480212:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3622:1875360098800384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788483352.480245:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788483352.480254:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0e00/0x1d7ea3d89ea1c09d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c0a4 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483352.480335:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0e00/0x1d7ea3d89ea1c09d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c0a4 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483352.480369:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483352.480373:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1bfd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1bfe0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483352.480378:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1400 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788483352.480381:0:22776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1bfd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1bfe0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483352.480387:0:22776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1bfd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1bfe0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788483352.480394:0:22776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1bfd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1bfe0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483352.480399:0:22776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788483352.480417:0:22776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1bfd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1bfe0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483352.480428:0:22776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788483352.480448:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098800384 00000100:00100000:2.0:1788483352.480457:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098800384 00000100:00100000:1.0:1788483352.480471:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3619:1875360098800512:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483352.480477:0:22773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69edb8b800/0x1d7ea3d89ea1c0a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c09d expref: 18 pid: 22780 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483352.480498:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788483352.480498:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483352.480518:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:3622:x1875360098800384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483352.480529:0:22773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483352.480534:0:22773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69edb8b800/0x1d7ea3d89ea1c0a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c09d expref: 18 pid: 22780 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483352.480535:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1bfd9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1bfe0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483352.480542:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1400/0x1d7ea3d89ea1bfd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1bfe0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483352.480545:0:22773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69edb8b800/0x1d7ea3d89ea1c0a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c09d expref: 18 pid: 22780 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483352.480556:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69edb8b800/0x1d7ea3d89ea1c0a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c09d expref: 18 pid: 22780 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483352.480556:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483352.480558:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483352.480560:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483352.480565:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483352.480568:0:22773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483352.480579:0:22775:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788483352.480597:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+17:3622:x1875360098800384:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483352.480597:0:22775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788483352.480603:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788483352.480616:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098800512 00000100:00100000:2.0:1788483352.480620:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098800512 00010000:00010000:2.0:1788483352.480631:0:22773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1bfe0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1bfd9 expref: 17 pid: 22780 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483352.480654:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788483352.480660:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+17:3619:x1875360098800512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483352.480668:0:22773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483352.480672:0:22773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1bfe0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1bfd9 expref: 17 pid: 22780 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483352.480680:0:22773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1bfe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1bfd9 expref: 17 pid: 22780 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483352.480689:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1bfe0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1bfd9 expref: 17 pid: 22780 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483352.480700:0:22773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a69ecf27c00/0x1d7ea3d89ea1c0dc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483352.480707:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecf27c00/0x1d7ea3d89ea1c0dc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788483352.480719:0:22773:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002488290s 00010000:00010000:2.0:1788483352.480723:0:22773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69ecf27c00/0x1d7ea3d89ea1c0dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483352.480730:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69ecf27c00/0x1d7ea3d89ea1c0dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483352.480736:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a69ecf27c00/0x1d7ea3d89ea1c0dc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483352.480742:0:22773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a69ecf27c00/0x1d7ea3d89ea1c0dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483352.480753:0:22773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483352.480758:0:22773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a69ecf27c00/0x1d7ea3d89ea1c0dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483352.480765:0:22773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a69ecf27c00/0x1d7ea3d89ea1c0dc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483352.480778:0:22773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a69ecf27c00/0x1d7ea3d89ea1c0dc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483352.480787:0:22773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483352.480823:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+16:3619:x1875360098800512:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483352.480829:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788483352.480913:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3619:1875360098800512:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483352.480933:0:22804:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a69ecf27c00/0x1d7ea3d89ea1c0dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483352.480941:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a69ecf27c00/0x1d7ea3d89ea1c0dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483352.480948:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ecf27c00/0x1d7ea3d89ea1c0dc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483352.480978:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3622:1875360098800384:0@lo:103:ldlm_bl.0 00000040:01000000:3.0:1788483352.481058:0:23521:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1788483352.481491:0:23547:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788483352.481496:0:23547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788483352.481572:0:23549:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788483352.481574:0:23521:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1788483352.481953:0:23550:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23550:1875360098800640:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788483352.482001:0:23550:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788483352.482007:0:23549:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788483352.482030:0:23550:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788483352.482137:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098800640 00000100:00100000:1.0:1788483352.482143:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098800640 00000100:00100000:1.0:1788483352.482179:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788483352.482186:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23550:x1875360098800640:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788483352.482255:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23550:x1875360098800640:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 70us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483352.482262:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:01000000:3.0:1788483352.482360:0:23521:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788483352.482401:0:23521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788483352.482705:0:23550:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23550:1875360098800640:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1788483352.482732:0:23550:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788483352.482757:0:23550:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23550:1875360098800768:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788483352.482784:0:23550:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483352.482808:0:23550:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788483352.483017:0:23530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098800768 00000100:00100000:1.0:1788483352.483022:0:23530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098800768 00000100:00100000:1.0:1788483352.483055:0:23530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788483352.483062:0:23530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23550:x1875360098800768:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788483352.483172:0:23530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23550:x1875360098800768:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 111us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483352.483180:0:23530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00000080:3.0:1788483352.483225:0:23521:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788483352.483233:0:23521:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788483352.483365:0:23521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788483352.483479:0:23550:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23550:1875360098800768:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788483352.483529:0:23550:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23550:1875360098800896:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788483352.483555:0:23550:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483352.483577:0:23550:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483352.483629:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098800896 00000100:00100000:1.0:1788483352.483634:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098800896 00000100:00100000:1.0:1788483352.483663:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788483352.483670:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23550:x1875360098800896:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788483352.483704:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23550:x1875360098800896:12345-0@lo:900:lod0001_rec0000.0 Request processed in 35us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483352.483710:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788483352.483763:0:23550:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a69d0f21880 x1875360098800896/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788483368 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483352.483773:0:23550:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23550:1875360098800896:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788483352.483805:0:23550:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23550:1875360098801024:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788483352.483826:0:23550:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483352.483846:0:23550:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788483352.484121:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098801024 00000100:00100000:1.0:1788483352.484126:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098801024 00000100:00100000:1.0:1788483352.484153:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788483352.484160:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23550:x1875360098801024:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788483352.484209:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23550:x1875360098801024:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 50us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483352.484216:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788483352.484284:0:23550:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23550:1875360098801024:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788483352.484390:0:23550:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788483352.484673:0:23521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788483352.485395:0:23521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788483352.485434:0:23521:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788483352.485672:0:23521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788483352.486221:0:23521:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000040:00080000:2.0:1788483352.487904:0:23549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788483352.487967:0:23549:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1788483352.494980:0:23550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788483352.495055:0:23550:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00000004:3.0:1788483352.495059:0:23521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000004:00080000:0.0:1788483352.495060:0:23550:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:2.0:1788483352.496787:0:23521:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788483352.496836:0:23521:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb53840e3b988 00100000:10000000:2.0:1788483352.496843:0:23521:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788483352.497848:0:23521:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788483352.497882:0:23521:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.154@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788483352.497906:0:23521:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788483352.497927:0:23521:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788483352.501278:0:23521:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788483352.501515:0:23521:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788483352.888235:0:22830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e840 going to sleep for 0 seconds 00010000:00010000:0.0:1788483353.464362:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788483353.465765:0:23542:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788483353.917166:0:22830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e840 going to sleep for 0 seconds 10000000:01000000:1.0:1788483354.427377:0:22785:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788483354.427386:0:22785:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a69efd92000 from 12 10000000:01000000:1.0:1788483354.427392:0:22785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788483354.427442:0:22785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c0e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483354.427475:0:22785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c0e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483354.427488:0:22785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c0e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483354.427515:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098801152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788483354.427596:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483354.427642:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd81ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788483354.428222:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098801152 00000100:00100000:0.0:1788483354.428231:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098801152 00000100:00100000:0.0:1788483354.428322:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788483354.428343:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3665c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+16:22785:x1875360098801152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483354.428358:0:22783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483354.428373:0:22783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69d0401a00/0x1d7ea3d89ea1c0ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1c0e3 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483354.428398:0:22783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69d0401a00/0x1d7ea3d89ea1c0ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c0e3 expref: 17 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483354.428409:0:22783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69d0401a00/0x1d7ea3d89ea1c0ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c0e3 expref: 17 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483354.428418:0:22783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69d0401a00, rc 0) 00000100:00100000:0.0:1788483354.428485:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3665c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+17:22785:x1875360098801152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483354.428493:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788483354.428541:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098801152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483354.428559:0:22785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c0e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c0ea expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483354.428567:0:22785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c0e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1c0ea expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483354.432839:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098801280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788483354.432910:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483354.432954:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788483354.432982:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098801280 00000100:00100000:0.0:1788483354.432989:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098801280 00000100:00100000:0.0:1788483354.433072:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788483354.433081:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3664050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+17:22785:x1875360098801280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788483354.433119:0:22782:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788483354.433135:0:22782:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788483354.433138:0:22782:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788483354.433226:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3664050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+17:22785:x1875360098801280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483354.433234:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788483354.433277:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098801280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788483354.433315:0:22785:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788483354.433323:0:22785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c0e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c0ea expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483354.433340:0:22785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c0e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c0ea expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483354.433350:0:22785:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788483354.433353:0:22785:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a68c4d04800 from 12 10000000:01000000:0.0:1788483354.433355:0:22785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788483354.433378:0:22785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69d0401600/0x1d7ea3d89ea1c0f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483354.433394:0:22785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69d0401600/0x1d7ea3d89ea1c0f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483354.433404:0:22785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69d0401600/0x1d7ea3d89ea1c0f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483354.433416:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098801408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788483354.433440:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483354.433453:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788483354.433552:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098801408 00000100:00100000:1.0:1788483354.433557:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098801408 00000100:00100000:1.0:1788483354.433600:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788483354.433607:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+17:22785:x1875360098801408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788483354.433616:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483354.433628:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1c0f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1c0f1 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483354.433648:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1c0f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c0f1 expref: 18 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483354.433658:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1c0f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c0f1 expref: 18 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483354.433667:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8a400, rc 0) 00000100:00100000:1.0:1788483354.433695:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:22785:x1875360098801408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483354.433701:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788483354.434287:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098801408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483354.434301:0:22785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69d0401600/0x1d7ea3d89ea1c0f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c0f8 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483354.434311:0:22785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69d0401600/0x1d7ea3d89ea1c0f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1c0f8 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483354.434366:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098801536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788483354.434399:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483354.434431:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788483354.434489:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098801536 00000100:00100000:1.0:1788483354.434494:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098801536 00000100:00100000:1.0:1788483354.434529:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788483354.434537:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c7547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:22785:x1875360098801536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788483354.434550:0:22783:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788483354.434563:0:22783:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788483354.434566:0:22783:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1788483354.434640:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c7547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:22785:x1875360098801536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483354.434647:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788483354.434788:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098801536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788483354.434825:0:22785:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788483354.434831:0:22785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69d0401600/0x1d7ea3d89ea1c0f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c0f8 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483354.434839:0:22785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69d0401600/0x1d7ea3d89ea1c0f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c0f8 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483354.488679:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788483354.491542:0:23542:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788483354.943722:0:22830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e840 going to sleep for 0 seconds 00010000:00010000:0.0:1788483355.515276:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483355.960810:0:22830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e840 going to sleep for 0 seconds 00010000:00010000:0.0:1788483356.537874:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483356.984641:0:22830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e840 going to sleep for 0 seconds 00000001:02000400:1.0:1788483357.138965:0:23793:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg654-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788483357.433164:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788483357.433187:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098801664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788483357.433303:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483357.433461:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098801664 00000100:00100000:1.0:1788483357.433469:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098801664 00000100:00100000:1.0:1788483357.433522:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788483357.433531:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098801664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788483357.433573:0:22793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788483357.433625:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098801664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483357.433632:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788483357.433678:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098801664:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788483357.562072:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788483357.944565:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788483357.944572:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788483357.944575:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a69d25dd000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483357.944586:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a69d25dd000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483357.944610:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69d0f20700 x1875360098801920/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788483357.944624:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483357.944628:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483357.944673:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483357.944677:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483357.944705:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483357.944709:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483357.944712:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483357.944715:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788483357.944743:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098802176:0@lo:400:kworker.0 00000100:00100000:3.0:1788483357.944837:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098802048:0@lo:400:kworker.0 00000100:00100000:0.0:1788483357.944883:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483357.947979:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3621:1875360098801792:0@lo:400:kworker.0 00000100:00100000:3.0:1788483357.948874:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483357.948939:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098801920:0@lo:38:kworker.0 00000100:00100000:3.0:1788483357.948974:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483357.949007:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098802304:0@lo:400:kworker.0 00000100:00100000:3.0:1788483357.949030:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483357.949065:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098802048 00000100:00100000:3.0:1788483357.949073:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098802048 00000100:00100000:3.0:1788483357.949127:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098802304 00000100:00100000:3.0:1788483357.949130:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098802304 00000100:00100000:3.0:1788483357.949147:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788483357.949155:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098802048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483357.949206:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098802048:12345-0@lo:400:kworker.0 Request processed in 51us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483357.949223:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788483357.949239:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788483357.949245:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098802304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483357.949275:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098802304:12345-0@lo:400:kworker.0 Request processed in 30us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483357.949295:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788483357.949323:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098802176 00000100:00100000:3.0:1788483357.949327:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098802176 00000100:00100000:3.0:1788483357.949348:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098801920 00000100:00100000:3.0:1788483357.949351:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098801920 00000100:00100000:3.0:1788483357.949361:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788483357.949366:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098802176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483357.949398:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098802176:12345-0@lo:400:kworker.0 Request processed in 31us (4515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483357.949404:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788483357.949415:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788483357.949418:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1875360098801920:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788483357.949566:0:22793:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 650 last 0 00000020:00000080:3.0:1788483357.949600:0:22793:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d7ea3d89ea1c0ff 00000004:00100000:3.0:1788483357.949613:0:22793:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788483357.949618:0:22793:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:3.0:1788483357.949704:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a69d0f20a80 x1875360098802304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483357.949716:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098802304:0@lo:400:kworker.0 00010000:00080000:3.0:1788483357.949741:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a69d0f21180 x1875360098802048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483357.949757:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098802048:0@lo:400:kworker.0 00000100:00100000:0.0:1788483357.951462:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098802176:0@lo:400:kworker.0 00000100:00080000:0.0:1788483357.960571:0:22793:0:(import.c:65:import_set_state_nolock()) ffff9a68c331a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788483357.960668:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3618:x1875360098801920:12345-0@lo:38:kworker.0 Request processed in 11246us (11691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483357.960678:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788483357.960732:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788483357.960740:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788483357.960746:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788483357.960748:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69d25dd000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788483357.960761:0:3618:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000004df2cf39): req@ffff9a69ffefbb80 x1875360098794880/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483357.960783:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098801920:0@lo:38:kworker.0 00000100:00100000:0.0:1788483357.960833:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788483357.960844:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098802432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788483357.960878:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483357.960906:0:23530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098802432 00000100:00100000:0.0:1788483357.960912:0:23530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098802432 00000100:00100000:0.0:1788483357.960941:0:23530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788483357.960949:0:23530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1875360098802432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788483357.960975:0:23530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788483357.961013:0:23530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1875360098802432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483357.961019:0:23530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788483357.961048:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098802432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483357.961182:0:22830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483357.961201:0:22830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c365e840 going to sleep for 11 seconds 00000100:00100000:2.0:1788483357.961215:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098794880 00000100:00100000:2.0:1788483357.961218:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098794880 00000100:00100000:2.0:1788483357.961241:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788483357.961247:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22830:x1875360098794880:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788483357.961538:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22830:x1875360098794880:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 291us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483357.961545:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788483357.961583:0:22830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22830:1875360098794880:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788483357.961613:0:22830:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788483357.961644:0:22830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22830:1875360098802560:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788483357.961672:0:22830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483357.961695:0:22830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788483357.961705:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098802560 00000100:00100000:2.0:1788483357.961709:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098802560 00000100:00100000:2.0:1788483357.961726:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788483357.961747:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffefad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22830:x1875360098802560:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788483357.961851:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffefad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22830:x1875360098802560:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 104us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483357.961858:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788483357.961880:0:22830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22830:1875360098802560:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788483357.961936:0:22830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22830:1875360098802688:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788483357.961957:0:22830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483357.961970:0:22830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788483357.961980:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098802688 00000100:00100000:2.0:1788483357.961983:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098802688 00000100:00100000:2.0:1788483357.961999:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788483357.962004:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffefb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22830:x1875360098802688:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788483357.962045:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffefb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22830:x1875360098802688:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 40us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483357.962051:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788483357.962072:0:22830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22830:1875360098802688:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788483357.962133:0:22830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788483357.973429:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483357.973472:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098801792 00000100:00100000:3.0:1788483357.973480:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098801792 00000100:00100000:3.0:1788483357.973523:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788483357.973532:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c7546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:3621:x1875360098801792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483357.973586:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c7546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:3621:x1875360098801792:12345-0@lo:400:kworker.0 Request processed in 55us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483357.973593:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788483357.973653:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3621:1875360098801792:0@lo:400:kworker.0 00000040:00080000:2.0:1788483357.974374:0:22830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788483357.974435:0:22830:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:2.0:1788483357.974441:0:22830:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:3.0:1788483358.078324:0:23845:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788483358.081513:0:23845:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788483358.585414:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788483358.982474:0:23896:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788483358.984010:0:23896:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788483359.608547:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788483360.183942:0:23944:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb2f48610 20000000:00000080:1.0:1788483360.183959:0:23944:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a69c86aac00 uarg=0000000000000000 20000000:01000000:1.0:1788483360.184013:0:23944:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788483360.184021:0:23944:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788483360.184026:0:23944:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788483360.191186:0:23945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1788483360.191473:0:23944:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788483360.206799:0:23944:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788483360.206836:0:23944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c106 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483360.206859:0:23944:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69d0400600/0x1d7ea3d89ea1bfaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1bfa8 expref: 17 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483360.206867:0:23944:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69edb8a200/0x1d7ea3d89ea1c0b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c0ab expref: 17 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483360.206876:0:23944:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c106 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483360.206933:0:23944:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69edb8a200/0x1d7ea3d89ea1c0b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1c0ab expref: 17 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483360.206969:0:23944:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69edb8a200/0x1d7ea3d89ea1c0b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c0ab expref: 17 pid: 22780 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483360.206994:0:23944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5264700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23944:1875360098802816:0@lo:104: 00000100:00100000:3.0:1788483360.208736:0:23944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788483360.208927:0:23944:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69d0400600/0x1d7ea3d89ea1bfaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1bfa8 expref: 17 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483360.208944:0:23944:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69d0400600/0x1d7ea3d89ea1bfaf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1bfa8 expref: 17 pid: 22782 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483360.208961:0:23944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5264380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23944:1875360098802944:0@lo:104: 00000100:00100000:3.0:1788483360.209014:0:23944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483360.212203:0:23944:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483360.219524:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098802816 00000100:00100000:0.0:1788483360.219547:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098802816 00000100:00100000:0.0:1788483360.219624:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098802944 00000100:00100000:0.0:1788483360.219628:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098802944 00000100:00100000:0.0:1788483360.219650:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788483360.219663:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5267800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+4:23944:x1875360098802816:12345-0@lo:104: 00010000:00010000:0.0:1788483360.219686:0:22772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0400/0x1d7ea3d89ea1c0ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1c0b2 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483360.219836:0:22772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788483360.219843:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5267800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+4:23944:x1875360098802816:12345-0@lo:104: Request processed in 183us (11119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483360.219851:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788483360.219872:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788483360.219879:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5267100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+3:23944:x1875360098802944:12345-0@lo:104: 00010000:00010000:0.0:1788483360.219888:0:22772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1bfa8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1bfaf expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483360.219908:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483360.219917:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0400/0x1d7ea3d89ea1c0ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1c0b2 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483360.219926:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0400 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:2.0:1788483360.219931:0:22777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0400/0x1d7ea3d89ea1c0ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1c0b2 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483360.219932:0:22772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788483360.219936:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5267100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+3:23944:x1875360098802944:12345-0@lo:104: Request processed in 59us (10923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483360.219942:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788483360.219961:0:22777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0400/0x1d7ea3d89ea1c0ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1c0b2 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483360.219970:0:22777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0400/0x1d7ea3d89ea1c0ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1c0b2 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483360.219976:0:22777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788483360.220024:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483360.220026:0:22777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0400/0x1d7ea3d89ea1c0ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c0b2 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483360.220033:0:22777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788483360.220063:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0400/0x1d7ea3d89ea1c0ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c0b2 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483360.220070:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0400/0x1d7ea3d89ea1c0ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c0b2 expref: -99 pid: 23521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483360.220088:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483360.220090:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483360.220091:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483360.220122:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788483360.220139:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3621:1875360098803072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483360.220210:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788483360.220220:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483360.220226:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1bfa8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1bfaf expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483360.220233:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0200 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788483360.220242:0:22776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1bfa8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1bfaf expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483360.220249:0:22776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1bfa8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1bfaf expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788483360.220255:0:22776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1bfa8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1bfaf expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483360.220261:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098803072 10000000:01000000:0.0:1788483360.220261:0:22776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788483360.220265:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098803072 00010000:00010000:0.0:1788483360.220280:0:22776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1bfa8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1bfaf expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483360.220286:0:22776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788483360.220309:0:22773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69edb8a200/0x1d7ea3d89ea1c0b2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c0ab expref: 18 pid: 22780 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483360.220313:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1bfa8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1bfaf expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483360.220319:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1bfa8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1bfaf expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483360.220334:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788483360.220335:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483360.220336:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483360.220338:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483360.220347:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:3621:x1875360098803072:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788483360.220348:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3619:1875360098803200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483360.220360:0:22773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483360.220366:0:22773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69edb8a200/0x1d7ea3d89ea1c0b2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c0ab expref: 18 pid: 22780 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483360.220375:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788483360.220379:0:22773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69edb8a200/0x1d7ea3d89ea1c0b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c0ab expref: 18 pid: 22780 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483360.220403:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483360.220405:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483360.220412:0:22773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483360.220432:0:23548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098803200 00000100:00100000:0.0:1788483360.220435:0:23548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098803200 00000100:00100000:2.0:1788483360.220448:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+19:3621:x1875360098803072:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (239us total) trans 0 rc 0/0 00010000:00010000:0.0:1788483360.220449:0:23548:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69d0400600/0x1d7ea3d89ea1bfaf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1bfa8 expref: 19 pid: 22782 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483360.220455:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788483360.220479:0:23548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788483360.220486:0:23548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:3619:x1875360098803200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788483360.220494:0:23548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483360.220498:0:23548:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69d0400600/0x1d7ea3d89ea1bfaf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1bfa8 expref: 18 pid: 22782 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483360.220506:0:23548:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69d0400600/0x1d7ea3d89ea1bfaf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1bfa8 expref: 18 pid: 22782 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483360.220517:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3621:1875360098803072:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788483360.220519:0:23548:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c106 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483360.220527:0:23548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c106 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483360.220542:0:23548:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c106 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483360.220550:0:23548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c106 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483360.220558:0:23548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c106 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483360.220564:0:23548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c106 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483360.220569:0:23548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483360.220573:0:23548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c106 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483360.220588:0:23548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c106 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483360.220597:0:23548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c106 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483360.220608:0:23548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483360.220647:0:23548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:3619:x1875360098803200:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483360.220655:0:23548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788483360.220767:0:23944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69edb8a200/0x1d7ea3d89ea1c0b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c0ab expref: 17 pid: 22780 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483360.220780:0:23944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5264700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23944:1875360098802816:0@lo:104: 00010000:00010000:3.0:1788483360.220791:0:23944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69d0400600/0x1d7ea3d89ea1bfaf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1bfa8 expref: 16 pid: 22782 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483360.220800:0:23944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5264380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23944:1875360098802944:0@lo:104: 00010000:00010000:3.0:1788483360.220816:0:23944:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c106 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483360.220826:0:23944:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c106 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483360.220843:0:23944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c106 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483360.220849:0:23944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c106 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483360.221415:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3619:1875360098803200:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788483360.633513:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788483361.021772:0:22826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788483361.656650:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788483361.656800:0:22785:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788483361.656806:0:22785:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69efd92000 from 13 10000000:01000000:0.0:1788483361.656812:0:22785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788483361.656876:0:22785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69d0400e00/0x1d7ea3d89ea1c10d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483361.656890:0:22785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69d0400e00/0x1d7ea3d89ea1c10d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483361.656905:0:22785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69d0400e00/0x1d7ea3d89ea1c10d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483361.656938:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098803328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788483361.657032:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483361.657142:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d1bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483361.657212:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098803328 00000100:00100000:1.0:1788483361.657221:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098803328 00000100:00100000:1.0:1788483361.657286:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788483361.657307:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c7545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+16:22785:x1875360098803328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788483361.657322:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483361.657339:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69edb8b200/0x1d7ea3d89ea1c114 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1c10d expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483361.657367:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69edb8b200/0x1d7ea3d89ea1c114 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c10d expref: 17 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483361.657380:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69edb8b200/0x1d7ea3d89ea1c114 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c10d expref: 17 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483361.657391:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8b200, rc 0) 00000100:00100000:1.0:1788483361.657445:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c7545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+17:22785:x1875360098803328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483361.657453:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788483361.657645:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098803328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483361.657663:0:22785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69d0400e00/0x1d7ea3d89ea1c10d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c114 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483361.657684:0:22785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69d0400e00/0x1d7ea3d89ea1c10d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1c114 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483361.657757:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098803456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483361.657786:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483361.657814:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d1bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483361.657870:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098803456 00000100:00100000:3.0:1788483361.657876:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098803456 00000100:00100000:3.0:1788483361.657914:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788483361.657921:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c7546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+17:22785:x1875360098803456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788483361.658074:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c7546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+17:22785:x1875360098803456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483361.658081:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788483361.658221:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098803456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483361.658256:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098803584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788483361.658315:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483361.658345:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d1bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483361.658395:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098803584 00000100:00100000:3.0:1788483361.658400:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098803584 00000100:00100000:3.0:1788483361.658438:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788483361.658446:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c7547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+17:22785:x1875360098803584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788483361.658563:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c7547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+17:22785:x1875360098803584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483361.658570:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788483361.658719:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098803584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788483361.659692:0:24006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788483361.659939:0:22785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788483361.659969:0:22785:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788483361.659981:0:22785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69d0400e00/0x1d7ea3d89ea1c10d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c114 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483361.659993:0:22785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69d0400e00/0x1d7ea3d89ea1c10d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c114 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483361.660022:0:22785:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788483361.660025:0:22785:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a68c4d04800 from 13 10000000:01000000:3.0:1788483361.660028:0:22785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788483361.660063:0:22785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c11b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483361.660071:0:22785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c11b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483361.660081:0:22785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c11b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483361.660156:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5264380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098803712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788483361.660221:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483361.660255:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c25fd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483361.660335:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098803712 00000100:00100000:0.0:1788483361.660343:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098803712 00000100:00100000:0.0:1788483361.660397:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788483361.660406:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c7544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+17:22785:x1875360098803712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483361.660419:0:22782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483361.660433:0:22782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69d0401c00/0x1d7ea3d89ea1c122 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1c11b expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483361.660460:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69d0401c00/0x1d7ea3d89ea1c122 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c11b expref: 18 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483361.660469:0:22782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69d0401c00/0x1d7ea3d89ea1c122 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c11b expref: 18 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483361.660478:0:22782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69d0401c00, rc 0) 00000100:00100000:0.0:1788483361.660537:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c7544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:22785:x1875360098803712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483361.660552:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788483361.660768:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5264380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098803712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788483361.660784:0:22785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c11b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c122 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483361.660794:0:22785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c11b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1c122 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483361.660866:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5264380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098803840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788483361.660898:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483361.660923:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c25fd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483361.661794:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098803840 00000100:00100000:0.0:1788483361.661807:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098803840 00000100:00100000:0.0:1788483361.661875:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788483361.661885:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c7544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:22785:x1875360098803840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483361.662072:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c7544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:22785:x1875360098803840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483361.662079:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788483361.662731:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5264380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098803840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788483361.662795:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098803968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788483361.662868:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483361.662912:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd2240 going to sleep for 11 seconds 00000100:00100000:0.0:1788483361.663244:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098803968 00000100:00100000:0.0:1788483361.663252:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098803968 00000100:00100000:0.0:1788483361.663313:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788483361.663322:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c7547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:22785:x1875360098803968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788483361.663459:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c7547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:22785:x1875360098803968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483361.663468:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788483361.663986:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098803968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788483361.665314:0:24007:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788483361.666305:0:22785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788483361.666354:0:22785:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788483361.666368:0:22785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c11b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c122 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483361.666401:0:22785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c11b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c122 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483362.042464:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483352/real 1788483352] req@ffff9a69d0f23b80 x1875360098798080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483362 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483362.042509:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a69d0f23b80 x1875360098798080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483362 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483362.042521:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483352/real 1788483352] req@ffff9a69ffef9180 x1875360098797952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483362 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483362.042534:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a69ffef9180 x1875360098797952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483362 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788483362.042650:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69e8faa800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483362.043058:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788483362.043064:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098798080:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788483362.043071:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c1d33000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788483362.046631:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483362.046639:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788483362.046643:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483362.046646:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788483362.046663:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483362.046667:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788483362.046672:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a68c1d33000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788483362.046682:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 644 00000100:00080000:1.0:1788483362.046736:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788483362.046779:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a68c1d33000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788483362.046838:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69efe9df80 x1875360098804608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788483362.046852:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483362.046882:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788483362.046884:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a69e8faa800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788483362.046888:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 644 00000100:00080000:1.0:1788483362.046899:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788483362.046904:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a69e8faa800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788483362.048390:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69efe9e680 x1875360098804736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788483362.048458:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3620:1875360098804096:0@lo:400:kworker.0 00000100:00100000:1.0:1788483362.048554:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788483362.048691:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788483362.048698:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098797952:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788483362.048713:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098804352:0@lo:400:kworker.0 00000100:00100000:0.0:1788483362.048749:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483362.048793:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788483362.048799:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098804224:0@lo:400:kworker.0 00000100:00100000:0.0:1788483362.048827:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483362.048863:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098804352 00000100:00100000:0.0:1788483362.048872:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098804352 00000100:00100000:0.0:1788483362.048998:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788483362.049013:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098804352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483362.049076:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098804352:12345-0@lo:400:kworker.0 Request processed in 67us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483362.049085:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788483362.049149:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a69efe9ca80 x1875360098804352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483362.049164:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098804352:0@lo:400:kworker.0 00000100:00100000:0.0:1788483362.049200:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098804608:0@lo:8:kworker.0 00000400:00000100:0.0:1788483362.049229:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875360098804608 offset 0 length 520: 4 00000100:00100000:0.0:1788483362.049406:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098804736:0@lo:8:kworker.0 00000400:00000100:0.0:1788483362.049782:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875360098804736 offset 0 length 520: 4 00000100:00100000:1.0:1788483362.049912:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098804864:0@lo:400:kworker.0 00000100:00100000:1.0:1788483362.050015:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483362.050051:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788483362.050059:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098804480:0@lo:400:kworker.0 00000100:00100000:1.0:1788483362.050084:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483362.050141:0:23530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098804224 00000100:00100000:1.0:1788483362.050148:0:23530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098804224 00000100:00100000:0.0:1788483362.050228:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098804864 00000100:00100000:0.0:1788483362.050232:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098804864 00000100:00100000:0.0:1788483362.050701:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788483362.050714:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098804864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483362.050780:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098804864:12345-0@lo:400:kworker.0 Request processed in 68us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483362.050788:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788483362.050850:0:23530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098804480 00000100:00100000:1.0:1788483362.050855:0:23530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098804480 00000100:00100000:1.0:1788483362.050878:0:23530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788483362.050885:0:23530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1875360098804224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483362.051006:0:23530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1875360098804224:12345-0@lo:400:kworker.0 Request processed in 120us (2176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483362.051027:0:23530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788483362.051042:0:23530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788483362.051048:0:23530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098804480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483362.051080:0:23530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098804480:12345-0@lo:400:kworker.0 Request processed in 32us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483362.051086:0:23530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788483362.051156:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098804480:0@lo:400:kworker.0 00010000:00080000:1.0:1788483362.051171:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a69efe9d880 x1875360098804864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483362.051183:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098804864:0@lo:400:kworker.0 00000100:00080000:1.0:1788483362.051216:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483362.051220:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788483362.051223:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483362.051226:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788483362.051688:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098804224:0@lo:400:kworker.0 00000100:00100000:3.0:1788483362.051805:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098804096 00000100:00100000:3.0:1788483362.051812:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098804096 00000100:00100000:3.0:1788483362.051916:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788483362.051925:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c7546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:3620:x1875360098804096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483362.051997:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c7546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:3620:x1875360098804096:12345-0@lo:400:kworker.0 Request processed in 74us (3443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483362.052005:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788483362.052078:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3620:1875360098804096:0@lo:400:kworker.0 00000100:00100000:2.0:1788483362.555201:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098804992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788483362.555302:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483362.555374:0:23530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098804992 00000100:00100000:2.0:1788483362.555383:0:23530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098804992 00000100:00100000:2.0:1788483362.555443:0:23530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788483362.555454:0:23530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098804992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788483362.555496:0:23530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788483362.555556:0:23530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098804992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483362.555564:0:23530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788483362.555614:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098804992:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788483362.680339:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483363.064389:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098805120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788483363.064485:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483363.064567:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098805120 00000100:00100000:0.0:1788483363.064578:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098805120 00000100:00100000:0.0:1788483363.064637:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788483363.064648:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1875360098805120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788483363.064710:0:22794:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788483363.064761:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1875360098805120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483363.064769:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788483363.064824:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098805120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483363.064914:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483348/real 1788483348] req@ffff9a69f5266680 x1875360098795904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483363 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483363.064937:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a69f5266680 x1875360098795904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483363 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483363.064947:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483348/real 1788483348] req@ffff9a69f5266300 x1875360098796032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483363 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483363.064958:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a69f5266300 x1875360098796032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483363 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788483363.064973:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c27c2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788483363.065003:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788483363.065007:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098795904:0@lo:8:kworker.0 00000100:00080000:2.0:1788483363.065012:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69f8ab9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788483363.065016:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788483363.065019:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098796032:0@lo:8:kworker.0 00000100:00080000:0.0:1788483363.066478:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483363.066485:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788483363.066489:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a68c27c2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483363.066497:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 640 00000100:00080000:0.0:1788483363.066513:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788483363.066522:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a68c27c2000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483363.066566:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69d0f21880 x1875360098805376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788483363.066585:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483363.066589:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788483363.066590:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a69f8ab9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483363.066593:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 640 00000100:00080000:0.0:1788483363.066596:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788483363.066599:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a69f8ab9000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483363.066609:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69d0f21180 x1875360098805504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788483363.066644:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483363.066648:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483363.066651:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483363.066653:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788483363.066695:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098805632:0@lo:400:kworker.0 00000100:00100000:0.0:1788483363.066764:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483363.066811:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788483363.066817:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3620:1875360098805248:0@lo:400:kworker.0 00000100:00100000:0.0:1788483363.066849:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483363.066890:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098805760:0@lo:400:kworker.0 00000100:00100000:0.0:1788483363.066920:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483363.066949:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788483363.066955:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098805888:0@lo:400:kworker.0 00000100:00100000:0.0:1788483363.066978:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483363.067018:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098805632 00000100:00100000:0.0:1788483363.067026:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098805632 00000100:00100000:0.0:1788483363.067080:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098805888 00000100:00100000:0.0:1788483363.067084:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098805888 00000100:00100000:0.0:1788483363.067136:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788483363.067146:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098805632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483363.067199:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098805632:12345-0@lo:400:kworker.0 Request processed in 54us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483363.067207:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788483363.067222:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788483363.067228:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098805888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483363.067260:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098805888:12345-0@lo:400:kworker.0 Request processed in 32us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483363.067267:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788483363.067296:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098805248 00000100:00100000:0.0:1788483363.067300:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098805248 00000100:00100000:0.0:1788483363.067327:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788483363.067334:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c7545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:3620:x1875360098805248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483363.067364:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c7545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:3620:x1875360098805248:12345-0@lo:400:kworker.0 Request processed in 30us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483363.067370:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788483363.067402:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098805760 00000100:00100000:0.0:1788483363.067406:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098805760 00000100:00100000:0.0:1788483363.067428:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788483363.067434:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098805760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483363.067474:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098805760:12345-0@lo:400:kworker.0 Request processed in 40us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483363.067481:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788483363.067534:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3620:1875360098805248:0@lo:400:kworker.0 00010000:00080000:0.0:1788483363.067547:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a69d0f20a80 x1875360098805632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483363.067558:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098805632:0@lo:400:kworker.0 00010000:00080000:0.0:1788483363.067591:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a68c452c700 x1875360098805888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483363.067599:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098805888:0@lo:400:kworker.0 00000100:00100000:0.0:1788483363.067607:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098805760:0@lo:400:kworker.0 00000100:00100000:0.0:1788483363.067625:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098805376:0@lo:8:kworker.0 00000400:00000100:0.0:1788483363.067652:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875360098805376 offset 0 length 520: 4 00000100:00100000:0.0:1788483363.067666:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098805504:0@lo:8:kworker.0 00000400:00000100:0.0:1788483363.067683:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875360098805504 offset 0 length 520: 4 00000001:00100000:0.0:1788483363.579967:0:23522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788483363.704379:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483364.733367:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788483364.741921:0:23542:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788483365.752538:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483366.779888:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483367.672298:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788483367.672322:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098806016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788483367.672406:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483367.672579:0:23530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098806016 00000100:00100000:2.0:1788483367.672589:0:23530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098806016 00000100:00100000:2.0:1788483367.672640:0:23530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788483367.672649:0:23530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098806016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788483367.672684:0:23530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788483367.672734:0:23530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098806016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483367.672741:0:23530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788483367.672826:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098806016:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788483367.800352:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788483368.185750:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483368.185756:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788483368.185759:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483368.185762:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788483368.185794:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483368.185797:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788483368.185799:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483368.185801:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788483368.185832:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3620:1875360098806144:0@lo:400:kworker.0 00000100:00100000:1.0:1788483368.185894:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483368.185939:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098806656:0@lo:400:kworker.0 00000100:00100000:1.0:1788483368.185963:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483368.185987:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788483368.185993:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098806528:0@lo:400:kworker.0 00000100:00100000:1.0:1788483368.186024:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483368.186054:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098806400:0@lo:400:kworker.0 00000100:00100000:1.0:1788483368.186077:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483368.186128:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788483368.186134:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69efe9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098806272:0@lo:400:kworker.0 00000100:00100000:1.0:1788483368.186158:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483368.186190:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098806144 00000100:00100000:1.0:1788483368.186197:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098806144 00000100:00100000:1.0:1788483368.186249:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788483368.186268:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:3620:x1875360098806144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483368.186316:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:3620:x1875360098806144:12345-0@lo:400:kworker.0 Request processed in 59us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483368.186322:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788483368.186352:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098806656 00000100:00100000:1.0:1788483368.186362:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098806656 00000100:00100000:1.0:1788483368.186385:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098806400 00000100:00100000:1.0:1788483368.186388:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098806400 00000100:00100000:1.0:1788483368.186402:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788483368.186408:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098806656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483368.186438:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098806656:12345-0@lo:400:kworker.0 Request processed in 31us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483368.186445:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788483368.186455:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788483368.186460:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098806400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483368.186486:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098806400:12345-0@lo:400:kworker.0 Request processed in 26us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483368.186493:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788483368.186509:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098806528 00000100:00100000:1.0:1788483368.186512:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098806528 00000100:00100000:1.0:1788483368.186531:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098806272 00000100:00100000:1.0:1788483368.186533:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098806272 00000100:00100000:1.0:1788483368.186544:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788483368.186550:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098806528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483368.186578:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098806528:12345-0@lo:400:kworker.0 Request processed in 29us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483368.186585:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788483368.186597:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788483368.186603:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098806272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483368.186630:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098806272:12345-0@lo:400:kworker.0 Request processed in 27us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483368.186636:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788483368.186684:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098806272:0@lo:400:kworker.0 00010000:00080000:1.0:1788483368.186697:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a69efe9f800 x1875360098806400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483368.186707:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098806400:0@lo:400:kworker.0 00000100:00100000:1.0:1788483368.186735:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098806528:0@lo:400:kworker.0 00000100:00100000:1.0:1788483368.186743:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3620:1875360098806144:0@lo:400:kworker.0 00010000:00080000:1.0:1788483368.186752:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a69efe9ca80 x1875360098806656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483368.186760:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098806656:0@lo:400:kworker.0 00000100:00100000:3.0:1788483368.187151:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788483368.187164:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098806784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788483368.187197:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483368.187267:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098806784 00000100:00100000:0.0:1788483368.187272:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098806784 00000100:00100000:0.0:1788483368.187309:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788483368.187316:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098806784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788483368.187354:0:22794:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788483368.187393:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098806784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483368.187401:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788483368.187431:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098806784:0@lo:41:osp-pre-1-0.0 00000020:01000004:1.0:1788483368.291836:0:24293:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788483368.291839:0:24293:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788483368.291841:0:24293:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788483368.291946:0:24293:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a69efe13000 00000020:01000004:1.0:1788483368.291961:0:24293:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788483368.291973:0:24293:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788483368.291985:0:24293:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a69df0b3370) 00000020:00000080:1.0:1788483368.292001:0:24293:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788483368.402411:0:24293:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788483368.411777:0:24293:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788483368.418417:0:24293:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788483368.419717:0:24293:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788483368.420476:0:24293:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788483368.421588:0:24293:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788483368.421837:0:24293:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1788483368.427409:0:24293:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788483368.427608:0:24293:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788483368.427622:0:24293:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788483368.427634:0:24293:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1d7ea3d89ea1c130 00000020:01000004:2.0:1788483368.427640:0:24293:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788483368.427660:0:24293:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.154@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788483368.427663:0:24293:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788483368.427669:0:24293:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788483368.427674:0:24293:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788483368.427702:0:24293:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a69c86bcd28) 00000020:00000080:2.0:1788483368.427713:0:24293:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788483368.439969:0:24293:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788483368.440385:0:24293:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788483368.440391:0:24293:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788483368.448007:0:24293:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788483368.448020:0:24293:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788483368.448651:0:24293:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788483368.448658:0:24293:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788483368.450166:0:24293:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788483368.450369:0:24293:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788483368.450375:0:24293:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788483368.451766:0:24293:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788483368.451776:0:24293:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788483368.474465:0:24293:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788483368.474701:0:24293:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788483368.474707:0:24293:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788483368.478740:0:24293:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788483368.478757:0:24293:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788483368.480794:0:24293:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788483368.480805:0:24293:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788483368.483034:0:24293:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788483368.483571:0:24293:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788483368.483579:0:24293:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788483368.485085:0:24293:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788483368.485121:0:24293:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788483368.551947:0:24293:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788483368.552382:0:24293:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788483368.552390:0:24293:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788483368.561533:0:24293:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788483368.561554:0:24293:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788483368.562150:0:24293:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788483368.562220:0:24293:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788483368.562400:0:24293:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.154@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788483368.585212:0:24293:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.154@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788483368.585314:0:24293:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.154@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788483368.585319:0:24293:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788483368.585321:0:24293:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788483368.585322:0:24293:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788483368.585324:0:24293:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788483368.585325:0:24293:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788483368.585326:0:24293:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788483368.585328:0:24293:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788483368.585330:0:24293:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788483368.585331:0:24293:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788483368.585334:0:24293:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788483368.585337:0:24293:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788483368.585338:0:24293:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788483368.585340:0:24293:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788483368.585341:0:24293:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788483368.585342:0:24293:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788483368.585343:0:24293:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788483368.585344:0:24293:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788483368.585345:0:24293:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788483368.585346:0:24293:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788483368.585369:0:24293:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788483368.585389:0:24293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098806912:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788483368.585453:0:24293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483368.585559:0:24293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c25fdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788483368.590350:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098806912 00000100:00100000:2.0:1788483368.590365:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098806912 00000100:00100000:2.0:1788483368.590418:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788483368.590428:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:24293:x1875360098806912:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788483368.590462:0:22783:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788483368.590465:0:22783:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788483368.590469:0:22783:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788483368.590990:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:24293:x1875360098806912:12345-0@lo:253:mount.lustre.0 Request processed in 562us (5534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483368.590999:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788483368.591147:0:24293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098806912:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788483368.591161:0:24293:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788483368.591164:0:24293:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788483368.591166:0:24293:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788483368.591167:0:24293:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788483368.591168:0:24293:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788483368.591169:0:24293:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788483368.591171:0:24293:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788483368.591172:0:24293:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788483368.591174:0:24293:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788483368.591175:0:24293:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788483368.591194:0:24293:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a69efe13000 from lustre-OST0000 10000000:01000000:0.0:1788483368.591233:0:24293:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788483368.591237:0:24293:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788483368.591245:0:24293:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a69e00999b8 local copy 00010000:00010000:0.0:1788483368.591262:0:24293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27400/0x1d7ea3d89ea1beeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bef2 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483368.591387:0:24293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098807040:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483368.591421:0:24293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483368.591449:0:24293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecf0d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788483368.591760:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098807040 00000100:00100000:2.0:1788483368.591766:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098807040 00000100:00100000:2.0:1788483368.591803:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788483368.591811:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:24293:x1875360098807040:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483368.591886:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:24293:x1875360098807040:12345-0@lo:501:mount.lustre.0 Request processed in 75us (464us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788483368.591894:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788483368.591994:0:24293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098807040:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788483368.592007:0:24293:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788483368.592024:0:24293:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788483368.592030:0:24293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27400/0x1d7ea3d89ea1beeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bef2 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.592039:0:24293:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27400/0x1d7ea3d89ea1beeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bef2 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483368.592063:0:24293:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a69efe13000 10000000:01000000:0.0:1788483368.592074:0:24293:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788483368.592080:0:24293:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788483368.592082:0:24293:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788483368.592087:0:24293:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788483368.592091:0:24293:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788483368.592160:0:24293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69d0400600/0x1d7ea3d89ea1c13e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.592169:0:24293:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69d0400600/0x1d7ea3d89ea1c13e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.592178:0:24293:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69d0400600/0x1d7ea3d89ea1c13e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483368.592191:0:24293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098807168:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788483368.592218:0:24293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483368.592479:0:24293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecf0d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788483368.592526:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098807168 00000100:00100000:2.0:1788483368.592532:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098807168 00000100:00100000:2.0:1788483368.592564:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788483368.592571:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+18:24293:x1875360098807168:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788483368.592580:0:22783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483368.592592:0:22783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecf26400/0x1d7ea3d89ea1c145 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1c13e expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483368.592613:0:22783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecf26400/0x1d7ea3d89ea1c145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c13e expref: 19 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483368.592632:0:22783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecf26400/0x1d7ea3d89ea1c145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c13e expref: 19 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483368.592640:0:22783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf26400, rc 0) 00000100:00100000:2.0:1788483368.592681:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+19:24293:x1875360098807168:12345-0@lo:101:mount.lustre.0 Request processed in 110us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483368.592688:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788483368.592827:0:24293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098807168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483368.592839:0:24293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69d0400600/0x1d7ea3d89ea1c13e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c145 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483368.592848:0:24293:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69d0400600/0x1d7ea3d89ea1c13e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1c145 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788483368.593836:0:24293:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1788483368.594664:0:24293:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788483368.598064:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788483368.600134:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788483368.600179:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788483368.600195:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788483368.600263:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788483368.600283:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788483368.600298:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788483368.600312:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788483368.600322:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1788483368.600332:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1788483368.600350:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1788483368.600398:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1788483368.600438:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1788483368.600467:0:24293:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1788483368.600665:0:24293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5265180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098807296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483368.600744:0:24293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483368.600798:0:24293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788483368.600821:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098807296 00000100:00100000:1.0:1788483368.600828:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098807296 00000100:00100000:1.0:1788483368.600894:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788483368.600903:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+19:24293:x1875360098807296:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483368.601041:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+19:24293:x1875360098807296:12345-0@lo:501:mount.lustre.0 Request processed in 138us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483368.601049:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788483368.601591:0:24293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5265180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098807296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483368.601636:0:24293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5265180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098807424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788483368.601690:0:24293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483368.601758:0:24293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788483368.601824:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098807424 00000100:00100000:1.0:1788483368.601829:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098807424 00000100:00100000:1.0:1788483368.601882:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788483368.601891:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+19:24293:x1875360098807424:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788483368.602836:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+19:24293:x1875360098807424:12345-0@lo:503:mount.lustre.0 Request processed in 942us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483368.602857:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788483368.602961:0:24293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5265180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098807424:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788483368.603411:0:24293:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788483368.603480:0:24293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5265180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098807552:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788483368.603548:0:24293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483368.603575:0:24293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788483368.603866:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098807552 00000100:00100000:2.0:1788483368.603874:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098807552 00000100:00100000:2.0:1788483368.603918:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788483368.603927:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ca988050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+19:24293:x1875360098807552:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483368.604473:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ca988050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+19:24293:x1875360098807552:12345-0@lo:502:mount.lustre.0 Request processed in 544us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483368.604482:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788483368.604597:0:24293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5265180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098807552:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788483368.604774:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788483368.604802:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788483368.604833:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788483368.604862:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788483368.604876:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788483368.604888:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788483368.604901:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788483368.604914:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788483368.604928:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1788483368.604941:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1788483368.604953:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1788483368.604964:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1788483368.604992:0:24293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5265180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098807680:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788483368.605033:0:24293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483368.605058:0:24293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788483368.605341:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098807680 00000100:00100000:2.0:1788483368.605348:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098807680 00000100:00100000:2.0:1788483368.605387:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788483368.605395:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d463fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+19:24293:x1875360098807680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483368.605680:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d463fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+19:24293:x1875360098807680:12345-0@lo:502:mount.lustre.0 Request processed in 285us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483368.605689:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788483368.605756:0:24293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5265180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098807680:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788483368.605804:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1788483368.605814:0:24293:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788483368.614826:0:24310:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788483368.614837:0:24310:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788483368.614855:0:24310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483368.614857:0:24310:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788483368.614870:0:24310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788483368.614884:0:24310:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a69f45ecd28) 00000020:00000080:1.0:1788483368.614909:0:24310:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788483368.614914:0:24310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788483368.614978:0:24310:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a69efe13000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788483368.614987:0:24310:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788483368.614993:0:24310:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1d7ea3d89ea1c153 00010000:00010000:1.0:1788483368.623745:0:24310:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788483368.625451:0:24310:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:1.0:1788483368.627857:0:24310:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1788483368.635010:0:24310:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788483368.635023:0:24310:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788483368.635029:0:24310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483368.635031:0:24310:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788483368.635034:0:24310:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788483368.635036:0:24310:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1788483368.635038:0:24310:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788483368.635039:0:24310:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788483368.635041:0:24310:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788483368.635043:0:24310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483368.635044:0:24310:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788483368.635046:0:24310:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788483368.635048:0:24310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483368.635049:0:24310:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788483368.635052:0:24310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788483368.635054:0:24310:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788483368.635056:0:24310:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788483368.635059:0:24310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483368.635060:0:24310:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788483368.635062:0:24310:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788483368.635064:0:24310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483368.635065:0:24310:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788483368.635068:0:24310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788483368.635121:0:24310:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788483368.635137:0:24310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483368.635138:0:24310:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788483368.635143:0:24310:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1788483368.635290:0:24293:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788483368.635326:0:24293:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788483368.635352:0:24293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69d0400600/0x1d7ea3d89ea1c13e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c145 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483368.635364:0:24293:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69d0400600/0x1d7ea3d89ea1c13e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c145 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483368.635372:0:24293:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69efe13000 from 1 10000000:01000000:3.0:1788483368.635374:0:24293:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788483368.635408:0:24293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1c15a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483368.635421:0:24293:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1c15a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483368.635434:0:24293:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1c15a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483368.635458:0:24293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5265f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098807808:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788483368.635519:0:24293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483368.641007:0:24293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788483368.643993:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098807808 00000100:00100000:1.0:1788483368.644006:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098807808 00000100:00100000:1.0:1788483368.644062:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788483368.644072:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d463d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+19:24293:x1875360098807808:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483368.644087:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483368.644127:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69edb8ac00/0x1d7ea3d89ea1c161 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1c15a expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483368.644155:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69edb8ac00/0x1d7ea3d89ea1c161 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c15a expref: 20 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483368.644165:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69edb8ac00/0x1d7ea3d89ea1c161 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c15a expref: 20 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483368.644174:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8ac00, rc 0) 00000100:00100000:1.0:1788483368.644591:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d463d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+20:24293:x1875360098807808:12345-0@lo:101:mount.lustre.0 Request processed in 520us (9071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483368.644600:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788483368.645667:0:24293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5265f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098807808:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788483368.645694:0:24293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1c15a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c161 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.645706:0:24293:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1c15a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1c161 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788483368.649644:0:24293:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1788483368.651075:0:24293:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788483368.652623:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788483368.652670:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1788483368.652684:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1788483368.652697:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1788483368.652709:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1788483368.652722:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1788483368.652735:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1788483368.652747:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1788483368.652758:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1788483368.652786:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1788483368.652799:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1788483368.652818:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1788483368.652824:0:24293:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1788483368.654301:0:24293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098807936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483368.654364:0:24293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483368.654402:0:24293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c25fda80 going to sleep for 11 seconds 00000100:00100000:3.0:1788483368.655381:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098807936 00000100:00100000:3.0:1788483368.655391:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098807936 00000100:00100000:3.0:1788483368.655436:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788483368.655446:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d463f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+20:24293:x1875360098807936:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483368.655585:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d463f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+20:24293:x1875360098807936:12345-0@lo:501:mount.lustre.0 Request processed in 139us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483368.655593:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788483368.655963:0:24293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098807936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483368.656004:0:24293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098808064:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788483368.656932:0:24293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483368.656980:0:24293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c25fda80 going to sleep for 11 seconds 00000100:00100000:3.0:1788483368.657316:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098808064 00000100:00100000:3.0:1788483368.657324:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098808064 00000100:00100000:3.0:1788483368.657363:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788483368.657372:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c998f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+20:24293:x1875360098808064:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788483368.657493:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c998f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+20:24293:x1875360098808064:12345-0@lo:503:mount.lustre.0 Request processed in 121us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483368.657501:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788483368.658464:0:24293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098808064:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788483368.659832:0:24293:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788483368.660141:0:24293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098808192:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483368.660210:0:24293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483368.661108:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098808192 00000100:00100000:1.0:1788483368.661116:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098808192 00000100:00100000:1.0:1788483368.661167:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788483368.661175:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+20:24293:x1875360098808192:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483368.661681:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+20:24293:x1875360098808192:12345-0@lo:502:mount.lustre.0 Request processed in 505us (1470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483368.661690:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788483368.662429:0:24293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c25fd480 going to sleep for 11 seconds 00000100:00100000:0.0:1788483368.662459:0:24293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098808192:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788483368.662700:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788483368.662733:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1788483368.662759:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1788483368.662773:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1788483368.662787:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1788483368.662799:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1788483368.662813:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1788483368.662824:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1788483368.662836:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1788483368.662864:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1788483368.662877:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1788483368.662921:0:24293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098808320:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483368.662970:0:24293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483368.662996:0:24293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c25fd480 going to sleep for 11 seconds 00000100:00100000:2.0:1788483368.663091:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098808320 00000100:00100000:2.0:1788483368.663138:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098808320 00000100:00100000:2.0:1788483368.663177:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788483368.663184:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+20:24293:x1875360098808320:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483368.663313:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+20:24293:x1875360098808320:12345-0@lo:502:mount.lustre.0 Request processed in 128us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483368.663321:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788483368.665395:0:24293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098808320:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788483368.665483:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1788483368.665496:0:24293:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788483368.666176:0:24314:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483368.666187:0:24314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483368.666189:0:24314:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788483368.666196:0:24314:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a69efe13000 00000020:00000080:3.0:1788483368.666208:0:24314:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788483368.666216:0:24314:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483368.666219:0:24314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483368.666221:0:24314:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788483368.666234:0:24314:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483368.666238:0:24314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483368.666239:0:24314:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788483368.666243:0:24314:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a69efe13000 00000020:00000080:3.0:1788483368.666246:0:24314:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788483368.666308:0:24314:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483368.666311:0:24314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483368.666313:0:24314:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788483368.666316:0:24314:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483368.666319:0:24314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483368.666320:0:24314:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788483368.666324:0:24314:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a69efe13000 00000020:00000080:3.0:1788483368.666326:0:24314:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788483368.666342:0:24314:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483368.666345:0:24314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483368.666346:0:24314:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788483368.666348:0:24314:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483368.666351:0:24314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483368.666352:0:24314:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788483368.666355:0:24314:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a69efe13000 00000020:00000080:3.0:1788483368.666358:0:24314:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788483368.666379:0:24314:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483368.666383:0:24314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483368.666385:0:24314:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788483368.666389:0:24314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1788483368.672016:0:24293:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788483368.672059:0:24293:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788483368.672088:0:24293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1c15a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c161 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.672115:0:24293:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1c15a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c161 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483368.672173:0:24293:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788483368.672177:0:24293:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a69efe13000 10000000:01000000:0.0:1788483368.672180:0:24293:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a69efe13000 10000000:01000000:0.0:1788483368.672184:0:24293:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788483368.672190:0:24293:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a69efe13000 from 1 10000000:01000000:0.0:1788483368.672193:0:24293:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788483368.672237:0:24293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69d0400a00/0x1d7ea3d89ea1c168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.672261:0:24293:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69d0400a00/0x1d7ea3d89ea1c168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.672273:0:24293:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69d0400a00/0x1d7ea3d89ea1c168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483368.672298:0:24293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098808448:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788483368.672357:0:24293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483368.672403:0:24293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c25fda80 going to sleep for 11 seconds 00000100:00100000:1.0:1788483368.673340:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098808448 00000100:00100000:1.0:1788483368.673354:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098808448 00000100:00100000:1.0:1788483368.673646:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788483368.673657:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+20:24293:x1875360098808448:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483368.673672:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483368.673686:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69edb8b400/0x1d7ea3d89ea1c16f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1c168 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483368.673711:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69edb8b400/0x1d7ea3d89ea1c16f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c168 expref: 21 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483368.673720:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69edb8b400/0x1d7ea3d89ea1c16f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c168 expref: 21 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483368.673728:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69edb8b400, rc 0) 00000100:00100000:1.0:1788483368.673782:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:24293:x1875360098808448:12345-0@lo:101:mount.lustre.0 Request processed in 127us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483368.673790:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788483368.674050:0:24293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098808448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788483368.674069:0:24293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69d0400a00/0x1d7ea3d89ea1c168 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c16f expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.674079:0:24293:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69d0400a00/0x1d7ea3d89ea1c168 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1c16f expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788483368.691359:0:24293:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1788483368.693824:0:24293:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788483368.694086:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788483368.694144:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788483368.694158:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788483368.694170:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788483368.694183:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788483368.694195:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788483368.694207:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788483368.694220:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788483368.694249:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788483368.694276:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788483368.694290:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788483368.694302:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788483368.694314:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788483368.694339:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788483368.694351:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788483368.694363:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788483368.694375:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788483368.694385:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788483368.694396:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788483368.694407:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788483368.694418:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788483368.694429:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788483368.694440:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788483368.694451:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788483368.694463:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1788483368.694475:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1788483368.694497:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1788483368.694509:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1788483368.694521:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1788483368.694546:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1788483368.694561:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1788483368.694573:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1788483368.694584:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1788483368.694596:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1788483368.694607:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1788483368.694618:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1788483368.694628:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1788483368.694639:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1788483368.694650:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1788483368.694662:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1788483368.694672:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1788483368.694684:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1788483368.694695:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1788483368.694706:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1788483368.694717:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1788483368.694744:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1788483368.694758:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1788483368.694769:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1788483368.694884:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1788483368.694903:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1788483368.694918:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1788483368.694922:0:24293:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1788483368.695014:0:24293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098808576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483368.695075:0:24293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483368.695144:0:24293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69df22f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788483368.695394:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098808576 00000100:00100000:1.0:1788483368.695401:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098808576 00000100:00100000:1.0:1788483368.695442:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788483368.695451:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:24293:x1875360098808576:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483368.695560:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:24293:x1875360098808576:12345-0@lo:501:mount.lustre.0 Request processed in 110us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483368.695568:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788483368.701241:0:24293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098808576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483368.701311:0:24293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098808704:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788483368.701392:0:24293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483368.701429:0:24293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69df22f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788483368.707792:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098808704 00000100:00100000:1.0:1788483368.707805:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098808704 00000100:00100000:1.0:1788483368.707864:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788483368.707874:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:24293:x1875360098808704:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788483368.708029:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:24293:x1875360098808704:12345-0@lo:503:mount.lustre.0 Request processed in 156us (6636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483368.708038:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788483368.708364:0:24293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098808704:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788483368.708761:0:24293:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788483368.708836:0:24293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098808832:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483368.708887:0:24293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483368.708921:0:24293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69df22f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788483368.709483:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098808832 00000100:00100000:1.0:1788483368.709491:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098808832 00000100:00100000:1.0:1788483368.709532:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788483368.709539:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:24293:x1875360098808832:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483368.709645:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:24293:x1875360098808832:12345-0@lo:502:mount.lustre.0 Request processed in 105us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483368.709653:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788483368.712452:0:24293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098808832:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788483368.712672:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788483368.712702:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1788483368.712718:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1788483368.712730:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1788483368.712742:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1788483368.712755:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1788483368.712767:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1788483368.712796:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1788483368.712811:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788483368.712824:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1788483368.712836:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1788483368.712848:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1788483368.712861:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1788483368.712873:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1788483368.712884:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1788483368.712895:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1788483368.712908:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1788483368.712921:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1788483368.712936:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1788483368.712948:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1788483368.712962:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1788483368.712983:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1788483368.712995:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1788483368.713018:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1788483368.713031:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1788483368.713042:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1788483368.713054:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1788483368.713065:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1788483368.713079:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1788483368.713091:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1788483368.713128:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1788483368.713141:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1788483368.713153:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1788483368.713164:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1788483368.713175:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1788483368.713187:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1788483368.713199:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1788483368.713211:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1788483368.714331:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1788483368.714387:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1788483368.714404:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1788483368.714417:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1788483368.714430:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1788483368.714443:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1788483368.714455:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1788483368.714467:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1788483368.714480:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1788483368.714494:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1788483368.714545:0:24293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098808960:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483368.714615:0:24293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483368.714660:0:24293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69df22f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788483368.715645:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098808960 00000100:00100000:1.0:1788483368.715654:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098808960 00000100:00100000:1.0:1788483368.715703:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788483368.715712:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:24293:x1875360098808960:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483368.715851:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:24293:x1875360098808960:12345-0@lo:502:mount.lustre.0 Request processed in 140us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483368.715859:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788483368.718290:0:24293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098808960:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788483368.718519:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1788483368.718550:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1788483368.718588:0:24293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098809088:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483368.718654:0:24293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483368.718695:0:24293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c25fdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788483368.718826:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098809088 00000100:00100000:2.0:1788483368.718833:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098809088 00000100:00100000:2.0:1788483368.718895:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788483368.718904:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:24293:x1875360098809088:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483368.719023:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:24293:x1875360098809088:12345-0@lo:502:mount.lustre.0 Request processed in 119us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483368.719031:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788483368.722728:0:24293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098809088:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788483368.722821:0:24293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1788483368.722836:0:24293:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788483368.727419:0:24320:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788483368.727436:0:24320:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a68c4403370) 00000020:00000080:0.0:1788483368.727460:0:24320:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788483368.727563:0:24320:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a69efe13000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788483368.727567:0:24320:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a69efe13000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788483368.727570:0:24320:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a69efe13000 3 00010000:00080000:0.0:1788483368.727599:0:24320:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a68c3e3a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.154@tcp at head 00010000:00010000:0.0:1788483368.729218:0:24320:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1788483368.729431:0:24320:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788483368.729467:0:24320:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788483368.729477:0:24320:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1d7ea3d89ea1c17d 00000100:00080000:0.0:1788483368.729486:0:24320:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788483368.729491:0:24320:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a68c3e3a000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483368.729522:0:24320:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c452c700 x1875360098809216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788483368.729545:0:24320:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788483368.730086:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483368.730093:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788483368.730120:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483368.730123:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788483368.730127:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483368.730130:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788483368.730133:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483368.730142:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788483368.731088:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1875360098809216:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788483368.731177:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483368.736826:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098809216 00000100:00100000:0.0:1788483368.736839:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098809216 00000100:00100000:0.0:1788483368.736883:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788483368.736892:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3618:x1875360098809216:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788483368.736919:0:22789:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 660 last 0 00000020:00000080:0.0:1788483368.736975:0:22789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1d7ea3d89ea1c184 00000004:00100000:0.0:1788483368.736992:0:22789:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788483368.737024:0:22789:0:(import.c:65:import_set_state_nolock()) ffff9a68c3e3b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788483368.737123:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875360098809216:12345-0@lo:38:llog_process_th.0 Request processed in 229us (5944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483368.737130:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788483368.738244:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a68c452c700 x1875360098809216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788483378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483368.738266:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788483368.738274:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1788483368.738282:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788483368.738287:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788483368.738290:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c3e3a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788483368.738296:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3618:1875360098809216:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1788483368.740963:0:24320:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788483368.740987:0:24320:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9a68c4400000) 00000020:00000080:0.0:1788483368.741011:0:24320:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1788483368.741093:0:24320:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a69efe13000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788483368.741122:0:24320:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a69efe13000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788483368.741124:0:24320:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a69efe13000 3 00010000:00080000:0.0:1788483368.741155:0:24320:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a68c3e3d000@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.154@tcp at head 00010000:00010000:0.0:1788483368.742806:0:24320:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1788483368.742994:0:24320:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788483368.743031:0:24320:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788483368.743043:0:24320:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x1d7ea3d89ea1c192 00000100:00080000:0.0:1788483368.743052:0:24320:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788483368.743058:0:24320:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9a68c3e3d000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483368.743093:0:24320:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c452dc00 x1875360098809344/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788483368.743134:0:24320:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788483368.743190:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483368.743193:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483368.743196:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483368.743199:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483368.743212:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483368.743215:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483368.743218:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483368.743221:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788483368.743269:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3622:1875360098809472:0@lo:400:kworker.0 00000100:00100000:0.0:1788483368.743338:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483368.743372:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098809984:0@lo:400:kworker.0 00000100:00100000:0.0:1788483368.743409:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483368.743434:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788483368.743440:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098809856:0@lo:400:kworker.0 00000100:00100000:0.0:1788483368.743463:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483368.743500:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098809600:0@lo:400:kworker.0 00000100:00100000:0.0:1788483368.743522:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483368.743538:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098810112:0@lo:400:kworker.0 00000100:00100000:0.0:1788483368.743561:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483368.743576:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788483368.743581:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098809728:0@lo:400:kworker.0 00000100:00100000:0.0:1788483368.743600:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483368.743634:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098809984 00000100:00100000:0.0:1788483368.743640:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098809984 00000100:00100000:2.0:1788483368.743809:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098809472 00000100:00100000:2.0:1788483368.743814:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098809472 00000100:00100000:2.0:1788483368.743859:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788483368.743869:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:3622:x1875360098809472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483368.743917:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:3622:x1875360098809472:12345-0@lo:400:kworker.0 Request processed in 50us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483368.743924:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788483368.743954:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3618:1875360098809344:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788483368.743979:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483368.744014:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3622:1875360098809472:0@lo:400:kworker.0 00000100:00100000:1.0:1788483368.746173:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098809856 00000100:00100000:1.0:1788483368.746185:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098809856 00000100:00100000:1.0:1788483368.746228:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098809600 00000100:00100000:1.0:1788483368.746232:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098809600 00000100:00100000:1.0:1788483368.746251:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788483368.746271:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098809856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483368.746351:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098809856:12345-0@lo:400:kworker.0 Request processed in 82us (2886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483368.746358:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788483368.746375:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788483368.746382:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098809600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483368.746415:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098809600:12345-0@lo:400:kworker.0 Request processed in 33us (2892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483368.746421:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788483368.746772:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098809856:0@lo:400:kworker.0 00000100:00100000:2.0:1788483368.747968:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098810112 00000100:00100000:2.0:1788483368.747978:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098810112 00000100:00100000:2.0:1788483368.748027:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098809728 00000100:00100000:2.0:1788483368.748030:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098809728 00000100:00100000:2.0:1788483368.748043:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098809344 00000100:00100000:2.0:1788483368.748045:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098809344 00000100:00100000:2.0:1788483368.748057:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788483368.748065:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098810112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483368.748142:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098810112:12345-0@lo:400:kworker.0 Request processed in 78us (4580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483368.748149:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788483368.748163:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788483368.748170:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098809728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483368.748196:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098809728:12345-0@lo:400:kworker.0 Request processed in 27us (4594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483368.748200:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788483368.748213:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788483368.748217:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3618:x1875360098809344:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788483368.748271:0:22789:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 661 last 0 00000020:00000080:2.0:1788483368.748315:0:22789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x1d7ea3d89ea1c199 00000004:00100000:2.0:1788483368.748330:0:22789:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788483368.748360:0:22789:0:(import.c:65:import_set_state_nolock()) ffff9a69e8faf800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788483368.748401:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875360098809344:12345-0@lo:38:llog_process_th.0 Request processed in 182us (4420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483368.748407:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788483368.748454:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a68c452dc00 x1875360098809344/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788483378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483368.748465:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788483368.748472:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1788483368.748479:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788483368.748483:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788483368.748485:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c3e3d000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788483368.748490:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3618:1875360098809344:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788483368.748577:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788483368.748653:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788483368.748663:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098809984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483368.748714:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098809984:12345-0@lo:400:kworker.0 Request processed in 53us (5303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483368.748720:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788483368.748865:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a68c452c380 x1875360098809728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483368.748876:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098809728:0@lo:400:kworker.0 00000100:00100000:0.0:1788483368.748887:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098809600:0@lo:400:kworker.0 00010000:00080000:0.0:1788483368.748897:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a68c452ed80 x1875360098810112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483368.748913:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098810112:0@lo:400:kworker.0 00010000:00080000:1.0:1788483368.748980:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a68c452ea00 x1875360098809984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483368.748990:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098809984:0@lo:400:kworker.0 00000040:00080000:1.0:1788483368.749299:0:24320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1788483368.749737:0:24293:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788483368.749774:0:24293:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788483368.749796:0:24293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69d0400a00/0x1d7ea3d89ea1c168 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c16f expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.749807:0:24293:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69d0400a00/0x1d7ea3d89ea1c168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c16f expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788483368.749941:0:24293:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788483368.749943:0:24293:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788483368.749945:0:24293:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788483368.749946:0:24293:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788483368.749947:0:24293:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788483368.749949:0:24293:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788483368.749950:0:24293:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788483368.749956:0:24293:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788483368.749958:0:24293:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788483368.749962:0:24293:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788483368.749964:0:24293:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788483368.749966:0:24293:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788483368.749967:0:24293:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788483368.749968:0:24293:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788483368.749970:0:24293:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788483368.749971:0:24293:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788483368.749972:0:24293:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788483368.749973:0:24293:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788483368.749974:0:24293:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788483368.749996:0:24293:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788483368.750015:0:24293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098810240:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788483368.750068:0:24293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483368.750120:0:24293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d2f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788483368.750178:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098810240 00000100:00100000:1.0:1788483368.750184:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098810240 00000100:00100000:1.0:1788483368.750220:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788483368.750228:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:24293:x1875360098810240:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788483368.750249:0:22782:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788483368.750271:0:22782:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788483368.755291:0:22782:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788483368.755313:0:22782:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788483368.755540:0:22804:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788483368.755557:0:22804:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788483368.755577:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c1a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.755593:0:22804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69d0401a00/0x1d7ea3d89ea1c0ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c0e3 expref: 21 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.755601:0:22804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1c0f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c0f1 expref: 21 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.755609:0:22804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c1a0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.755645:0:22804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1c0f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1c0f1 expref: 21 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.755658:0:22804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1c0f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c0f1 expref: 21 pid: 22780 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483368.755671:0:22804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875360098810368:0@lo:104: 00000100:00100000:0.0:1788483368.755729:0:22804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788483368.755775:0:22804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69d0401a00/0x1d7ea3d89ea1c0ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1c0e3 expref: 21 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.755784:0:22804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69d0401a00/0x1d7ea3d89ea1c0ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c0e3 expref: 21 pid: 22783 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483368.755792:0:22804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875360098810496:0@lo:104: 00000100:00100000:0.0:1788483368.755815:0:22804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483368.755830:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d2f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788483368.755868:0:22772:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788483368.755892:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098810368 00000100:00100000:0.0:1788483368.755898:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098810368 00000100:00100000:0.0:1788483368.755928:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098810496 00000100:00100000:0.0:1788483368.755931:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098810496 00000100:00100000:0.0:1788483368.755943:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788483368.755949:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+4:22804:x1875360098810368:12345-0@lo:104: 00010000:00010000:0.0:1788483368.755961:0:22772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69d0401600/0x1d7ea3d89ea1c0f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1c0f8 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756007:0:22772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788483368.756012:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+4:22804:x1875360098810368:12345-0@lo:104: Request processed in 64us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483368.756019:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788483368.756034:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788483368.756040:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d9949c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+3:22804:x1875360098810496:12345-0@lo:104: 00010000:00010000:0.0:1788483368.756047:0:22772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c0e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1c0ea expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756078:0:22772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788483368.756083:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d9949c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+3:22804:x1875360098810496:12345-0@lo:104: Request processed in 44us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483368.756089:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788483368.756163:0:22804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875360098810368:0@lo:104: 00000100:00100000:0.0:1788483368.756172:0:22804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875360098810496:0@lo:104: 00010000:00010000:0.0:1788483368.756188:0:22804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c1a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756204:0:23946:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788483368.756215:0:23946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69d0401600/0x1d7ea3d89ea1c0f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1c0f8 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756223:0:23946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401600 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788483368.756226:0:23946:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69d0401600/0x1d7ea3d89ea1c0f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1c0f8 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756235:0:23946:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69d0401600/0x1d7ea3d89ea1c0f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1c0f8 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788483368.756242:0:23946:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69d0401600/0x1d7ea3d89ea1c0f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1c0f8 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483368.756247:0:23946:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788483368.756284:0:23946:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69d0401600/0x1d7ea3d89ea1c0f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c0f8 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756291:0:23946:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788483368.756307:0:23946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69d0401600/0x1d7ea3d89ea1c0f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c0f8 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756314:0:23946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69d0401600/0x1d7ea3d89ea1c0f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c0f8 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756327:0:23946:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483368.756330:0:23946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c0e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1c0ea expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756337:0:23946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8b800 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:0.0:1788483368.756340:0:23946:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c0e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1c0ea expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756358:0:23946:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c0e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1c0ea expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788483368.756365:0:23946:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c0e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1c0ea expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483368.756370:0:23946:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788483368.756383:0:23946:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c0e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c0ea expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756389:0:23946:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788483368.756403:0:23946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c0e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c0ea expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756410:0:23946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c0e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c0ea expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756425:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483368.756427:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483368.756428:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483368.756434:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483368.756450:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3620:1875360098810624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788483368.756477:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483368.756511:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098810624 00000100:00100000:0.0:1788483368.756515:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098810624 00010000:00010000:0.0:1788483368.756531:0:22774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1c0f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c0f1 expref: 22 pid: 22780 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483368.756552:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788483368.756565:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+22:3620:x1875360098810624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788483368.756575:0:22774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483368.756581:0:22774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1c0f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c0f1 expref: 22 pid: 22780 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756591:0:22774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1c0f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c0f1 expref: 22 pid: 22780 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756603:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69edb8a400/0x1d7ea3d89ea1c0f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c0f1 expref: 22 pid: 22780 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756615:0:22774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483368.756641:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:3620:x1875360098810624:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483368.756647:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788483368.756674:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3620:1875360098810624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788483368.756689:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3621:1875360098810752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788483368.756713:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483368.756739:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098810752 00000100:00100000:0.0:1788483368.756743:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098810752 00010000:00010000:0.0:1788483368.756754:0:22775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69d0401a00/0x1d7ea3d89ea1c0ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c0e3 expref: 21 pid: 22783 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483368.756773:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788483368.756779:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e0009c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:3621:x1875360098810752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788483368.756786:0:22775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483368.756790:0:22775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69d0401a00/0x1d7ea3d89ea1c0ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c0e3 expref: 21 pid: 22783 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756810:0:22775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69d0401a00/0x1d7ea3d89ea1c0ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c0e3 expref: 21 pid: 22783 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756821:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69d0401a00/0x1d7ea3d89ea1c0ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c0e3 expref: 21 pid: 22783 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756833:0:22775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c1a0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756842:0:22775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c1a0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788483368.756853:0:22775:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002488290s 00010000:00010000:0.0:1788483368.756858:0:22775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c1a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756866:0:22775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c1a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756873:0:22775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c1a0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756881:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c1a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756886:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401800 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483368.756891:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c1a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756899:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c1a0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756917:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c1a0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.756926:0:22775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483368.756952:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e0009c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+20:3621:x1875360098810752:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483368.756959:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788483368.756996:0:22804:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c1a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.757004:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c1a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483368.757011:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c1a0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483368.757035:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3621:1875360098810752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788483368.757322:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+19:24293:x1875360098810240:12345-0@lo:253:mount.lustre.0 Request processed in 7094us (7253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483368.757331:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788483368.757399:0:24293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:24293:1875360098810240:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788483368.757409:0:24293:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788483368.757412:0:24293:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788483368.757413:0:24293:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788483368.757415:0:24293:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788483368.757416:0:24293:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788483368.757418:0:24293:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788483368.757419:0:24293:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788483368.757421:0:24293:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788483368.757423:0:24293:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788483368.757424:0:24293:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788483368.757440:0:24293:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1788483368.762961:0:24293:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1788483368.775953:0:24293:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788483368.775961:0:24293:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788483368.775996:0:24293:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788483368.776039:0:24293:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.154@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788483368.776058:0:24293:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788483368.776083:0:24293:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788483368.776835:0:24293:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788483368.777046:0:24293:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788483368.835447:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483369.860578:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788483369.934083:0:24372:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788483369.936071:0:24372:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1788483370.372342:0:22785:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788483370.372349:0:22785:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a69efd92000 from 13 10000000:01000000:1.0:1788483370.372354:0:22785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788483370.372396:0:22785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a400/0x1d7ea3d89ea1c1a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483370.372407:0:22785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a400/0x1d7ea3d89ea1c1a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483370.372418:0:22785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a400/0x1d7ea3d89ea1c1a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483370.372442:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3077480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098810880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788483370.372509:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483370.372553:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed85fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788483370.372608:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098810880 00000100:00100000:0.0:1788483370.372616:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098810880 00000100:00100000:0.0:1788483370.372671:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788483370.372871:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+19:22785:x1875360098810880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483370.372886:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483370.372901:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69d0401400/0x1d7ea3d89ea1c1ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1c1a7 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483370.372937:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69d0401400/0x1d7ea3d89ea1c1ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c1a7 expref: 20 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483370.372952:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69d0401400/0x1d7ea3d89ea1c1ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c1a7 expref: 20 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483370.372961:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69d0401400, rc 0) 00000100:00100000:0.0:1788483370.373000:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+20:22785:x1875360098810880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 321us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483370.373007:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788483370.373126:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3077480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098810880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788483370.373140:0:22785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a400/0x1d7ea3d89ea1c1a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c1ae expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483370.373150:0:22785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a400/0x1d7ea3d89ea1c1a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1c1ae expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483370.373204:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3077480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098811008:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788483370.373236:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483370.373265:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ed85fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788483370.373338:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098811008 00000100:00100000:0.0:1788483370.373343:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098811008 00000100:00100000:0.0:1788483370.373365:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788483370.373372:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+20:22785:x1875360098811008:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788483370.373385:0:22782:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788483370.373401:0:22782:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788483370.373405:0:22782:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1788483370.373475:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+20:22785:x1875360098811008:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483370.373482:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788483370.373557:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3077480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098811008:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788483370.373611:0:22785:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788483370.373621:0:22785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a400/0x1d7ea3d89ea1c1a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c1ae expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483370.373629:0:22785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a400/0x1d7ea3d89ea1c1a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c1ae expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483370.373638:0:22785:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788483370.373640:0:22785:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a68c4d04800 from 13 10000000:01000000:1.0:1788483370.373642:0:22785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788483370.373659:0:22785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c1b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483370.373665:0:22785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c1b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483370.373673:0:22785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c1b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483370.373686:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3077480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098811136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788483370.373711:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483370.373740:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c2bc1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788483370.373788:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098811136 00000100:00100000:0.0:1788483370.373793:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098811136 00000100:00100000:0.0:1788483370.373824:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788483370.373831:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+20:22785:x1875360098811136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483370.373838:0:22783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483370.373849:0:22783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69d0401600/0x1d7ea3d89ea1c1bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1c1b5 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483370.373873:0:22783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69d0401600/0x1d7ea3d89ea1c1bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c1b5 expref: 21 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483370.373882:0:22783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69d0401600/0x1d7ea3d89ea1c1bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c1b5 expref: 21 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483370.373889:0:22783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69d0401600, rc 0) 00000100:00100000:0.0:1788483370.373917:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:22785:x1875360098811136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483370.373923:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788483370.373991:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3077480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098811136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788483370.374002:0:22785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c1b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c1bc expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483370.374009:0:22785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c1b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1c1bc expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483370.374046:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3077480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098811264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788483370.374080:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483370.374126:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c2bc1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788483370.374190:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098811264 00000100:00100000:0.0:1788483370.374194:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098811264 00000100:00100000:0.0:1788483370.374217:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788483370.374222:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:22785:x1875360098811264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788483370.374232:0:22780:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788483370.374242:0:22780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788483370.374256:0:22780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1788483370.374316:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:22785:x1875360098811264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 93us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483370.374323:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788483370.374395:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3077480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098811264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788483370.374435:0:22785:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788483370.374441:0:22785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c1b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c1bc expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483370.374449:0:22785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c1b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c1bc expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483370.885088:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788483371.261019:0:22826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788483371.901460:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483372.796202:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788483372.796223:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098811392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788483372.796295:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483372.796336:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098811392 00000100:00100000:1.0:1788483372.796342:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098811392 00000100:00100000:1.0:1788483372.796382:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788483372.796390:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098811392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788483372.796419:0:22794:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788483372.796459:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098811392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483372.796467:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788483372.796510:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098811392:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788483372.920606:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483373.304581:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788483373.304604:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098811520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788483373.304670:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483373.304782:0:23530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098811520 00000100:00100000:1.0:1788483373.304790:0:23530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098811520 00000100:00100000:1.0:1788483373.304835:0:23530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788483373.304844:0:23530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098811520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788483373.304885:0:23530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788483373.304933:0:23530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098811520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483373.304940:0:23530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788483373.304980:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098811520:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1788483373.816385:0:14600:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483373.816399:0:14600:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483373.816402:0:14600:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483373.816406:0:14600:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483373.816422:0:14600:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483373.816426:0:14600:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483373.816429:0:14600:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483373.816432:0:14600:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788483373.816466:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098811776:0@lo:400:kworker.0 00000100:00100000:0.0:1788483373.816543:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483373.816585:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098812288:0@lo:400:kworker.0 00000100:00100000:0.0:1788483373.816609:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483373.816633:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788483373.816639:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098811904:0@lo:400:kworker.0 00000100:00100000:0.0:1788483373.816658:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483373.816671:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098812416:0@lo:400:kworker.0 00000100:00100000:0.0:1788483373.816693:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483373.816730:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098811776 00000100:00100000:0.0:1788483373.816737:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098811776 00000100:00100000:0.0:1788483373.816777:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788483373.816785:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098811776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483373.816834:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098811776:12345-0@lo:400:kworker.0 Request processed in 50us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483373.816841:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788483373.816871:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098812288 00000100:00100000:0.0:1788483373.816876:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098812288 00000100:00100000:0.0:1788483373.816902:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098811904 00000100:00100000:0.0:1788483373.816905:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098811904 00000100:00100000:0.0:1788483373.816914:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098812416 00000100:00100000:0.0:1788483373.816916:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098812416 00000100:00100000:0.0:1788483373.816928:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788483373.816934:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098812288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483373.816965:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098812288:12345-0@lo:400:kworker.0 Request processed in 31us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483373.816971:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788483373.816981:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788483373.816987:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098811904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483373.817009:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098811904:12345-0@lo:400:kworker.0 Request processed in 22us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483373.817014:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788483373.817024:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788483373.817029:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098812416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483373.817377:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3620:1875360098811648:0@lo:400:kworker.0 00000100:00100000:3.0:1788483373.817409:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483373.817441:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098812160:0@lo:400:kworker.0 00000100:00100000:3.0:1788483373.817463:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483373.817476:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788483373.817481:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098812032:0@lo:400:kworker.0 00000100:00100000:3.0:1788483373.817500:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483373.817566:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098811648 00000100:00100000:3.0:1788483373.817571:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098811648 00000100:00100000:3.0:1788483373.817602:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788483373.817608:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:3620:x1875360098811648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483373.817645:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:3620:x1875360098811648:12345-0@lo:400:kworker.0 Request processed in 37us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483373.817651:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788483373.817754:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098812032 00000100:00100000:3.0:1788483373.817759:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098812032 00000100:00100000:3.0:1788483373.817782:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788483373.817788:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098812032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483373.817819:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098812032:12345-0@lo:400:kworker.0 Request processed in 31us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483373.817828:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788483373.817864:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098812032:0@lo:400:kworker.0 00000100:00100000:3.0:1788483373.817874:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3620:1875360098811648:0@lo:400:kworker.0 00000100:00100000:0.0:1788483373.818007:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098812416:12345-0@lo:400:kworker.0 Request processed in 976us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483373.818015:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788483373.818027:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098812160 00000100:00100000:0.0:1788483373.818031:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098812160 00000100:00100000:0.0:1788483373.818045:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788483373.818050:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098812160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483373.818112:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098812160:12345-0@lo:400:kworker.0 Request processed in 45us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483373.818128:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788483373.818154:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788483373.818158:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788483373.818180:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c452ed80 x1875360098811904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483373.818191:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098811904:0@lo:400:kworker.0 00010000:00080000:0.0:1788483373.818201:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c452ce00 x1875360098812416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483373.818208:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098812416:0@lo:400:kworker.0 00000100:00100000:0.0:1788483373.818218:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098811776:0@lo:400:kworker.0 00010000:00080000:0.0:1788483373.818236:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c452fb80 x1875360098812288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483373.818243:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098812288:0@lo:400:kworker.0 00010000:00080000:3.0:1788483373.818983:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c452dc00 x1875360098812160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483373.818994:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098812160:0@lo:400:kworker.0 00010000:00010000:0.0:1788483373.950049:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483374.970319:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788483374.988572:0:23542:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1788483375.674686:0:24662:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg654-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788483375.993338:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788483376.872623:0:24714:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788483376.872860:0:24714:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788483377.027204:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788483377.877571:0:24765:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788483377.877786:0:24765:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788483377.928820:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788483377.928842:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098812544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788483377.928904:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483377.929001:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098812544 00000100:00100000:3.0:1788483377.929008:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098812544 00000100:00100000:3.0:1788483377.929058:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788483377.929068:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098812544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788483377.929124:0:22794:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788483377.929185:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098812544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483377.929191:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788483377.929335:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098812544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788483377.977181:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483362/real 1788483362] req@ffff9a69efe9df80 x1875360098804608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483377 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483377.977220:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a69efe9df80 x1875360098804608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483377 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483377.977231:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483362/real 1788483362] req@ffff9a69efe9e680 x1875360098804736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483377 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483377.977242:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a69efe9e680 x1875360098804736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483377 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788483377.977263:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c1d33000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788483377.977287:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788483377.977292:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098804608:0@lo:8:kworker.0 00000100:00080000:2.0:1788483377.977297:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69e8faa800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788483377.977303:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788483377.977305:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69efe9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098804736:0@lo:8:kworker.0 00000100:00080000:1.0:1788483377.977487:0:14600:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483377.977491:0:14600:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788483377.977494:0:14600:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483377.977497:0:14600:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788483377.977509:0:14600:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483377.977512:0:14600:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788483377.977514:0:14600:0:(import.c:65:import_set_state_nolock()) ffff9a68c1d33000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788483377.977520:0:14600:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 654 00000100:00080000:1.0:1788483377.977525:0:14600:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788483377.977531:0:14600:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a68c1d33000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788483377.977552:0:14600:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c3076a00 x1875360098813056/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788483377.977564:0:14600:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483377.977567:0:14600:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788483377.977568:0:14600:0:(import.c:65:import_set_state_nolock()) ffff9a69e8faa800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788483377.977571:0:14600:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 654 00000100:00080000:1.0:1788483377.977573:0:14600:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788483377.977588:0:14600:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a69e8faa800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:1.0:1788483377.977600:0:14600:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c3076680 x1875360098813184/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788483377.977655:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098813312:0@lo:400:kworker.0 00000100:00100000:1.0:1788483377.977713:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483377.977759:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788483377.977765:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3619:1875360098812672:0@lo:400:kworker.0 00000100:00100000:1.0:1788483377.977792:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483377.977814:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098813440:0@lo:400:kworker.0 00000100:00100000:1.0:1788483377.977839:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483377.977865:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098812800:0@lo:400:kworker.0 00000100:00100000:1.0:1788483377.977889:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483377.977907:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098813568:0@lo:400:kworker.0 00000100:00100000:1.0:1788483377.977931:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483377.977948:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788483377.977953:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098812928:0@lo:400:kworker.0 00000100:00100000:1.0:1788483377.977973:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483377.977998:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098813312 00000100:00100000:1.0:1788483377.978005:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098813312 00000100:00100000:1.0:1788483377.978038:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098813440 00000100:00100000:1.0:1788483377.978042:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098813440 00000100:00100000:1.0:1788483377.978067:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098813568 00000100:00100000:1.0:1788483377.978069:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098813568 00000100:00100000:1.0:1788483377.978081:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098812928 00000100:00100000:1.0:1788483377.978084:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098812928 00000100:00100000:1.0:1788483377.978126:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788483377.978135:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098813312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483377.978220:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098813312:12345-0@lo:400:kworker.0 Request processed in 71us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483377.978227:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788483377.978246:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788483377.978252:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098813440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483377.978282:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098813440:12345-0@lo:400:kworker.0 Request processed in 30us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483377.978287:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788483377.978298:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788483377.978304:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098813568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483377.978333:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098813568:12345-0@lo:400:kworker.0 Request processed in 30us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483377.978339:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788483377.978351:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788483377.978356:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098812928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483377.978381:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875360098812928:12345-0@lo:400:kworker.0 Request processed in 25us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483377.978387:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788483377.978404:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098812672 00000100:00100000:1.0:1788483377.978408:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098812672 00000100:00100000:1.0:1788483377.978434:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788483377.978440:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:3619:x1875360098812672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483377.978468:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:3619:x1875360098812672:12345-0@lo:400:kworker.0 Request processed in 28us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483377.978473:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788483377.978507:0:23530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098812800 00000100:00100000:1.0:1788483377.978510:0:23530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098812800 00000100:00100000:1.0:1788483377.978532:0:23530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788483377.978537:0:23530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098812800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483377.978563:0:23530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098812800:12345-0@lo:400:kworker.0 Request processed in 26us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483377.978568:0:23530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788483377.978583:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788483377.978587:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788483377.978612:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3619:1875360098812672:0@lo:400:kworker.0 00010000:00080000:1.0:1788483377.978622:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c3077b80 x1875360098813440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483377.978632:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098813440:0@lo:400:kworker.0 00010000:00080000:1.0:1788483377.978639:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c3075180 x1875360098813312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483377.978646:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098813312:0@lo:400:kworker.0 00010000:00080000:1.0:1788483377.978674:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c3075c00 x1875360098812928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483377.978680:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875360098812928:0@lo:400:kworker.0 00000100:00100000:1.0:1788483377.978688:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098812800:0@lo:400:kworker.0 00010000:00080000:1.0:1788483377.978696:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c3076d80 x1875360098813568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483377.978703:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098813568:0@lo:400:kworker.0 00000100:00100000:2.0:1788483377.978876:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3076a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098813056:0@lo:8:kworker.0 00000100:00100000:2.0:1788483377.978913:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483377.978941:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098813184:0@lo:8:kworker.0 00000100:00100000:2.0:1788483377.978973:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483377.979276:0:24299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098813056 00000100:00100000:1.0:1788483377.979281:0:24299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098813056 00000100:00100000:1.0:1788483377.979338:0:24299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098813184 00000100:00100000:1.0:1788483377.979341:0:24299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098813184 00000100:00100000:2.0:1788483377.981566:0:24300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788483377.981577:0:24300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffefa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3618:x1875360098813056:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788483377.981609:0:24300:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 670 last 0 00000020:00000080:2.0:1788483377.981638:0:24300:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1d7ea3d89ea1c1c3 00002000:00100000:2.0:1788483377.981653:0:24300:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9a69efd94000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788483377.981657:0:24300:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788483377.981659:0:24300:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788483377.981815:0:24300:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788483377.981846:0:24300:0:(import.c:65:import_set_state_nolock()) ffff9a69efd92800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788483377.981936:0:24300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffefa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3618:x1875360098813056:12345-0@lo:8:kworker.0 Request processed in 359us (3021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483377.981944:0:24300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788483377.981966:0:24300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788483377.981971:0:24300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3618:x1875360098813184:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788483377.981984:0:24300:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1788483377.982455:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c3076a00 x1875360098813056/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788483397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483377.982467:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788483377.982475:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788483377.982482:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788483377.982487:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788483377.982489:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c1d33000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788483377.982508:0:3618:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788483377.982513:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3076a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098813056:0@lo:8:kworker.0 00000004:00080000:3.0:1788483377.985444:0:23531:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788483377.985545:0:23531:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 670248447901ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788483377.985553:0:23531:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1788483377.986093:0:23532:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788483377.986136:0:23532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23532:1875360098813824:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788483377.986337:0:23532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483377.986371:0:23532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69e0135f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788483377.986388:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098813696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788483377.986413:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483377.986466:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098813696 00000100:00100000:1.0:1788483377.986474:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098813696 00000100:00100000:1.0:1788483377.986523:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788483377.986531:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3075180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3622:x1875360098813696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788483377.986556:0:24301:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788483377.986600:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3075180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3622:x1875360098813696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483377.986606:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788483377.986640:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c3076d80 x1875360098813696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483377.986659:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098813696:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788483377.986679:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788483377.987279:0:24299:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788483377.987287:0:24299:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788483377.987352:0:24299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098813824 00000100:00100000:3.0:1788483377.987357:0:24299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098813824 00000100:00100000:3.0:1788483377.987431:0:24773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788483377.987438:0:24773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3075c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23532:x1875360098813824:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788483377.988886:0:23522:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1788483377.994705:0:24773:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788483377.994712:0:24773:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788483377.994803:0:24773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3075c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23532:x1875360098813824:12345-0@lo:7:osp-pre-0-1.0 Request processed in 7361us (8463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483377.994816:0:24773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788483377.994927:0:23532:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68c3074000 x1875360098813824/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788483393 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483377.994951:0:23532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23532:1875360098813824:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788483377.994965:0:23532:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788483377.995005:0:23532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5265180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23532:1875360098813952:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788483377.995042:0:23532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483377.995072:0:23532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d451cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788483377.998445:0:24299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098813952 00000100:00100000:0.0:1788483377.998461:0:24299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098813952 00000100:00100000:0.0:1788483377.998584:0:24299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788483377.998596:0:24299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23532:x1875360098813952:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788483377.998629:0:24299:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1788483377.998712:0:24299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23532:x1875360098813952:12345-0@lo:5:osp-pre-0-1.0 Request processed in 118us (3667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483377.998719:0:24299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788483377.998789:0:23532:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69f5265180 x1875360098813952/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788483393 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483377.998805:0:23532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5265180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23532:1875360098813952:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788483377.998818:0:23532:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788483377.998858:0:23532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5265180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23532:1875360098814080:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788483377.998889:0:23532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483377.999565:0:23532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d451cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788483377.999607:0:24298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098814080 00000100:00100000:1.0:1788483377.999613:0:24298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098814080 00000100:00100000:1.0:1788483377.999641:0:24298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788483377.999649:0:24298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23532:x1875360098814080:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788483377.999692:0:24298:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:3.0:1788483378.035709:0:24300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3618:x1875360098813184:12345-0@lo:8:kworker.0 Request processed in 53731us (56730us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788483378.035721:0:24300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788483378.035805:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69e8faa800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788483378.035812:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788483378.035816:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098813184:0@lo:8:kworker.0 00000001:00080000:2.0:1788483378.044965:0:24294:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:2.0:1788483378.044981:0:24294:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788483378.045642:0:24298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23532:x1875360098814080:12345-0@lo:5:osp-pre-0-1.0 Request processed in 45988us (46747us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788483378.045653:0:24298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788483378.049512:0:23532:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69f5265180 x1875360098814080/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788483393 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483378.049526:0:23532:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788483378.049541:0:23532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5265180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23532:1875360098814080:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788483378.049556:0:23532:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00010000:00010000:2.0:1788483378.049697:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483378.049820:0:23532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5264380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23532:1875360098814208:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788483378.049873:0:23532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483378.049904:0:23532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d451cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788483378.049965:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098814208 00000100:00100000:0.0:1788483378.049972:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098814208 00000100:00100000:0.0:1788483378.050029:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788483378.050039:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23532:x1875360098814208:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788483378.050121:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23532:x1875360098814208:12345-0@lo:900:osp-pre-0-1.0 Request processed in 83us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483378.050129:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788483378.050378:0:23532:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69f5264380 x1875360098814208/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788483394 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483378.050389:0:23532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5264380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23532:1875360098814208:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788483378.424703:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098814336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483378.424774:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483378.424861:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098814336 00000100:00100000:3.0:1788483378.424869:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098814336 00000100:00100000:3.0:1788483378.424924:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788483378.424933:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098814336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788483378.424962:0:22793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788483378.433520:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098814336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8575us (8734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483378.433558:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788483378.435079:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098814336:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788483379.066434:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483380.088565:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483381.113274:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788483381.511210:0:22826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788483382.137403:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483383.034376:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788483383.034399:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098814464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788483383.034466:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483383.034531:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098814464 00000100:00100000:2.0:1788483383.034541:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098814464 00000100:00100000:2.0:1788483383.034585:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788483383.034594:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098814464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788483383.034626:0:22794:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788483383.034673:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098814464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483383.034680:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788483383.034720:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098814464:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788483383.036497:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098814592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788483383.036553:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483383.036651:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098814592 00000100:00100000:2.0:1788483383.036658:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098814592 00000100:00100000:2.0:1788483383.036730:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788483383.036739:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3077b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098814592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788483383.036765:0:24301:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788483383.036809:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3077b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098814592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483383.036815:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788483383.036866:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788483383.036890:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69ffefa300 x1875360098814592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483383.036907:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098814592:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788483383.037481:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483383.037485:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483383.037488:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483383.037491:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483383.037502:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483383.037505:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788483383.037509:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a69e8faa800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483383.037513:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 670 00000100:00080000:0.0:1788483383.037518:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788483383.037522:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a69e8faa800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483383.037540:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69c59e7480 x1875360098815104/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788483383.037600:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098815104:0@lo:8:kworker.0 00000100:00100000:0.0:1788483383.037635:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483383.037675:0:24299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098815104 00000100:00100000:0.0:1788483383.037680:0:24299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098815104 00000100:00100000:0.0:1788483383.037711:0:24299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788483383.037716:0:24299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1875360098815104:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788483383.037733:0:24299:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788483383.037767:0:24299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1875360098815104:12345-0@lo:8:kworker.0 Request processed in 49us (130us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788483383.037773:0:24299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788483383.037790:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098814976:0@lo:400:kworker.0 00000100:00100000:0.0:1788483383.037815:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483383.037832:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788483383.037837:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098814848:0@lo:400:kworker.0 00000100:00100000:0.0:1788483383.037859:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483383.037882:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098815488:0@lo:400:kworker.0 00000100:00100000:0.0:1788483383.037902:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483383.037924:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098814848 00000100:00100000:0.0:1788483383.037928:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098814848 00000100:00100000:0.0:1788483383.037956:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788483383.037962:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098814848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483383.038001:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098814848:12345-0@lo:400:kworker.0 Request processed in 39us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483383.038009:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788483383.038036:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69e8faa800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483383.038046:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788483383.038050:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098815104:0@lo:8:kworker.0 00000100:00100000:0.0:1788483383.038076:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098814848:0@lo:400:kworker.0 00000100:00100000:1.0:1788483383.038563:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69d0f20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3622:1875360098814720:0@lo:400:kworker.0 00000100:00100000:1.0:1788483383.038600:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483383.038635:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1875360098815360:0@lo:400:kworker.0 00000100:00100000:1.0:1788483383.038657:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483383.038677:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788483383.038684:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098815232:0@lo:400:kworker.0 00000100:00100000:1.0:1788483383.038704:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483383.038723:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098814976 00000100:00100000:1.0:1788483383.038727:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098814976 00000100:00100000:1.0:1788483383.038748:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098815488 00000100:00100000:1.0:1788483383.038751:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098815488 00000100:00100000:1.0:1788483383.038768:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098815360 00000100:00100000:1.0:1788483383.038771:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098815360 00000100:00100000:1.0:1788483383.038782:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098815232 00000100:00100000:1.0:1788483383.038785:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098815232 00000100:00100000:1.0:1788483383.038796:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788483383.038810:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098814976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483383.038849:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098814976:12345-0@lo:400:kworker.0 Request processed in 40us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483383.038856:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788483383.038871:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788483383.038877:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098815488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483383.038905:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098815488:12345-0@lo:400:kworker.0 Request processed in 28us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483383.038910:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788483383.038922:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788483383.038927:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875360098815360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483383.038961:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875360098815360:12345-0@lo:400:kworker.0 Request processed in 34us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483383.038966:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788483383.038977:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788483383.038983:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098815232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483383.039007:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098815232:12345-0@lo:400:kworker.0 Request processed in 24us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483383.039012:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788483383.039032:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788483383.039035:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788483383.039052:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c59e5880 x1875360098815232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483383.039064:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098815232:0@lo:400:kworker.0 00010000:00080000:1.0:1788483383.039073:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c59e6d80 x1875360098815360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483383.039087:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1875360098815360:0@lo:400:kworker.0 00010000:00080000:1.0:1788483383.039145:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c59e7100 x1875360098815488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483383.039763:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098814720 00000100:00100000:0.0:1788483383.039769:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098814720 00000100:00100000:0.0:1788483383.039844:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788483383.039852:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdabbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:3622:x1875360098814720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483383.039905:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdabbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:3622:x1875360098814720:12345-0@lo:400:kworker.0 Request processed in 54us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483383.039911:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788483383.039958:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098815488:0@lo:400:kworker.0 00010000:00080000:1.0:1788483383.039974:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c59e6a00 x1875360098814976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483383.039981:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098814976:0@lo:400:kworker.0 00000100:00100000:3.0:1788483383.045853:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3622:1875360098814720:0@lo:400:kworker.0 00010000:00010000:0.0:1788483383.165987:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483383.548215:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098815616:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788483383.548279:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483383.548938:0:23530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098815616 00000100:00100000:1.0:1788483383.548947:0:23530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098815616 00000100:00100000:1.0:1788483383.549000:0:23530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788483383.549009:0:23530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098815616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788483383.549039:0:23530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788483383.549085:0:23530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098815616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483383.549091:0:23530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788483383.549218:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098815616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788483384.057328:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483363/real 1788483363] req@ffff9a69d0f21880 x1875360098805376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483383 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483384.057368:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a69d0f21880 x1875360098805376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483383 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483384.057379:0:3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483363/real 1788483363] req@ffff9a69d0f21180 x1875360098805504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483383 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483384.057391:0:3618:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a69d0f21180 x1875360098805504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483383 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788483384.057434:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c27c2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788483384.057458:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788483384.057463:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098805376:0@lo:8:kworker.0 00000100:00080000:1.0:1788483384.057469:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69f8ab9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788483384.057474:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788483384.057477:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69d0f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098805504:0@lo:8:kworker.0 00000100:00080000:0.0:1788483384.057670:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483384.057675:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788483384.057678:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a68c27c2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483384.057683:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 655 00000100:00080000:0.0:1788483384.057689:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788483384.057696:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a68c27c2000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483384.057716:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69c59e4000 x1875360098816000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788483384.057728:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483384.057732:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788483384.057747:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a69f8ab9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483384.057750:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 655 00000100:00080000:0.0:1788483384.057753:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788483384.057757:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a69f8ab9000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483384.057768:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69c59e5180 x1875360098816128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788483384.057818:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483384.057821:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788483384.057823:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a69e8faa800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483384.057827:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 675 00000100:00080000:0.0:1788483384.057829:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788483384.057832:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a69e8faa800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483384.057842:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69c59e5c00 x1875360098816640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788483384.057885:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098815872:0@lo:400:kworker.0 00000100:00100000:0.0:1788483384.057962:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483384.058000:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098816768:0@lo:400:kworker.0 00000100:00100000:0.0:1788483384.058021:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483384.058039:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788483384.058043:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3622:1875360098815744:0@lo:400:kworker.0 00000100:00100000:0.0:1788483384.058067:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483384.058089:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098816512:0@lo:400:kworker.0 00000100:00100000:0.0:1788483384.058132:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483384.058170:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098816384:0@lo:400:kworker.0 00000100:00100000:0.0:1788483384.058213:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483384.058228:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098817024:0@lo:400:kworker.0 00000100:00100000:0.0:1788483384.058245:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483384.058258:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788483384.058263:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098816256:0@lo:400:kworker.0 00000100:00100000:0.0:1788483384.058279:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483384.058290:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098816896:0@lo:400:kworker.0 00000100:00100000:0.0:1788483384.058473:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483384.058499:0:24300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098816512 00000100:00100000:0.0:1788483384.058508:0:24300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098816512 00000100:00100000:0.0:1788483384.058564:0:24300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788483384.058574:0:24300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098816512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483384.058626:0:24300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098816512:12345-0@lo:400:kworker.0 Request processed in 53us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483384.058633:0:24300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788483384.058657:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098816000:0@lo:8:kworker.0 00000100:00100000:0.0:1788483384.058678:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483384.058692:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098816128:0@lo:8:kworker.0 00000100:00100000:0.0:1788483384.058707:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483384.058721:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098816640:0@lo:8:kworker.0 00000100:00100000:0.0:1788483384.058737:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483384.058758:0:24299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098816000 00000100:00100000:0.0:1788483384.058761:0:24299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098816000 00000100:00100000:0.0:1788483384.058772:0:24299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098816128 00000100:00100000:0.0:1788483384.058774:0:24299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098816128 00000100:00100000:0.0:1788483384.058780:0:24299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098816640 00000100:00100000:0.0:1788483384.059261:0:24299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098816640 00000100:00100000:0.0:1788483384.059290:0:24299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788483384.059368:0:24299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1875360098816000:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788483384.059404:0:24299:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 676 last 0 00000020:00000080:0.0:1788483384.059442:0:24299:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d7ea3d89ea1c1ca 00002000:00100000:0.0:1788483384.059461:0:24299:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a68c1d32800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788483384.059465:0:24299:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788483384.059468:0:24299:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788483384.059570:0:24299:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788483384.059602:0:24299:0:(import.c:65:import_set_state_nolock()) ffff9a68c1d37000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788483384.059675:0:24299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1875360098816000:12345-0@lo:8:kworker.0 Request processed in 378us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483384.059682:0:24299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788483384.059700:0:24299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788483384.059704:0:24299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1875360098816128:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788483384.059716:0:24299:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788483384.059758:0:24299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1875360098816128:12345-0@lo:8:kworker.0 Request processed in 52us (1049us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788483384.059764:0:24299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788483384.059777:0:24299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788483384.059781:0:24299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1875360098816640:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788483384.059791:0:24299:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788483384.059942:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098816768 00000100:00100000:1.0:1788483384.059949:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098816768 00000100:00100000:1.0:1788483384.059978:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098817024 00000100:00100000:1.0:1788483384.059982:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098817024 00000100:00100000:1.0:1788483384.059993:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098816256 00000100:00100000:1.0:1788483384.059996:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098816256 00000100:00100000:1.0:1788483384.060006:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098816896 00000100:00100000:1.0:1788483384.060009:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098816896 00000100:00100000:1.0:1788483384.060021:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788483384.060028:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098816768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483384.060068:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875360098816768:12345-0@lo:400:kworker.0 Request processed in 41us (2046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483384.060075:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788483384.060090:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788483384.060125:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098817024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483384.060185:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098817024:12345-0@lo:400:kworker.0 Request processed in 79us (1928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483384.060191:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788483384.060205:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788483384.060210:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098816256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483384.060257:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098816256:12345-0@lo:400:kworker.0 Request processed in 46us (1976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483384.060264:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788483384.060277:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788483384.060284:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098816896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483384.060323:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098816896:12345-0@lo:400:kworker.0 Request processed in 40us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483384.060329:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788483384.060351:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098815744 00000100:00100000:1.0:1788483384.060355:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098815744 00000100:00100000:1.0:1788483384.060385:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788483384.060392:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdabb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:3622:x1875360098815744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483384.060424:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdabb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:3622:x1875360098815744:12345-0@lo:400:kworker.0 Request processed in 32us (2355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483384.060430:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788483384.060463:0:23530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098815872 00000100:00100000:1.0:1788483384.060467:0:23530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098815872 00000100:00100000:1.0:1788483384.060492:0:23530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098816384 00000100:00100000:1.0:1788483384.060495:0:23530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098816384 00000100:00100000:1.0:1788483384.060509:0:23530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788483384.060515:0:23530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098815872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483384.060550:0:23530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098815872:12345-0@lo:400:kworker.0 Request processed in 35us (2587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483384.060556:0:23530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788483384.060568:0:23530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788483384.060573:0:23530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d0f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098816384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483384.060615:0:23530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d0f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098816384:12345-0@lo:400:kworker.0 Request processed in 41us (2400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483384.060621:0:23530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1788483384.060685:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c59e4e00 x1875360098816256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483384.060701:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098816256:0@lo:400:kworker.0 00010000:00080000:1.0:1788483384.060713:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c59e6a00 x1875360098816896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483384.060721:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098816896:0@lo:400:kworker.0 00000100:00100000:1.0:1788483384.060732:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098816384:0@lo:400:kworker.0 00010000:00080000:1.0:1788483384.060741:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c59e7100 x1875360098817024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483384.060750:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098817024:0@lo:400:kworker.0 00000100:00100000:0.0:1788483384.062629:0:24299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1875360098816640:12345-0@lo:8:kworker.0 Request processed in 2838us (3882us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788483384.062643:0:24299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788483384.064479:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3622:1875360098815744:0@lo:400:kworker.0 00010000:00080000:0.0:1788483384.064514:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c59e6300 x1875360098816512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483384.064530:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098816512:0@lo:400:kworker.0 00000100:00100000:0.0:1788483384.064544:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098815872:0@lo:400:kworker.0 00010000:00080000:0.0:1788483384.064559:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c59e5500 x1875360098816768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483384.064569:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875360098816768:0@lo:400:kworker.0 00010000:00080000:0.0:1788483384.064634:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69c59e4000 x1875360098816000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788483409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483384.064644:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788483384.064656:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788483384.064667:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788483384.064674:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788483384.064678:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c27c2000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788483384.064702:0:3618:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788483384.064709:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098816000:0@lo:8:kworker.0 00000100:00080000:0.0:1788483384.064723:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69f8ab9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483384.064727:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788483384.064731:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098816128:0@lo:8:kworker.0 00000004:00080000:3.0:1788483384.065071:0:22813:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788483384.065117:0:22813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22813:1875360098817280:0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1788483384.067013:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69e8faa800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483384.067028:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788483384.067034:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098816640:0@lo:8:kworker.0 00000100:00100000:3.0:1788483384.067286:0:22813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483384.067412:0:22813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c6176780 going to sleep for 11 seconds 00000100:00100000:3.0:1788483384.067451:0:24298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098817280 00000100:00100000:3.0:1788483384.067460:0:24298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098817280 00000100:00100000:3.0:1788483384.067534:0:24298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788483384.067546:0:24298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22813:x1875360098817280:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788483384.068573:0:22812:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788483384.068700:0:22812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676331602895ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788483384.068709:0:22812:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788483384.070571:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098817152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788483384.070683:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483384.075442:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098817152 00000100:00100000:2.0:1788483384.075464:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098817152 00000100:00100000:2.0:1788483384.075547:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788483384.075559:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffefb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875360098817152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788483384.075595:0:24301:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788483384.075703:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffefb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875360098817152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (5020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483384.075710:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788483384.075772:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69f5265c00 x1875360098817152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483384.075795:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098817152:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788483384.076722:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788483384.079474:0:22768:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:2.0:1788483384.080427:0:24298:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1788483384.080442:0:24298:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:2.0:1788483384.080451:0:24298:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:65) 00002000:00010000:0.0:1788483384.110716:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483384.110733:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c1d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.110755:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788483384.110760:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483384.110768:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c1d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.110791:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c1d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.110816:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c1d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.110824:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c1d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.110855:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788483384.111474:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483384.111484:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c1d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.111495:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788483384.111499:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483384.111504:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c1d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.111523:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c1d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.111533:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c1d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.111540:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c1d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.111565:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788483384.111944:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788483384.111957:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c1d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.111968:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401e00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483384.111973:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c1d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.111983:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c1d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.112008:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c1d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.112030:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c1d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.112053:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483384.112057:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c1d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.112065:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0400800 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483384.112068:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c1d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.112075:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c1d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.112085:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c1d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.112092:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c1d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.112128:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483384.112129:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483384.112131:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483384.112418:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483384.112493:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483384.112501:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c1df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.112512:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788483384.112516:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483384.112523:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c1df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.112535:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c1df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.112546:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c1df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.112567:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c1df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.112592:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483384.114034:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483384.114053:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c1df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.114068:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401000 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483384.114074:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c1df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.114084:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c1df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.114159:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c1df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.114169:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c1df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.114202:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483384.114204:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483384.114206:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483384.114550:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483384.114559:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c1e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.114571:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788483384.114576:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483384.114582:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c1e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.114595:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c1e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.114605:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c1e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.114613:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c1e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.114640:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483384.116306:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483384.116321:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c1e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.116353:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0400400 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483384.116359:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c1e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.116369:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c1e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.116391:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c1e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.116399:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c1e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.116426:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483384.116429:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483384.116432:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483384.116996:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483384.117011:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c1ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.117041:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788483384.117046:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483384.117053:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c1ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.117068:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c1ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.117078:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c1ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.117086:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c1ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.118253:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483384.118945:0:23946:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483384.118959:0:23946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c1ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.118976:0:23946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401800 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483384.118981:0:23946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c1ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.118992:0:23946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c1ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.119018:0:23946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c1ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.119026:0:23946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c1ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.119068:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483384.119070:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483384.119072:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788483384.120306:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788483384.120329:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000884460d5/0x1d7ea3d89ea1c1f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.120346:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788483384.120352:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483384.120359:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000884460d5/0x1d7ea3d89ea1c1f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.120376:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000884460d5/0x1d7ea3d89ea1c1f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.120387:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000884460d5/0x1d7ea3d89ea1c1f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.120394:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000884460d5/0x1d7ea3d89ea1c1f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.120418:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483384.121425:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483384.121438:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000884460d5/0x1d7ea3d89ea1c1f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.121450:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26600 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483384.121455:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000884460d5/0x1d7ea3d89ea1c1f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.121466:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000884460d5/0x1d7ea3d89ea1c1f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.121507:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000884460d5/0x1d7ea3d89ea1c1f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.121516:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000884460d5/0x1d7ea3d89ea1c1f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.121537:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483384.121540:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483384.121541:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788483384.123924:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788483384.123939:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b557fe9/0x1d7ea3d89ea1c1fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.123956:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=676s v=(0 0) 00010000:00010000:3.0:1788483384.123962:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483384.123968:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b557fe9/0x1d7ea3d89ea1c1fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.123984:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b557fe9/0x1d7ea3d89ea1c1fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.124011:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b557fe9/0x1d7ea3d89ea1c1fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.124019:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b557fe9/0x1d7ea3d89ea1c1fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.124043:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483384.124077:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483384.124093:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b557fe9/0x1d7ea3d89ea1c1fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.124213:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483384.124219:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b557fe9/0x1d7ea3d89ea1c1fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.124230:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b557fe9/0x1d7ea3d89ea1c1fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.124262:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b557fe9/0x1d7ea3d89ea1c1fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.124269:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b557fe9/0x1d7ea3d89ea1c1fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.124289:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483384.124291:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483384.124301:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483384.127653:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483384.127666:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050601b14/0x1d7ea3d89ea1c202 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.127686:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788483384.127692:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483384.127699:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050601b14/0x1d7ea3d89ea1c202 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.127728:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050601b14/0x1d7ea3d89ea1c202 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.127740:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050601b14/0x1d7ea3d89ea1c202 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.127748:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050601b14/0x1d7ea3d89ea1c202 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.127777:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788483384.130458:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483384.130475:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036884315/0x1d7ea3d89ea1c209 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.130516:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788483384.130521:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483384.130529:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036884315/0x1d7ea3d89ea1c209 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.130545:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036884315/0x1d7ea3d89ea1c209 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.130556:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036884315/0x1d7ea3d89ea1c209 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.130564:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036884315/0x1d7ea3d89ea1c209 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.130591:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788483384.131033:0:23946:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788483384.131043:0:23946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050601b14/0x1d7ea3d89ea1c202 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.131054:0:23946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8b600 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483384.131059:0:23946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050601b14/0x1d7ea3d89ea1c202 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.131070:0:23946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050601b14/0x1d7ea3d89ea1c202 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.131090:0:23946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050601b14/0x1d7ea3d89ea1c202 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.131114:0:23946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050601b14/0x1d7ea3d89ea1c202 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.131260:0:23946:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483384.131271:0:23946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036884315/0x1d7ea3d89ea1c209 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.131278:0:23946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8a200 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483384.131282:0:23946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036884315/0x1d7ea3d89ea1c209 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.131290:0:23946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036884315/0x1d7ea3d89ea1c209 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.131310:0:23946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036884315/0x1d7ea3d89ea1c209 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.131317:0:23946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036884315/0x1d7ea3d89ea1c209 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.131332:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483384.131334:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483384.131336:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483384.131784:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483384.131791:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1bc99b2/0x1d7ea3d89ea1c210 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.131803:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788483384.131808:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483384.131812:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1bc99b2/0x1d7ea3d89ea1c210 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.131823:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1bc99b2/0x1d7ea3d89ea1c210 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.131842:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1bc99b2/0x1d7ea3d89ea1c210 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.131850:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1bc99b2/0x1d7ea3d89ea1c210 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.131864:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788483384.132407:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483384.132415:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b50f41a7/0x1d7ea3d89ea1c217 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.132427:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788483384.132431:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483384.132435:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b50f41a7/0x1d7ea3d89ea1c217 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.132445:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b50f41a7/0x1d7ea3d89ea1c217 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.132453:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b50f41a7/0x1d7ea3d89ea1c217 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.132461:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b50f41a7/0x1d7ea3d89ea1c217 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.132493:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788483384.132763:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483384.132769:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000168f66e0/0x1d7ea3d89ea1c21e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.132778:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788483384.132782:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483384.132786:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000168f66e0/0x1d7ea3d89ea1c21e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.132795:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000168f66e0/0x1d7ea3d89ea1c21e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.132803:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000168f66e0/0x1d7ea3d89ea1c21e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.132822:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000168f66e0/0x1d7ea3d89ea1c21e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.132832:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788483384.133089:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788483384.133111:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1bc99b2/0x1d7ea3d89ea1c210 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.133120:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8a800 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483384.133125:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1bc99b2/0x1d7ea3d89ea1c210 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.133151:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1bc99b2/0x1d7ea3d89ea1c210 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.133170:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1bc99b2/0x1d7ea3d89ea1c210 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.133186:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1bc99b2/0x1d7ea3d89ea1c210 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.133220:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788483384.133224:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b50f41a7/0x1d7ea3d89ea1c217 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.133230:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c7200 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483384.133233:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b50f41a7/0x1d7ea3d89ea1c217 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.133240:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b50f41a7/0x1d7ea3d89ea1c217 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.133250:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b50f41a7/0x1d7ea3d89ea1c217 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.133257:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b50f41a7/0x1d7ea3d89ea1c217 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.133270:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483384.133274:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000168f66e0/0x1d7ea3d89ea1c21e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.133280:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c7c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483384.133284:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000168f66e0/0x1d7ea3d89ea1c21e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.133313:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000168f66e0/0x1d7ea3d89ea1c21e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.133324:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000168f66e0/0x1d7ea3d89ea1c21e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.133332:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000168f66e0/0x1d7ea3d89ea1c21e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.133347:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483384.133349:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483384.133351:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483384.133580:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483384.134533:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483384.134545:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6887b5/0x1d7ea3d89ea1c225 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.134562:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788483384.134580:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483384.134587:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6887b5/0x1d7ea3d89ea1c225 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.134601:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb6887b5/0x1d7ea3d89ea1c225 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.134610:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6887b5/0x1d7ea3d89ea1c225 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.134619:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6887b5/0x1d7ea3d89ea1c225 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.134642:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483384.135066:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483384.135074:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb6887b5/0x1d7ea3d89ea1c225 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.135083:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c7600 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483384.135088:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6887b5/0x1d7ea3d89ea1c225 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.135125:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6887b5/0x1d7ea3d89ea1c225 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.135160:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb6887b5/0x1d7ea3d89ea1c225 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.135169:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb6887b5/0x1d7ea3d89ea1c225 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.135203:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483384.135205:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483384.135207:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483384.135484:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483384.135490:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dee7335a/0x1d7ea3d89ea1c22c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.135500:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788483384.135504:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483384.135508:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dee7335a/0x1d7ea3d89ea1c22c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.135518:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dee7335a/0x1d7ea3d89ea1c22c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.135526:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dee7335a/0x1d7ea3d89ea1c22c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.135543:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dee7335a/0x1d7ea3d89ea1c22c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.135566:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483384.135877:0:23946:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483384.135884:0:23946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dee7335a/0x1d7ea3d89ea1c22c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.135892:0:23946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6800 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483384.135896:0:23946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dee7335a/0x1d7ea3d89ea1c22c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.135904:0:23946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dee7335a/0x1d7ea3d89ea1c22c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.135916:0:23946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dee7335a/0x1d7ea3d89ea1c22c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.135933:0:23946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dee7335a/0x1d7ea3d89ea1c22c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.135950:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483384.135951:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483384.135953:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483384.136501:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483384.136511:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1c233 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.136525:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788483384.136529:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483384.136535:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1c233 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.136546:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1c233 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.136554:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1c233 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.136562:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1c233 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.136587:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483384.136793:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483384.136800:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1c233 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.136808:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6200 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483384.136812:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1c233 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.136820:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1c233 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.136834:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1c233 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.136841:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae1270d5/0x1d7ea3d89ea1c233 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.136858:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483384.136860:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483384.136861:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483384.137092:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483384.137414:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029eba7ac/0x1d7ea3d89ea1c23a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.137432:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788483384.137437:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483384.137442:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029eba7ac/0x1d7ea3d89ea1c23a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.137454:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029eba7ac/0x1d7ea3d89ea1c23a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.137462:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029eba7ac/0x1d7ea3d89ea1c23a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.137470:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029eba7ac/0x1d7ea3d89ea1c23a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.137495:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483384.137798:0:23946:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483384.137805:0:23946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029eba7ac/0x1d7ea3d89ea1c23a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.137813:0:23946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483384.137818:0:23946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029eba7ac/0x1d7ea3d89ea1c23a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.137827:0:23946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029eba7ac/0x1d7ea3d89ea1c23a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.137843:0:23946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029eba7ac/0x1d7ea3d89ea1c23a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.137850:0:23946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029eba7ac/0x1d7ea3d89ea1c23a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.137871:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483384.137873:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483384.137875:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483384.137969:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483384.137975:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1c241 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.137983:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788483384.137986:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483384.137991:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1c241 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.138000:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1c241 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.138021:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1c241 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.138029:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1c241 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.138084:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788483384.142798:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483384.142820:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1c248 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.142842:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788483384.142847:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483384.142854:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1c248 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.142871:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1c248 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.142882:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1c248 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.142890:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1c248 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.142998:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788483384.143009:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1c241 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.143017:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6600 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483384.143022:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1c241 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.143044:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1c241 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.143066:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1c241 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.143074:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5e25201/0x1d7ea3d89ea1c241 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.143434:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483384.143442:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1c248 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.143452:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6400 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483384.143456:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1c248 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.143464:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1c248 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.143477:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1c248 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.143486:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483384.143488:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483384.143489:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483384.144444:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483384.144451:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483384.144454:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483384.144628:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483384.144677:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788483384.144689:0:24298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1c248 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788483384.145745:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483384.145758:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1c24f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.145778:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788483384.145783:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483384.145790:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1c24f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.145806:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1c24f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.145817:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1c24f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.145825:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1c24f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.145855:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483384.146278:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483384.146288:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1c24f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.146306:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6a00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483384.146312:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1c24f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.146322:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1c24f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.146344:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1c24f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.146366:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1c24f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.146390:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483384.146392:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483384.146393:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483384.146699:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483384.146706:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1c256 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.146723:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788483384.146727:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483384.146731:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1c256 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.146740:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1c256 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.146748:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1c256 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.146755:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1c256 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.146779:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483384.147138:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483384.147152:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1c256 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.147162:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c7e00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483384.147166:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1c256 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.147183:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1c256 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.147199:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1c256 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.147207:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8967d08/0x1d7ea3d89ea1c256 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.147230:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483384.147232:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483384.147233:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483384.147537:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483384.147545:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000127ac7f3/0x1d7ea3d89ea1c25d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.147554:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788483384.147558:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483384.147563:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000127ac7f3/0x1d7ea3d89ea1c25d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.147573:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000127ac7f3/0x1d7ea3d89ea1c25d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.147593:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000127ac7f3/0x1d7ea3d89ea1c25d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.147600:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000127ac7f3/0x1d7ea3d89ea1c25d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.147628:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483384.148009:0:23946:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483384.148015:0:23946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000127ac7f3/0x1d7ea3d89ea1c25d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.148024:0:23946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c8685000 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483384.148038:0:23946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000127ac7f3/0x1d7ea3d89ea1c25d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.148046:0:23946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000127ac7f3/0x1d7ea3d89ea1c25d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.148061:0:23946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000127ac7f3/0x1d7ea3d89ea1c25d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.148069:0:23946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000127ac7f3/0x1d7ea3d89ea1c25d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.148085:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483384.148087:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483384.148089:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483384.148442:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483384.148450:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041957bd0/0x1d7ea3d89ea1c264 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.148460:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788483384.148464:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483384.148469:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041957bd0/0x1d7ea3d89ea1c264 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.148479:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041957bd0/0x1d7ea3d89ea1c264 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.148487:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041957bd0/0x1d7ea3d89ea1c264 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.148494:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041957bd0/0x1d7ea3d89ea1c264 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.148528:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483384.148823:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483384.148830:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041957bd0/0x1d7ea3d89ea1c264 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.148839:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c8685a00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483384.148843:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041957bd0/0x1d7ea3d89ea1c264 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.148851:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041957bd0/0x1d7ea3d89ea1c264 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.148865:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041957bd0/0x1d7ea3d89ea1c264 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.148872:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041957bd0/0x1d7ea3d89ea1c264 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.148888:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483384.148890:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483384.148892:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483384.149002:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483384.149009:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a1d00eb/0x1d7ea3d89ea1c26b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.149018:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788483384.149021:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483384.149026:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a1d00eb/0x1d7ea3d89ea1c26b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.149035:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a1d00eb/0x1d7ea3d89ea1c26b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.149043:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a1d00eb/0x1d7ea3d89ea1c26b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.149050:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a1d00eb/0x1d7ea3d89ea1c26b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.149071:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788483384.149911:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483384.149921:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf124394/0x1d7ea3d89ea1c272 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.149932:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788483384.149944:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483384.149950:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf124394/0x1d7ea3d89ea1c272 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.149961:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf124394/0x1d7ea3d89ea1c272 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.149971:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf124394/0x1d7ea3d89ea1c272 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.149978:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf124394/0x1d7ea3d89ea1c272 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.150144:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788483384.152376:0:23946:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788483384.152396:0:23946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a1d00eb/0x1d7ea3d89ea1c26b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.152413:0:23946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c8684c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483384.152420:0:23946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a1d00eb/0x1d7ea3d89ea1c26b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.152432:0:23946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a1d00eb/0x1d7ea3d89ea1c26b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.152459:0:23946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a1d00eb/0x1d7ea3d89ea1c26b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.152467:0:23946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a1d00eb/0x1d7ea3d89ea1c26b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.152497:0:23946:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483384.152502:0:23946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf124394/0x1d7ea3d89ea1c272 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.152508:0:23946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c8685c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483384.152512:0:23946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf124394/0x1d7ea3d89ea1c272 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.152519:0:23946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf124394/0x1d7ea3d89ea1c272 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.152556:0:23946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf124394/0x1d7ea3d89ea1c272 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.152565:0:23946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf124394/0x1d7ea3d89ea1c272 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788483384.152572:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788483384.152584:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483384.152589:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a143f608/0x1d7ea3d89ea1c279 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.152590:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483384.152593:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483384.152612:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788483384.152617:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483384.152623:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a143f608/0x1d7ea3d89ea1c279 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.152637:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a143f608/0x1d7ea3d89ea1c279 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.152648:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a143f608/0x1d7ea3d89ea1c279 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.152661:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483384.152674:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a143f608/0x1d7ea3d89ea1c279 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.152862:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788483384.155722:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788483384.155741:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5e9e78/0x1d7ea3d89ea1c280 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.155761:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=676s v=(0 0) 00010000:00010000:3.0:1788483384.155767:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483384.155774:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5e9e78/0x1d7ea3d89ea1c280 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.155790:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5e9e78/0x1d7ea3d89ea1c280 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.155800:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5e9e78/0x1d7ea3d89ea1c280 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.155829:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5e9e78/0x1d7ea3d89ea1c280 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483384.155856:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788483384.156287:0:23946:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788483384.156362:0:23946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a143f608/0x1d7ea3d89ea1c279 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.156373:0:23946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c8684a00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483384.156378:0:23946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a143f608/0x1d7ea3d89ea1c279 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.156387:0:23946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a143f608/0x1d7ea3d89ea1c279 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.156406:0:23946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a143f608/0x1d7ea3d89ea1c279 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.156423:0:23946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a143f608/0x1d7ea3d89ea1c279 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.156444:0:23946:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483384.156448:0:23946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5e9e78/0x1d7ea3d89ea1c280 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.156455:0:23946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0400 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483384.156459:0:23946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5e9e78/0x1d7ea3d89ea1c280 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.156466:0:23946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5e9e78/0x1d7ea3d89ea1c280 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.156477:0:23946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5e9e78/0x1d7ea3d89ea1c280 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.156484:0:23946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5e9e78/0x1d7ea3d89ea1c280 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.156497:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483384.156499:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483384.156501:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483384.156575:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788483384.163480:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788483384.163498:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1c287 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.163519:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788483384.163525:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483384.163534:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1c287 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.163552:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1c287 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.163564:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1c287 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.163572:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1c287 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.163610:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483384.164112:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483384.164122:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1c287 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.164916:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483384.164923:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1c287 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.164934:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1c287 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.164958:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1c287 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.164966:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1c287 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.164988:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483384.164991:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483384.164993:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788483384.165640:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788483384.165650:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1c28e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.165665:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788483384.165670:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483384.165677:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1c28e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.165689:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1c28e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.165698:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1c28e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.165706:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1c28e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.165733:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483384.166210:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483384.166219:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1c28e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.166229:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27000 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483384.166233:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1c28e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.166243:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1c28e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.166270:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1c28e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.166279:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1c28e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788483384.167524:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788483384.167541:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cd3d479/0x1d7ea3d89ea1c295 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.167557:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788483384.167571:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483384.167577:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cd3d479/0x1d7ea3d89ea1c295 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.167592:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cd3d479/0x1d7ea3d89ea1c295 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.167601:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cd3d479/0x1d7ea3d89ea1c295 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.168241:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cd3d479/0x1d7ea3d89ea1c295 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.168265:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788483384.168903:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788483384.168911:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e69ca38/0x1d7ea3d89ea1c29c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.168924:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788483384.168929:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483384.168935:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e69ca38/0x1d7ea3d89ea1c29c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.168947:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e69ca38/0x1d7ea3d89ea1c29c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.168956:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e69ca38/0x1d7ea3d89ea1c29c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.168971:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e69ca38/0x1d7ea3d89ea1c29c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.168990:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788483384.169477:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788483384.169485:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab3cdd02/0x1d7ea3d89ea1c2a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.169494:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788483384.169497:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483384.169501:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab3cdd02/0x1d7ea3d89ea1c2a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.169511:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab3cdd02/0x1d7ea3d89ea1c2a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.169519:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab3cdd02/0x1d7ea3d89ea1c2a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.169527:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab3cdd02/0x1d7ea3d89ea1c2a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.169537:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788483384.170659:0:23946:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788483384.170672:0:23946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cd3d479/0x1d7ea3d89ea1c295 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.170686:0:23946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26800 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483384.170692:0:23946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cd3d479/0x1d7ea3d89ea1c295 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.170703:0:23946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cd3d479/0x1d7ea3d89ea1c295 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.170729:0:23946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cd3d479/0x1d7ea3d89ea1c295 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.170737:0:23946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cd3d479/0x1d7ea3d89ea1c295 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.170758:0:23946:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788483384.170763:0:23946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e69ca38/0x1d7ea3d89ea1c29c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.170782:0:23946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27800 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483384.170785:0:23946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e69ca38/0x1d7ea3d89ea1c29c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.170793:0:23946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e69ca38/0x1d7ea3d89ea1c29c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.170803:0:23946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e69ca38/0x1d7ea3d89ea1c29c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.170809:0:23946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e69ca38/0x1d7ea3d89ea1c29c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.170822:0:23946:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483384.170826:0:23946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab3cdd02/0x1d7ea3d89ea1c2a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.170832:0:23946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26e00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483384.170835:0:23946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab3cdd02/0x1d7ea3d89ea1c2a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.170843:0:23946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab3cdd02/0x1d7ea3d89ea1c2a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.170852:0:23946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab3cdd02/0x1d7ea3d89ea1c2a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.170865:0:23946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab3cdd02/0x1d7ea3d89ea1c2a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483384.170878:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483384.170879:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483384.170881:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483384.170890:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788483384.171453:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788483384.171463:0:24298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1c2aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.171482:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788483384.171488:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483384.171495:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1c2aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.171507:0:24298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1c2aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.171515:0:24298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1c2aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.171524:0:24298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1c2aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483384.171544:0:24298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788483384.171894:0:24298:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:2.0:1788483384.172024:0:24298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22813:x1875360098817280:12345-0@lo:5:osp-pre-0-0.0 Request processed in 104475us (105872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483384.172035:0:24298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788483384.175878:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483384.175893:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1c2aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.175907:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26000 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483384.175912:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1c2aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.175922:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1c2aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.175943:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1c2aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.175951:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3d4ca92/0x1d7ea3d89ea1c2aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483384.175977:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483384.175979:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483384.175981:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483384.176214:0:22813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22813:1875360098817280:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788483384.176244:0:22813:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788483384.178335:0:22813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22813:1875360098817408:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788483384.178434:0:22813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483384.178481:0:22813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69df22fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483384.178517:0:24773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098817408 00000100:00100000:3.0:1788483384.178527:0:24773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098817408 00000100:00100000:3.0:1788483384.178587:0:24773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788483384.178598:0:24773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22813:x1875360098817408:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788483384.178656:0:24773:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:0.0:1788483384.184682:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788483384.192576:0:24294:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:2.0:1788483384.192636:0:24294:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:1.0:1788483384.192903:0:23542:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788483384.194548:0:24773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22813:x1875360098817408:12345-0@lo:5:osp-pre-0-0.0 Request processed in 15939us (16103us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788483384.194564:0:24773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788483384.194634:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483384.197204:0:22813:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1788483384.197226:0:22813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22813:1875360098817408:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788483384.197249:0:22813:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:0.0:1788483385.208922:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788483385.663002:0:25112:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788483385.663011:0:25112:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788483385.663013:0:25112:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788483385.663253:0:25112:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a69d18cc000 00000020:01000004:2.0:1788483385.663271:0:25112:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788483385.663286:0:25112:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788483385.663298:0:25112:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a69c86b99b8) 00000020:00000080:2.0:1788483385.663316:0:25112:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788483385.697896:0:25112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788483385.700730:0:25112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788483385.701118:0:25112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788483385.701374:0:25112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788483385.701613:0:25112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788483385.701808:0:25112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788483385.702002:0:25112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:0.0:1788483385.702810:0:25112:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788483385.703000:0:25112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788483385.703015:0:25112:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788483385.703026:0:25112:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1d7ea3d89ea1c2b8 00000020:01000004:0.0:1788483385.703032:0:25112:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788483385.703053:0:25112:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.154@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788483385.703057:0:25112:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788483385.703063:0:25112:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788483385.703088:0:25112:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788483385.703092:0:25112:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.154@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788483385.710888:0:25112:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.154@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788483385.710939:0:25112:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.154@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788483385.710944:0:25112:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788483385.710945:0:25112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788483385.710946:0:25112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788483385.710948:0:25112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788483385.710949:0:25112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788483385.710950:0:25112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788483385.710952:0:25112:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788483385.710953:0:25112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788483385.710954:0:25112:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788483385.710958:0:25112:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788483385.710960:0:25112:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788483385.710961:0:25112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788483385.710962:0:25112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788483385.710963:0:25112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788483385.710964:0:25112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788483385.710965:0:25112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788483385.710966:0:25112:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788483385.710967:0:25112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788483385.710968:0:25112:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788483385.710995:0:25112:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788483385.711015:0:25112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098817536:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788483385.711077:0:25112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483385.711429:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098817536 00000100:00100000:3.0:1788483385.711437:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098817536 00000100:00100000:3.0:1788483385.711499:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788483385.711509:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdaba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:25112:x1875360098817536:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788483385.711552:0:22780:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788483385.711556:0:22780:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788483385.711564:0:22780:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788483385.711956:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdaba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:25112:x1875360098817536:12345-0@lo:253:mount.lustre.0 Request processed in 447us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483385.711964:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788483385.712033:0:25112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0000 going to sleep for 11 seconds 00000100:00100000:1.0:1788483385.712061:0:25112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098817536:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788483385.712071:0:25112:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788483385.712073:0:25112:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788483385.712075:0:25112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788483385.712076:0:25112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788483385.712077:0:25112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788483385.712078:0:25112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788483385.712079:0:25112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788483385.712080:0:25112:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788483385.712082:0:25112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788483385.712083:0:25112:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788483385.712228:0:25112:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a69d18cc000 from lustre-OST0001 10000000:01000000:1.0:1788483385.712258:0:25112:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788483385.712261:0:25112:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788483385.712269:0:25112:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a69e00999b8 local copy 00010000:00010000:1.0:1788483385.712280:0:25112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27400/0x1d7ea3d89ea1beeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bef2 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483385.712373:0:25112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3076680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098817664:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483385.712403:0:25112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483385.712472:0:25112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788483385.712513:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098817664 00000100:00100000:2.0:1788483385.712519:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098817664 00000100:00100000:2.0:1788483385.712591:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788483385.712600:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdabb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:25112:x1875360098817664:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483385.712675:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdabb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:25112:x1875360098817664:12345-0@lo:501:mount.lustre.0 Request processed in 77us (270us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788483385.712683:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788483385.712750:0:25112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3076680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098817664:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788483385.712763:0:25112:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788483385.712782:0:25112:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788483385.712788:0:25112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27400/0x1d7ea3d89ea1beeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bef2 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483385.712796:0:25112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecf27400/0x1d7ea3d89ea1beeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1bef2 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483385.712818:0:25112:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a69d18cc000 10000000:01000000:3.0:1788483385.712823:0:25112:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788483385.712828:0:25112:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788483385.712831:0:25112:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788483385.712835:0:25112:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788483385.712837:0:25112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788483385.712857:0:25112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0e00/0x1d7ea3d89ea1c2bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483385.712865:0:25112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0e00/0x1d7ea3d89ea1c2bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483385.712874:0:25112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0e00/0x1d7ea3d89ea1c2bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483385.712887:0:25112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098817792:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788483385.712923:0:25112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483385.713036:0:25112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3dc7900 going to sleep for 11 seconds 00000100:00100000:1.0:1788483385.713277:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098817792 00000100:00100000:1.0:1788483385.713283:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098817792 00000100:00100000:1.0:1788483385.713307:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788483385.713314:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:25112:x1875360098817792:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483385.713323:0:22782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483385.713335:0:22782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c8685600/0x1d7ea3d89ea1c2c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1c2bf expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.713356:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c8685600/0x1d7ea3d89ea1c2c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c2bf expref: 22 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.713380:0:22782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c8685600/0x1d7ea3d89ea1c2c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c2bf expref: 22 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.713388:0:22782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c8685600, rc 0) 00000100:00100000:1.0:1788483385.713428:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+22:25112:x1875360098817792:12345-0@lo:101:mount.lustre.0 Request processed in 114us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483385.713435:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788483385.713511:0:25112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098817792:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483385.713523:0:25112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0e00/0x1d7ea3d89ea1c2bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c2c6 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483385.713532:0:25112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0e00/0x1d7ea3d89ea1c2bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1c2c6 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788483385.714472:0:25112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1788483385.715001:0:25112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788483385.716622:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788483385.716683:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788483385.716700:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788483385.716713:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788483385.716727:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788483385.716738:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788483385.716752:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788483385.716764:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788483385.716776:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1788483385.716799:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1788483385.716804:0:25112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1788483385.716899:0:25112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098817920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483385.716960:0:25112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483385.716996:0:25112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69cb1ea240 going to sleep for 11 seconds 00000100:00100000:1.0:1788483385.717144:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098817920 00000100:00100000:1.0:1788483385.717152:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098817920 00000100:00100000:1.0:1788483385.717200:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788483385.717209:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdaba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+22:25112:x1875360098817920:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483385.717345:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdaba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+22:25112:x1875360098817920:12345-0@lo:501:mount.lustre.0 Request processed in 136us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483385.717353:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788483385.717581:0:25112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098817920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483385.717616:0:25112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098818048:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788483385.717656:0:25112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483385.717773:0:25112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69cb1ea240 going to sleep for 11 seconds 00000100:00100000:0.0:1788483385.717946:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098818048 00000100:00100000:0.0:1788483385.717952:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098818048 00000100:00100000:2.0:1788483385.718000:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788483385.718009:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+22:25112:x1875360098818048:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788483385.718839:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+22:25112:x1875360098818048:12345-0@lo:503:mount.lustre.0 Request processed in 829us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483385.718849:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788483385.719064:0:25112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098818048:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788483385.719619:0:25112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788483385.719696:0:25112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098818176:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788483385.719749:0:25112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483385.719831:0:25112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69cb1ea240 going to sleep for 11 seconds 00000100:00100000:2.0:1788483385.719868:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098818176 00000100:00100000:2.0:1788483385.719875:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098818176 00000100:00100000:2.0:1788483385.719914:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788483385.719922:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdabb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+22:25112:x1875360098818176:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788483385.720495:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdabb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+22:25112:x1875360098818176:12345-0@lo:502:mount.lustre.0 Request processed in 573us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483385.720504:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788483385.720570:0:25112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098818176:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788483385.720757:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788483385.720782:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788483385.720795:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788483385.720807:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788483385.720819:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788483385.720831:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788483385.720843:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788483385.720855:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788483385.720866:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1788483385.720892:0:25112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098818304:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483385.720927:0:25112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483385.721001:0:25112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788483385.721036:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098818304 00000100:00100000:2.0:1788483385.721042:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098818304 00000100:00100000:2.0:1788483385.721127:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788483385.721145:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+22:25112:x1875360098818304:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483385.721235:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+22:25112:x1875360098818304:12345-0@lo:502:mount.lustre.0 Request processed in 99us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483385.721248:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788483385.721327:0:25112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098818304:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788483385.721367:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1788483385.721376:0:25112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788483385.722048:0:25116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788483385.722055:0:25116:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788483385.722062:0:25116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483385.722064:0:25116:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788483385.722070:0:25116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788483385.722082:0:25116:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a69c86bb370) 00000020:00000080:2.0:1788483385.722284:0:25116:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788483385.722356:0:25116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788483385.722420:0:25116:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a69d18cc000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788483385.722428:0:25116:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788483385.722435:0:25116:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1d7ea3d89ea1c2d4 00010000:00010000:3.0:1788483385.728505:0:25116:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788483385.728964:0:25116:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:3.0:1788483385.730385:0:25116:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788483385.731564:0:25116:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788483385.731575:0:25116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483385.731582:0:25116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483385.731585:0:25116:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788483385.731589:0:25116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483385.731592:0:25116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483385.731594:0:25116:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788483385.731598:0:25116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788483385.731600:0:25116:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788483385.731602:0:25116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483385.731605:0:25116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483385.731606:0:25116:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788483385.731609:0:25116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483385.731611:0:25116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483385.731612:0:25116:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788483385.731623:0:25116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788483385.731647:0:25116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483385.731650:0:25116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483385.731651:0:25116:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788483385.731654:0:25116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1788483385.731798:0:25112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788483385.731824:0:25112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788483385.731848:0:25112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0e00/0x1d7ea3d89ea1c2bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c2c6 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.731861:0:25112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0e00/0x1d7ea3d89ea1c2bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c2c6 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483385.731869:0:25112:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69d18cc000 from 1 10000000:01000000:1.0:1788483385.731872:0:25112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788483385.731905:0:25112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c8684400/0x1d7ea3d89ea1c2db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.731913:0:25112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c8684400/0x1d7ea3d89ea1c2db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.731924:0:25112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c8684400/0x1d7ea3d89ea1c2db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483385.731946:0:25112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098818432:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788483385.732007:0:25112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483385.732050:0:25112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483385.732186:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098818432 00000100:00100000:0.0:1788483385.732194:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098818432 00000100:00100000:0.0:1788483385.732240:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788483385.732250:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+22:25112:x1875360098818432:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788483385.732263:0:22782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483385.732275:0:22782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69d0401a00/0x1d7ea3d89ea1c2e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1c2db expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483385.732298:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69d0401a00/0x1d7ea3d89ea1c2e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c2db expref: 23 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483385.732316:0:22782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69d0401a00/0x1d7ea3d89ea1c2e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c2db expref: 23 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483385.732323:0:22782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69d0401a00, rc 0) 00000100:00100000:0.0:1788483385.732367:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+23:25112:x1875360098818432:12345-0@lo:101:mount.lustre.0 Request processed in 119us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483385.732373:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788483385.732564:0:25112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098818432:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483385.732578:0:25112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c8684400/0x1d7ea3d89ea1c2db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c2e2 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.732598:0:25112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c8684400/0x1d7ea3d89ea1c2db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1c2e2 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788483385.733519:0:25112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1788483385.733749:0:25112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788483385.733908:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788483385.733934:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788483385.733947:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788483385.733961:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788483385.733974:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788483385.737040:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788483385.737073:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1788483385.737084:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1788483385.737109:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1788483385.737123:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1788483385.737199:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1788483385.737226:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1788483385.737231:0:25112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1788483385.737328:0:25112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098818560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483385.737387:0:25112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483385.737434:0:25112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788483385.737640:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098818560 00000100:00100000:2.0:1788483385.737647:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098818560 00000100:00100000:2.0:1788483385.737690:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788483385.737698:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdaba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+23:25112:x1875360098818560:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483385.737805:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdaba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+23:25112:x1875360098818560:12345-0@lo:501:mount.lustre.0 Request processed in 107us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483385.737812:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788483385.739326:0:25112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098818560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483385.739371:0:25112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098818688:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788483385.739424:0:25112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483385.739459:0:25112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483385.739508:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098818688 00000100:00100000:0.0:1788483385.739513:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098818688 00000100:00100000:0.0:1788483385.739551:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788483385.739559:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+23:25112:x1875360098818688:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788483385.739660:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+23:25112:x1875360098818688:12345-0@lo:503:mount.lustre.0 Request processed in 101us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483385.739667:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788483385.739743:0:25112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098818688:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788483385.740236:0:25112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788483385.740307:0:25112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098818816:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483385.740350:0:25112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483385.740371:0:25112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483385.740428:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098818816 00000100:00100000:0.0:1788483385.740434:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098818816 00000100:00100000:0.0:1788483385.740470:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788483385.740477:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+23:25112:x1875360098818816:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483385.740558:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+23:25112:x1875360098818816:12345-0@lo:502:mount.lustre.0 Request processed in 81us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483385.740565:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788483385.741296:0:25112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098818816:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788483385.741493:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788483385.741522:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788483385.741535:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788483385.741547:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788483385.741558:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788483385.741569:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788483385.741580:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788483385.741606:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1788483385.741622:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788483385.741634:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1788483385.741646:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1788483385.741670:0:25112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098818944:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483385.741717:0:25112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483385.741744:0:25112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483385.741896:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098818944 00000100:00100000:0.0:1788483385.741902:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098818944 00000100:00100000:0.0:1788483385.741939:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788483385.741946:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+23:25112:x1875360098818944:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483385.742039:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+23:25112:x1875360098818944:12345-0@lo:502:mount.lustre.0 Request processed in 93us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483385.742052:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788483385.742430:0:25112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098818944:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788483385.742479:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1788483385.742489:0:25112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788483385.744576:0:25120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483385.744589:0:25120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483385.744591:0:25120:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788483385.744598:0:25120:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a69d18cc000 00000020:00000080:3.0:1788483385.744601:0:25120:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788483385.744610:0:25120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483385.744613:0:25120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483385.744614:0:25120:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788483385.744617:0:25120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483385.744619:0:25120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483385.744620:0:25120:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788483385.744623:0:25120:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a69d18cc000 00000020:00000080:3.0:1788483385.744625:0:25120:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788483385.744690:0:25120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483385.744693:0:25120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483385.744695:0:25120:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788483385.744697:0:25120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483385.744699:0:25120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483385.744701:0:25120:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788483385.744704:0:25120:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a69d18cc000 00000020:00000080:3.0:1788483385.744706:0:25120:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788483385.744723:0:25120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483385.744726:0:25120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483385.744727:0:25120:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788483385.744730:0:25120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483385.744732:0:25120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483385.744740:0:25120:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788483385.744744:0:25120:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a69d18cc000 00000020:00000080:3.0:1788483385.744746:0:25120:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788483385.744780:0:25120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483385.744784:0:25120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483385.744786:0:25120:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788483385.744788:0:25120:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1788483385.753619:0:25112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788483385.753672:0:25112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788483385.753689:0:25112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c8684400/0x1d7ea3d89ea1c2db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c2e2 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.753701:0:25112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c8684400/0x1d7ea3d89ea1c2db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c2e2 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483385.753763:0:25112:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788483385.753767:0:25112:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a69d18cc000 10000000:01000000:1.0:1788483385.753769:0:25112:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a69d18cc000 10000000:01000000:1.0:1788483385.753773:0:25112:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788483385.753778:0:25112:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a69d18cc000 from 1 10000000:01000000:1.0:1788483385.753781:0:25112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788483385.753815:0:25112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c8684200/0x1d7ea3d89ea1c2e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.753823:0:25112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c8684200/0x1d7ea3d89ea1c2e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.753833:0:25112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c8684200/0x1d7ea3d89ea1c2e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483385.753855:0:25112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098819072:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788483385.753915:0:25112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483385.753954:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098819072 00000100:00100000:1.0:1788483385.753961:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098819072 00000100:00100000:1.0:1788483385.753999:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788483385.754008:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+23:25112:x1875360098819072:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483385.754021:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483385.754032:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c8684800/0x1d7ea3d89ea1c2f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1c2e9 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.754054:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c8684800/0x1d7ea3d89ea1c2f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c2e9 expref: 24 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.754078:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c8684800/0x1d7ea3d89ea1c2f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c2e9 expref: 24 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.754086:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c8684800, rc 0) 00000100:00100000:1.0:1788483385.755815:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:25112:x1875360098819072:12345-0@lo:101:mount.lustre.0 Request processed in 1801us (1893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483385.755827:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788483385.755907:0:25112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788483385.755933:0:25112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098819072:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483385.755952:0:25112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c8684200/0x1d7ea3d89ea1c2e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c2f0 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.755964:0:25112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c8684200/0x1d7ea3d89ea1c2e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1c2f0 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788483385.758075:0:25112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1788483385.759524:0:25112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788483385.759743:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788483385.759772:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1788483385.759787:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1788483385.759801:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1788483385.759813:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1788483385.759825:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1788483385.759838:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1788483385.759869:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1788483385.759886:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788483385.759898:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1788483385.759911:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1788483385.759937:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1788483385.759952:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1788483385.759964:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1788483385.759975:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1788483385.759988:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1788483385.760001:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1788483385.760015:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1788483385.760027:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1788483385.760038:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1788483385.760052:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1788483385.760065:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1788483385.760078:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1788483385.762357:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1788483385.762411:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1788483385.762428:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1788483385.762441:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1788483385.762454:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1788483385.762468:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1788483385.762481:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1788483385.762494:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1788483385.762507:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1788483385.762519:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1788483385.762531:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1788483385.762544:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1788483385.762556:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1788483385.762567:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1788483385.762580:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1788483385.762592:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1788483385.762622:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1788483385.762639:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1788483385.762653:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1788483385.762664:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1788483385.762676:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1788483385.762992:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1788483385.763009:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1788483385.763022:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1788483385.763034:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1788483385.763484:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1788483385.763508:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1788483385.763526:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1788483385.763531:0:25112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1788483385.763632:0:25112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098819200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483385.763692:0:25112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483385.763734:0:25112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788483385.764299:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098819200 00000100:00100000:2.0:1788483385.764308:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098819200 00000100:00100000:2.0:1788483385.764351:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788483385.764359:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3666c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:25112:x1875360098819200:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483385.764481:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3666c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:25112:x1875360098819200:12345-0@lo:501:mount.lustre.0 Request processed in 122us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483385.764488:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788483385.765956:0:25112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3074000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098819200:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483385.766010:0:25112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098819328:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788483385.766070:0:25112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483385.766130:0:25112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0000 going to sleep for 11 seconds 00000100:00100000:1.0:1788483385.766280:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098819328 00000100:00100000:1.0:1788483385.766287:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098819328 00000100:00100000:1.0:1788483385.766331:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788483385.766341:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3667c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:25112:x1875360098819328:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788483385.766437:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3667c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:25112:x1875360098819328:12345-0@lo:503:mount.lustre.0 Request processed in 98us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483385.766445:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788483385.766530:0:25112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098819328:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788483385.766961:0:25112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788483385.767049:0:25112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098819456:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483385.767134:0:25112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483385.768287:0:25112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0000 going to sleep for 11 seconds 00000100:00100000:1.0:1788483385.768380:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098819456 00000100:00100000:1.0:1788483385.768388:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098819456 00000100:00100000:1.0:1788483385.768440:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788483385.768450:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:25112:x1875360098819456:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483385.768576:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:25112:x1875360098819456:12345-0@lo:502:mount.lustre.0 Request processed in 127us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483385.768583:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788483385.768678:0:25112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098819456:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788483385.768913:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788483385.768944:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788483385.768961:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788483385.768976:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788483385.768990:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788483385.769005:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788483385.769018:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788483385.769030:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788483385.769041:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788483385.769054:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788483385.769067:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788483385.769081:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788483385.769092:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788483385.771304:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788483385.771329:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788483385.771357:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788483385.771370:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788483385.771382:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788483385.771394:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788483385.771406:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788483385.771417:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788483385.771428:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788483385.771439:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788483385.771451:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788483385.771463:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1788483385.771476:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1788483385.771488:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1788483385.771499:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1788483385.771513:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1788483385.771526:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1788483385.771539:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1788483385.771554:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1788483385.771567:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1788483385.771581:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1788483385.771595:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1788483385.771608:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1788483385.771620:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1788483385.771632:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1788483385.771645:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1788483385.771657:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1788483385.771670:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1788483385.771702:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1788483385.771719:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1788483385.771731:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1788483385.771744:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1788483385.771756:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1788483385.771768:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1788483385.771781:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1788483385.771845:0:25112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098819584:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483385.771919:0:25112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483385.771967:0:25112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0000 going to sleep for 11 seconds 00000100:00100000:1.0:1788483385.773285:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098819584 00000100:00100000:1.0:1788483385.773295:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098819584 00000100:00100000:1.0:1788483385.773345:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788483385.773356:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3664850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:25112:x1875360098819584:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483385.773503:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3664850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:25112:x1875360098819584:12345-0@lo:502:mount.lustre.0 Request processed in 150us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483385.773512:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788483385.773783:0:25112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098819584:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788483385.773991:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1788483385.774020:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1788483385.774053:0:25112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098819712:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483385.775258:0:25112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483385.775307:0:25112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c50d0000 going to sleep for 11 seconds 00000100:00100000:1.0:1788483385.776276:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098819712 00000100:00100000:1.0:1788483385.776286:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098819712 00000100:00100000:1.0:1788483385.776332:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788483385.776342:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3667450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:25112:x1875360098819712:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483385.776469:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3667450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:25112:x1875360098819712:12345-0@lo:502:mount.lustre.0 Request processed in 128us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483385.776476:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788483385.779538:0:25112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098819712:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788483385.779649:0:25112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1788483385.779663:0:25112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788483385.783538:0:25124:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788483385.783555:0:25124:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a69c86b8000) 00000020:00000080:2.0:1788483385.783582:0:25124:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1788483385.783690:0:25124:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a69d18cc000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788483385.783695:0:25124:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a69d18cc000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788483385.783703:0:25124:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a69d18cc000 3 00010000:00080000:2.0:1788483385.783733:0:25124:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a68c2576800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.154@tcp at head 00010000:00010000:2.0:1788483385.788690:0:25124:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1788483385.788939:0:25124:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788483385.788982:0:25124:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788483385.788994:0:25124:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1d7ea3d89ea1c2fe 00000100:00080000:2.0:1788483385.789004:0:25124:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788483385.789010:0:25124:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a68c2576800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:2.0:1788483385.789043:0:25124:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69ffefb480 x1875360098819840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788483385.789067:0:25124:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788483385.789252:0:25014:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788483385.789256:0:25014:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788483385.789258:0:25014:0:(import.c:65:import_set_state_nolock()) ffff9a69f8ab9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788483385.789262:0:25014:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 676 00000100:00080000:2.0:1788483385.789265:0:25014:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788483385.789269:0:25014:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a69f8ab9000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:2.0:1788483385.789283:0:25014:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69ffefa300 x1875360098820224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788483385.789323:0:25014:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788483385.789327:0:25014:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788483385.789329:0:25014:0:(import.c:65:import_set_state_nolock()) ffff9a69e8faa800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788483385.789333:0:25014:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 676 00000100:00080000:2.0:1788483385.789335:0:25014:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788483385.789339:0:25014:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a69e8faa800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:2.0:1788483385.789351:0:25014:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69f525f800 x1875360098820736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788483385.789406:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098819968:0@lo:400:kworker.0 00000100:00100000:0.0:1788483385.789498:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1875360098819840:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788483385.789574:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098820352:0@lo:400:kworker.0 00000100:00100000:0.0:1788483385.789659:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483385.789699:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098820224:0@lo:8:kworker.0 00000100:00100000:0.0:1788483385.789723:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483385.789740:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098820736:0@lo:8:kworker.0 00000100:00100000:0.0:1788483385.789758:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483385.789798:0:24299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098820224 00000100:00100000:0.0:1788483385.789804:0:24299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098820224 00000100:00100000:0.0:1788483385.789832:0:24299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098820736 00000100:00100000:0.0:1788483385.789835:0:24299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098820736 00000100:00100000:0.0:1788483385.789851:0:24299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788483385.789857:0:24299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1875360098820224:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788483385.789909:0:24299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1875360098820224:12345-0@lo:8:kworker.0 Request processed in 50us (183us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788483385.789915:0:24299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788483385.789928:0:24299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788483385.789931:0:24299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1875360098820736:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788483385.789975:0:24299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3618:x1875360098820736:12345-0@lo:8:kworker.0 Request processed in 41us (216us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788483385.789982:0:24299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788483385.790010:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788483385.790016:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69f8ab9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483385.790020:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788483385.790023:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098820224:0@lo:8:kworker.0 00000100:00100000:0.0:1788483385.790032:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788483385.790035:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69e8faa800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483385.790037:0:3618:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788483385.790040:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098820736:0@lo:8:kworker.0 00000100:00100000:1.0:1788483385.790563:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483385.790590:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098820992:0@lo:400:kworker.0 00000100:00100000:1.0:1788483385.790616:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483385.790635:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788483385.790641:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098820096:0@lo:400:kworker.0 00000100:00100000:1.0:1788483385.790665:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483385.790682:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098820864:0@lo:400:kworker.0 00000100:00100000:1.0:1788483385.790703:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483385.790724:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098819840 00000100:00100000:1.0:1788483385.790728:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098819840 00000100:00100000:1.0:1788483385.790743:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098820352 00000100:00100000:1.0:1788483385.790745:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098820352 00000100:00100000:1.0:1788483385.790762:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098820992 00000100:00100000:1.0:1788483385.790765:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098820992 00000100:00100000:1.0:1788483385.790791:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098820864 00000100:00100000:1.0:1788483385.790800:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098820864 00000100:00100000:1.0:1788483385.790819:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788483385.790825:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098820352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483385.790867:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098820352:12345-0@lo:400:kworker.0 Request processed in 42us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483385.790874:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788483385.790888:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788483385.790895:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098820992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483385.790920:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098820992:12345-0@lo:400:kworker.0 Request processed in 26us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483385.790926:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788483385.790938:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788483385.790944:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098820864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483385.790970:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098820864:12345-0@lo:400:kworker.0 Request processed in 27us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483385.790976:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788483385.790988:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788483385.790992:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3618:x1875360098819840:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788483385.791009:0:22790:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:1.0:1788483385.791056:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1d7ea3d89ea1c305 00000004:00100000:1.0:1788483385.791069:0:22790:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788483385.791118:0:22790:0:(import.c:65:import_set_state_nolock()) ffff9a69e011d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788483385.792289:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875360098819840:12345-0@lo:38:llog_process_th.0 Request processed in 1291us (2626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483385.792300:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788483385.792357:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69f525ca80 x1875360098820864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483385.792372:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098820864:0@lo:400:kworker.0 00010000:00080000:1.0:1788483385.792385:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69f525e680 x1875360098820352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483385.792394:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098820352:0@lo:400:kworker.0 00010000:00080000:1.0:1788483385.792405:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69f525ce00 x1875360098820992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483385.792413:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098820992:0@lo:400:kworker.0 00000100:00100000:1.0:1788483385.792445:0:24299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098820096 00000100:00100000:1.0:1788483385.792449:0:24299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098820096 00000100:00100000:1.0:1788483385.792483:0:24299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788483385.792491:0:24299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3076680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098820096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483385.792533:0:24299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3076680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098820096:12345-0@lo:400:kworker.0 Request processed in 43us (1867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483385.792539:0:24299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788483385.792567:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098820096:0@lo:400:kworker.0 00010000:00080000:1.0:1788483385.792599:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69ffefb480 x1875360098819840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788483395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483385.792608:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788483385.792614:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788483385.792621:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788483385.792625:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788483385.792628:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c2576800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788483385.792638:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3618:1875360098819840:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788483385.792720:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788483385.792946:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483385.793015:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098820608:0@lo:400:kworker.0 00000100:00100000:2.0:1788483385.793046:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483385.793074:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788483385.793081:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098820480:0@lo:400:kworker.0 00000100:00100000:2.0:1788483385.793123:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483385.793185:0:24773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098820608 00000100:00100000:3.0:1788483385.793190:0:24773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098820608 00000100:00100000:3.0:1788483385.793225:0:24773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788483385.793234:0:24773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098820608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483385.793268:0:24773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098820608:12345-0@lo:400:kworker.0 Request processed in 36us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483385.793273:0:24773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788483385.793289:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788483385.796478:0:23530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098819968 00000100:00100000:1.0:1788483385.796494:0:23530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098819968 00000100:00100000:1.0:1788483385.796538:0:23530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098820480 00000100:00100000:1.0:1788483385.796541:0:23530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098820480 00000100:00100000:1.0:1788483385.796559:0:23530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788483385.796568:0:23530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098819968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483385.796642:0:23530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098819968:12345-0@lo:400:kworker.0 Request processed in 74us (3695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483385.796649:0:23530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788483385.796665:0:23530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788483385.796672:0:23530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098820480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483385.796700:0:23530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098820480:12345-0@lo:400:kworker.0 Request processed in 30us (3577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483385.796706:0:23530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788483385.800367:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098820480:0@lo:400:kworker.0 00000100:00100000:2.0:1788483385.800383:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1875360098821120:0@lo:400:kworker.0 00000100:00100000:2.0:1788483385.800442:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483385.800481:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098819968:0@lo:400:kworker.0 00000100:00100000:2.0:1788483385.800496:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098820608:0@lo:400:kworker.0 00000100:00100000:1.0:1788483385.801076:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098821120 00000100:00100000:1.0:1788483385.801083:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098821120 00000020:01000004:3.0:1788483385.801357:0:25124:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788483385.801373:0:25124:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9a69d2878000) 00000020:00000080:3.0:1788483385.801397:0:25124:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1788483385.801493:0:25124:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a69d18cc000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788483385.801497:0:25124:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a69d18cc000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788483385.801499:0:25124:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a69d18cc000 3 00010000:00080000:3.0:1788483385.801526:0:25124:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a68c3d8e800@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.154@tcp at head 00000100:00100000:1.0:1788483385.802729:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788483385.802744:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875360098821120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483385.802831:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875360098821120:12345-0@lo:400:kworker.0 Request processed in 91us (2389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483385.802839:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788483385.802884:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69f525d880 x1875360098821120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483385.802898:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3622:1875360098821120:0@lo:400:kworker.0 00000100:00080000:2.0:1788483385.802981:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788483385.805304:0:25124:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1788483385.805552:0:25124:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788483385.805601:0:25124:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788483385.805615:0:25124:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x1d7ea3d89ea1c313 00000100:00080000:3.0:1788483385.805624:0:25124:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788483385.805630:0:25124:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9a68c3d8e800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:3.0:1788483385.805669:0:25124:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69f5265c00 x1875360098821248/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788483385.805698:0:25124:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788483385.805888:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3618:1875360098821248:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788483385.805953:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788483385.808379:0:25124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1788483385.813427:0:25112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788483385.813472:0:25112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788483385.813497:0:25112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c8684200/0x1d7ea3d89ea1c2e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c2f0 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483385.813508:0:25112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c8684200/0x1d7ea3d89ea1c2e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c2f0 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788483385.813559:0:25112:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788483385.813562:0:25112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788483385.813563:0:25112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788483385.813564:0:25112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788483385.813565:0:25112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788483385.813566:0:25112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788483385.813567:0:25112:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788483385.813569:0:25112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788483385.813570:0:25112:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788483385.813573:0:25112:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788483385.813576:0:25112:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788483385.813582:0:25112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788483385.813583:0:25112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788483385.813584:0:25112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788483385.813585:0:25112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788483385.813586:0:25112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788483385.813586:0:25112:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788483385.813587:0:25112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788483385.813588:0:25112:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788483385.813613:0:25112:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788483385.813630:0:25112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f64e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098821376:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788483385.813701:0:25112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483385.813734:0:25112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c8ace180 going to sleep for 11 seconds 00000100:00100000:1.0:1788483385.813795:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098821376 00000100:00100000:1.0:1788483385.813802:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098821376 00000100:00100000:1.0:1788483385.813854:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788483385.813863:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3666050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:25112:x1875360098821376:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788483385.813887:0:22780:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788483385.813899:0:22780:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788483385.814952:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098821248 00000100:00100000:3.0:1788483385.814961:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098821248 00000100:00100000:3.0:1788483385.815022:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788483385.815029:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875360098821248:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788483385.815053:0:22788:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:3.0:1788483385.815086:0:22788:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x1d7ea3d89ea1c31a 00000004:00100000:3.0:1788483385.815127:0:22788:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788483385.815316:0:22788:0:(import.c:65:import_set_state_nolock()) ffff9a68c3d88000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788483385.815930:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875360098821248:12345-0@lo:38:llog_process_th.0 Request processed in 898us (9974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483385.815939:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788483385.816624:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69f5265c00 x1875360098821248/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788483395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483385.816637:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788483385.816647:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788483385.816655:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788483385.816660:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788483385.816663:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a68c3d8e800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788483385.816669:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3618:1875360098821248:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1788483385.824426:0:22780:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788483385.824448:0:22780:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788483385.824756:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3666050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:25112:x1875360098821376:12345-0@lo:253:mount.lustre.0 Request processed in 10888us (11049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483385.824767:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788483385.824883:0:25112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f64e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:25112:1875360098821376:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788483385.824896:0:25112:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788483385.824899:0:25112:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788483385.824901:0:25112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788483385.824902:0:25112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788483385.824903:0:25112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788483385.824904:0:25112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788483385.824905:0:25112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788483385.824907:0:25112:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788483385.824909:0:25112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788483385.824910:0:25112:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788483385.824923:0:25112:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788483385.825842:0:22804:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788483385.825848:0:22804:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788483385.825867:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c321 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483385.825882:0:22804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69d0401400/0x1d7ea3d89ea1c1ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c1a7 expref: 23 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483385.825889:0:22804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69d0401600/0x1d7ea3d89ea1c1bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c1b5 expref: 23 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483385.825896:0:22804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c321 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483385.825931:0:22804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69d0401600/0x1d7ea3d89ea1c1bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1c1b5 expref: 23 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483385.825945:0:22804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69d0401600/0x1d7ea3d89ea1c1bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c1b5 expref: 23 pid: 22783 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483385.825959:0:22804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f66d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875360098821504:0@lo:104: 00000100:00100000:0.0:1788483385.826021:0:22804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788483385.826075:0:22804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69d0401400/0x1d7ea3d89ea1c1ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1c1a7 expref: 23 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483385.826084:0:22804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69d0401400/0x1d7ea3d89ea1c1ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c1a7 expref: 23 pid: 22780 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483385.826092:0:22804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f65500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875360098821632:0@lo:104: 00000100:00100000:0.0:1788483385.826144:0:22804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483385.826162:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c8ace480 going to sleep for 11 seconds 00000100:00100000:1.0:1788483385.826274:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098821504 00000100:00100000:1.0:1788483385.826281:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098821504 00000100:00100000:1.0:1788483385.826319:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098821632 00000100:00100000:1.0:1788483385.826323:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098821632 00000100:00100000:1.0:1788483385.826338:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788483385.826345:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+4:22804:x1875360098821504:12345-0@lo:104: 00010000:00010000:1.0:1788483385.826356:0:22772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c1b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1c1bc expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.826413:0:22772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788483385.826419:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+4:22804:x1875360098821504:12345-0@lo:104: Request processed in 75us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483385.826426:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788483385.826441:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788483385.826447:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+3:22804:x1875360098821632:12345-0@lo:104: 00010000:00010000:1.0:1788483385.826454:0:22772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a400/0x1d7ea3d89ea1c1a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1c1ae expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.826480:0:22772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788483385.826485:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+3:22804:x1875360098821632:12345-0@lo:104: Request processed in 39us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483385.826490:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788483385.826505:0:23946:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788483385.826510:0:23946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c1b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1c1bc expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.826517:0:23946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8b800 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:1.0:1788483385.826521:0:23946:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c1b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1c1bc expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.826529:0:23946:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c1b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1c1bc expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788483385.826542:0:23946:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c1b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1c1bc expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483385.826548:0:23946:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788483385.826573:0:23946:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c1b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c1bc expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.826579:0:23946:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788483385.826595:0:23946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c1b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c1bc expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.826601:0:23946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69edb8b800/0x1d7ea3d89ea1c1b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c1bc expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.826614:0:23946:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483385.826618:0:23946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a400/0x1d7ea3d89ea1c1a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1c1ae expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.826623:0:23946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69edb8a400 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:1.0:1788483385.826626:0:23946:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a400/0x1d7ea3d89ea1c1a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1c1ae expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.826633:0:23946:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a400/0x1d7ea3d89ea1c1a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1c1ae expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788483385.826639:0:23946:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a400/0x1d7ea3d89ea1c1a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1c1ae expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483385.826644:0:23946:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788483385.826661:0:23946:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a400/0x1d7ea3d89ea1c1a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c1ae expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.826667:0:23946:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788483385.826679:0:23946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a400/0x1d7ea3d89ea1c1a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c1ae expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.826686:0:23946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69edb8a400/0x1d7ea3d89ea1c1a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c1ae expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.826698:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483385.826700:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483385.826701:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483385.826712:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3622:1875360098821760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788483385.826738:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483385.826771:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788483385.826779:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3620:1875360098821888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788483385.826801:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483385.826844:0:23548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098821760 00000100:00100000:1.0:1788483385.826848:0:23548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098821760 00010000:00010000:1.0:1788483385.826865:0:23548:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69d0401600/0x1d7ea3d89ea1c1bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c1b5 expref: 24 pid: 22783 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483385.826885:0:23548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098821888 00000100:00100000:1.0:1788483385.826889:0:23548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098821888 00010000:00010000:1.0:1788483385.826913:0:23548:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69d0401400/0x1d7ea3d89ea1c1ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c1a7 expref: 25 pid: 22780 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483385.826939:0:23548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788483385.826945:0:23548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+25:3622:x1875360098821760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788483385.826964:0:23548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483385.826968:0:23548:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69d0401600/0x1d7ea3d89ea1c1bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c1b5 expref: 25 pid: 22783 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.826978:0:23548:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69d0401600/0x1d7ea3d89ea1c1bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c1b5 expref: 25 pid: 22783 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.826990:0:23548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483385.827018:0:23548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+25:3622:x1875360098821760:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483385.827025:0:23548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788483385.827039:0:23548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788483385.827044:0:23548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:3620:x1875360098821888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788483385.827061:0:23548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483385.827067:0:23548:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69d0401400/0x1d7ea3d89ea1c1ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c1a7 expref: 24 pid: 22780 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.827075:0:23548:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69d0401400/0x1d7ea3d89ea1c1ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c1a7 expref: 24 pid: 22780 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.827087:0:23548:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c321 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.827124:0:23548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c321 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483385.827253:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483385.828442:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69d0401600/0x1d7ea3d89ea1c1bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c1b5 expref: 24 pid: 22783 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483385.828461:0:22804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f66d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875360098821504:0@lo:104: 00010000:00010000:0.0:1788483385.828473:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69d0401400/0x1d7ea3d89ea1c1ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c1a7 expref: 23 pid: 22780 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483385.828482:0:22804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f65500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875360098821632:0@lo:104: 00010000:00010000:0.0:1788483385.828506:0:22804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c321 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788483385.829732:0:23548:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003883171s 00010000:00010000:1.0:1788483385.829744:0:23548:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c321 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.829775:0:23548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c321 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.829782:0:23548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c321 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.829790:0:23548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c321 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.829796:0:23548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401800 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483385.829801:0:23548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c321 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.829809:0:23548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c321 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.829830:0:23548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c321 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483385.829841:0:23548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483385.829913:0:23548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+22:3620:x1875360098821888:12345-0@lo:103:ldlm_bl.0 Request processed in 2866us (3107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483385.829923:0:23548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788483385.829992:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3622:1875360098821760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788483385.830022:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3620:1875360098821888:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788483385.830408:0:22804:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c321 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483385.830418:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c321 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483385.830425:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69d0401800/0x1d7ea3d89ea1c321 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1788483385.838390:0:25112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1788483385.840866:0:25112:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788483385.840877:0:25112:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788483385.840916:0:25112:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788483385.840963:0:25112:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.154@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788483385.840984:0:25112:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788483385.841000:0:25112:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788483385.845036:0:25112:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788483385.845330:0:25112:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788483386.233656:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788483386.847074:0:25178:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788483386.847541:0:25178:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788483387.256783:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788483387.640214:0:22785:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788483387.640222:0:22785:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a69efd92000 from 14 10000000:01000000:1.0:1788483387.640234:0:22785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788483387.640292:0:22785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c8684000/0x1d7ea3d89ea1c328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483387.640311:0:22785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c8684000/0x1d7ea3d89ea1c328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483387.640323:0:22785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c8684000/0x1d7ea3d89ea1c328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483387.640348:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098822016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788483387.640748:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483387.640832:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c11ca900 going to sleep for 11 seconds 00000100:00100000:2.0:1788483387.644831:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098822016 00000100:00100000:2.0:1788483387.644844:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098822016 00000100:00100000:2.0:1788483387.644919:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788483387.644928:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+22:22785:x1875360098822016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788483387.645032:0:22783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483387.645051:0:22783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecf27e00/0x1d7ea3d89ea1c32f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1c328 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483387.645077:0:22783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecf27e00/0x1d7ea3d89ea1c32f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c328 expref: 23 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483387.645119:0:22783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecf27e00/0x1d7ea3d89ea1c32f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c328 expref: 23 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483387.645128:0:22783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf27e00, rc 0) 00000100:00100000:2.0:1788483387.645223:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+23:22785:x1875360098822016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 296us (4475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483387.645231:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788483387.647342:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098822016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788483387.647369:0:22785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c8684000/0x1d7ea3d89ea1c328 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c32f expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483387.647382:0:22785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c8684000/0x1d7ea3d89ea1c328 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1c32f expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483387.647448:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098822144:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788483387.647516:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483387.647564:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd93e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483387.647642:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098822144 00000100:00100000:1.0:1788483387.647649:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098822144 00000100:00100000:1.0:1788483387.647686:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788483387.647694:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+23:22785:x1875360098822144:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788483387.647712:0:22780:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788483387.647727:0:22780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788483387.647730:0:22780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788483387.647809:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+23:22785:x1875360098822144:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483387.647817:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788483387.651456:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098822144:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788483387.651538:0:22785:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788483387.651548:0:22785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c8684000/0x1d7ea3d89ea1c328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c32f expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483387.651559:0:22785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c8684000/0x1d7ea3d89ea1c328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c32f expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483387.651575:0:22785:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788483387.651578:0:22785:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a68c4d04800 from 14 10000000:01000000:1.0:1788483387.651581:0:22785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788483387.651612:0:22785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c8685400/0x1d7ea3d89ea1c336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483387.651621:0:22785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69c8685400/0x1d7ea3d89ea1c336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483387.651630:0:22785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69c8685400/0x1d7ea3d89ea1c336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483387.651649:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098822272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788483387.651709:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483387.651757:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d2828300 going to sleep for 11 seconds 00000100:00100000:3.0:1788483387.652233:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098822272 00000100:00100000:3.0:1788483387.652240:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098822272 00000100:00100000:3.0:1788483387.652360:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788483387.652370:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3666850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+23:22785:x1875360098822272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788483387.652382:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483387.652395:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecee1400/0x1d7ea3d89ea1c33d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1c336 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483387.652418:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecee1400/0x1d7ea3d89ea1c33d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c336 expref: 24 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483387.652429:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecee1400/0x1d7ea3d89ea1c33d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c336 expref: 24 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483387.652438:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1400, rc 0) 00000100:00100000:3.0:1788483387.652531:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3666850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:22785:x1875360098822272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483387.652538:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788483387.656011:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098822272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788483387.656037:0:22785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69c8685400/0x1d7ea3d89ea1c336 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c33d expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483387.656049:0:22785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69c8685400/0x1d7ea3d89ea1c336 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1c33d expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483387.656410:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098822400:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788483387.656484:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483387.656558:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd93e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788483387.656602:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098822400 00000100:00100000:3.0:1788483387.656609:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098822400 00000100:00100000:3.0:1788483387.656695:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788483387.656704:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3665c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:22785:x1875360098822400:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788483387.656722:0:22783:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788483387.656737:0:22783:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788483387.656740:0:22783:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1788483387.656828:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3665c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:22785:x1875360098822400:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483387.656836:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788483387.656900:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098822400:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788483387.656967:0:22785:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788483387.656975:0:22785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69c8685400/0x1d7ea3d89ea1c336 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c33d expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483387.656984:0:22785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69c8685400/0x1d7ea3d89ea1c336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c33d expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483388.154669:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098822528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788483388.154732:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483388.154784:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098822528 00000100:00100000:2.0:1788483388.154791:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098822528 00000100:00100000:2.0:1788483388.154839:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788483388.154848:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098822528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788483388.154874:0:24301:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788483388.154912:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098822528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483388.154919:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788483388.154938:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788483388.154971:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098822528:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788483388.158710:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788483388.158734:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098822656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788483388.158798:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483388.158951:0:23530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098822656 00000100:00100000:1.0:1788483388.158960:0:23530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098822656 00000100:00100000:1.0:1788483388.159009:0:23530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788483388.159019:0:23530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098822656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788483388.159048:0:23530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788483388.159121:0:23530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098822656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483388.159129:0:23530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788483388.159199:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098822656:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788483388.284525:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483388.664265:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788483388.664287:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098822784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788483388.664364:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483388.664412:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098822784 00000100:00100000:0.0:1788483388.664419:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098822784 00000100:00100000:0.0:1788483388.664464:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788483388.664473:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098822784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788483388.664506:0:22794:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788483388.664550:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098822784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483388.664557:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788483388.664599:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098822784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788483389.177346:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098822912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788483389.177414:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483389.177549:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098822912 00000100:00100000:0.0:1788483389.177557:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098822912 00000100:00100000:0.0:1788483389.177619:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788483389.177628:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098822912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788483389.177647:0:24301:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:2.0:1788483389.178427:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483389.178620:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098822912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 991us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483389.178630:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788483389.178707:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098822912:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788483389.306382:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483390.329476:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788483391.227672:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483391.227679:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788483391.227682:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a69f8ab9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483391.227694:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a69f8ab9000 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483391.227714:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68c3f67480 x1875360098823424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788483391.227748:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483391.227759:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788483391.227761:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a69e8faa800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483391.227766:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a69e8faa800 using connection 192.168.206.154@tcp/0@lo 00000100:00100000:0.0:1788483391.227780:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a69ffefbb80 x1875360098823936/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788483391.227835:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098823552:0@lo:400:kworker.0 00000100:00100000:0.0:1788483391.227895:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483391.227928:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098824192:0@lo:400:kworker.0 00000100:00100000:0.0:1788483391.227950:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483391.227973:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788483391.227979:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3619:1875360098823040:0@lo:400:kworker.0 00000100:00100000:0.0:1788483391.228007:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483391.228034:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098823680:0@lo:400:kworker.0 00000100:00100000:0.0:1788483391.228065:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483391.228083:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098824320:0@lo:400:kworker.0 00000100:00100000:0.0:1788483391.228125:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483391.228162:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098823168:0@lo:400:kworker.0 00000100:00100000:0.0:1788483391.228185:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483391.228202:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098823808:0@lo:400:kworker.0 00000100:00100000:0.0:1788483391.228223:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483391.228240:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098824448:0@lo:400:kworker.0 00000100:00100000:0.0:1788483391.228259:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483391.228271:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788483391.228276:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098823296:0@lo:400:kworker.0 00000100:00100000:3.0:1788483391.228407:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098823552 00000100:00100000:3.0:1788483391.228416:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098823552 00000100:00100000:3.0:1788483391.228450:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098824192 00000100:00100000:3.0:1788483391.228453:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098824192 00000100:00100000:3.0:1788483391.228476:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098824320 00000100:00100000:3.0:1788483391.228479:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098824320 00000100:00100000:3.0:1788483391.228490:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098824448 00000100:00100000:3.0:1788483391.228493:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098824448 00000100:00100000:3.0:1788483391.228506:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788483391.228514:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098823552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483391.228569:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098823552:12345-0@lo:400:kworker.0 Request processed in 54us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483391.228576:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788483391.228591:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788483391.228598:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098824192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483391.228625:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098824192:12345-0@lo:400:kworker.0 Request processed in 28us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483391.228638:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788483391.228649:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788483391.228655:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098824320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483391.228684:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098824320:12345-0@lo:400:kworker.0 Request processed in 29us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483391.228689:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788483391.228699:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788483391.228705:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098824448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483391.228730:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098824448:12345-0@lo:400:kworker.0 Request processed in 25us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483391.228735:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788483391.228751:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788483391.228755:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788483391.228815:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483391.228845:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098824064:0@lo:400:kworker.0 00000100:00100000:0.0:1788483391.228866:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483391.228884:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098824576:0@lo:400:kworker.0 00000100:00100000:0.0:1788483391.228908:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788483391.228935:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edb85f80 x1875360098824448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483391.228947:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098824448:0@lo:400:kworker.0 00000100:00100000:0.0:1788483391.228975:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098823424:0@lo:8:kworker.0 00000100:00100000:0.0:1788483391.228997:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483391.229015:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098823936:0@lo:8:kworker.0 00000100:00100000:0.0:1788483391.229054:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483391.229080:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098824064 00000100:00100000:0.0:1788483391.229083:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098824064 00000100:00100000:0.0:1788483391.229120:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098824576 00000100:00100000:0.0:1788483391.229123:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098824576 00000100:00100000:0.0:1788483391.229158:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788483391.229164:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098824064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483391.229198:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098824064:12345-0@lo:400:kworker.0 Request processed in 34us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483391.229204:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788483391.229217:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788483391.229223:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098824576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483391.229248:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098824576:12345-0@lo:400:kworker.0 Request processed in 26us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483391.229264:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788483391.229483:0:24773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098823808 00000100:00100000:3.0:1788483391.229488:0:24773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098823808 00000100:00100000:3.0:1788483391.229509:0:24773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098823296 00000100:00100000:3.0:1788483391.229512:0:24773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098823296 00000100:00100000:3.0:1788483391.229522:0:24773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098823424 00000100:00100000:3.0:1788483391.229524:0:24773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098823424 00000100:00100000:3.0:1788483391.229531:0:24773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098823936 00000100:00100000:3.0:1788483391.229533:0:24773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098823936 00000100:00100000:3.0:1788483391.229541:0:24773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788483391.229548:0:24773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098823808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483391.229579:0:24773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098823808:12345-0@lo:400:kworker.0 Request processed in 32us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483391.229585:0:24773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788483391.229597:0:24773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788483391.229610:0:24773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098823296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483391.229641:0:24773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098823296:12345-0@lo:400:kworker.0 Request processed in 32us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483391.229647:0:24773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788483391.229658:0:24773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788483391.229661:0:24773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3618:x1875360098823424:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788483391.229685:0:24773:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 683 last 0 00000020:00000080:3.0:1788483391.229710:0:24773:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d7ea3d89ea1c344 00002000:00100000:3.0:1788483391.229724:0:24773:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a68c3d8a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788483391.229728:0:24773:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788483391.229732:0:24773:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788483391.229906:0:24773:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788483391.229929:0:24773:0:(import.c:65:import_set_state_nolock()) ffff9a68c3d8c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788483391.229972:0:24773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3618:x1875360098823424:12345-0@lo:8:kworker.0 Request processed in 308us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483391.229978:0:24773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788483391.229991:0:24773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788483391.229995:0:24773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3618:x1875360098823936:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788483391.230009:0:24773:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 683 last 0 00000020:00000080:3.0:1788483391.230024:0:24773:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1d7ea3d89ea1c34b 00002000:00100000:3.0:1788483391.230029:0:24773:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9a68c3d8c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788483391.230033:0:24773:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788483391.230034:0:24773:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788483391.230054:0:24773:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788483391.230065:0:24773:0:(import.c:65:import_set_state_nolock()) ffff9a68c3d8a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788483391.230119:0:24773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3618:x1875360098823936:12345-0@lo:8:kworker.0 Request processed in 122us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483391.230125:0:24773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788483391.230175:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3f67480 x1875360098823424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788483416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788483391.230188:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788483391.230194:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788483391.230198:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788483391.230200:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69f8ab9000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788483391.230216:0:3618:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788483391.230220:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3618:1875360098823424:0@lo:8:kworker.0 00010000:00080000:3.0:1788483391.230231:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69ffefbb80 x1875360098823936/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788483416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788483391.230239:0:3618:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788483391.230244:0:3618:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788483391.230246:0:3618:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788483391.230248:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a69e8faa800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788483391.230257:0:3618:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788483391.230260:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3618:1875360098823936:0@lo:8:kworker.0 00000004:00080000:3.0:1788483391.230381:0:22815:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1788483391.230400:0:22815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5265f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22815:1875360098824832:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788483391.230426:0:22815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483391.230441:0:22815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69ecdab840 going to sleep for 11 seconds 00000004:00080000:3.0:1788483391.230461:0:23534:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788483391.230473:0:23534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23534:1875360098825088:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788483391.230502:0:23534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483391.230510:0:23534:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd2540 going to sleep for 11 seconds 00000100:00100000:3.0:1788483391.230522:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098824960:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788483391.230542:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483391.230560:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788483391.230565:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f5265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098824704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788483391.230582:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483391.230609:0:24302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098824960 00000100:00100000:3.0:1788483391.230613:0:24302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098824960 00000100:00100000:3.0:1788483391.230631:0:24302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098824704 00000100:00100000:3.0:1788483391.230634:0:24302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098824704 00000100:00100000:3.0:1788483391.230647:0:24302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788483391.230654:0:24302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1875360098824960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788483391.230672:0:24302:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788483391.230706:0:24302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1875360098824960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483391.230712:0:24302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788483391.230724:0:24302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788483391.230729:0:24302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875360098824704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788483391.230738:0:24302:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788483391.230761:0:24302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875360098824704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483391.230766:0:24302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788483391.230812:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f5265180 x1875360098824704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483391.230826:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098824704:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788483391.230844:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f5267b80 x1875360098824960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483391.230855:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098824960:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788483391.230873:0:24773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098824832 00000100:00100000:3.0:1788483391.230877:0:24773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098824832 00000100:00100000:3.0:1788483391.230891:0:24773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098825088 00000100:00100000:3.0:1788483391.230894:0:24773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098825088 00000100:00100000:3.0:1788483391.230904:0:24773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788483391.230909:0:24773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22815:x1875360098824832:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788483391.231215:0:24298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788483391.231225:0:24298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23534:x1875360098825088:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1788483391.231271:0:23533:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788483391.231349:0:23533:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 683494251571ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788483391.231355:0:23533:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788483391.232411:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098823680 00000100:00100000:2.0:1788483391.232421:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098823680 00000100:00100000:2.0:1788483391.232466:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098823168 00000100:00100000:2.0:1788483391.232469:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098823168 00000100:00100000:2.0:1788483391.232488:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788483391.232494:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098823680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483391.232560:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098823680:12345-0@lo:400:kworker.0 Request processed in 66us (4493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483391.232574:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788483391.232590:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788483391.232596:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098823168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483391.232625:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098823168:12345-0@lo:400:kworker.0 Request processed in 30us (4439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483391.232631:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788483391.232670:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098823680:0@lo:400:kworker.0 00010000:00080000:2.0:1788483391.232685:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69ffefa300 x1875360098824320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483391.232695:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098824320:0@lo:400:kworker.0 00010000:00080000:2.0:1788483391.232708:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3f64e00 x1875360098823552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483391.232716:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098823552:0@lo:400:kworker.0 00010000:00080000:2.0:1788483391.232726:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69ffef9180 x1875360098824192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483391.232742:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098824192:0@lo:400:kworker.0 00000100:00100000:0.0:1788483391.232833:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098823040 00000100:00100000:0.0:1788483391.232838:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098823040 00000004:00080000:0.0:1788483391.232857:0:22814:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788483391.232973:0:22814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 683495875629ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788483391.232979:0:22814:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:0.0:1788483391.232998:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788483391.233003:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788483391.233006:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788483391.233029:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098823296:0@lo:400:kworker.0 00010000:00080000:0.0:1788483391.233041:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69ffefb480 x1875360098824064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483391.233050:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098824064:0@lo:400:kworker.0 00010000:00080000:0.0:1788483391.233060:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edb85180 x1875360098824576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483391.233068:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098824576:0@lo:400:kworker.0 00000100:00100000:0.0:1788483391.233077:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098823168:0@lo:400:kworker.0 00000100:00100000:0.0:1788483391.233086:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098823808:0@lo:400:kworker.0 00000100:00100000:0.0:1788483391.233162:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788483391.233170:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3664050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:3619:x1875360098823040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483391.233207:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3664050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:3619:x1875360098823040:12345-0@lo:400:kworker.0 Request processed in 38us (5199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483391.233213:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788483391.233242:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3619:1875360098823040:0@lo:400:kworker.0 00000004:00080000:3.0:1788483391.237633:0:23522:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:0.0:1788483391.240014:0:24773:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788483391.240024:0:24773:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1788483391.240030:0:24773:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00000004:00080000:3.0:1788483391.252013:0:22768:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788483391.268210:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483391.268222:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7380325/0x1d7ea3d89ea1c352 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.268238:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788483391.268242:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483391.268248:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7380325/0x1d7ea3d89ea1c352 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.268265:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7380325/0x1d7ea3d89ea1c352 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.268276:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7380325/0x1d7ea3d89ea1c352 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.268283:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7380325/0x1d7ea3d89ea1c352 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.268302:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483391.268314:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483391.268318:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7380325/0x1d7ea3d89ea1c352 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.268326:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401600 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483391.268338:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7380325/0x1d7ea3d89ea1c352 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.268346:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7380325/0x1d7ea3d89ea1c352 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.268362:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7380325/0x1d7ea3d89ea1c352 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.268369:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7380325/0x1d7ea3d89ea1c352 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.268383:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483391.268385:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483391.268387:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483391.269282:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483391.269292:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c359 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.269302:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788483391.269306:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483391.269312:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c359 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.269322:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c359 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.269332:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c359 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.269348:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c359 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.269367:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788483391.271359:0:24298:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788483391.271366:0:24298:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788483391.271451:0:24298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23534:x1875360098825088:12345-0@lo:7:osp-pre-1-1.0 Request processed in 40224us (40944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483391.271461:0:24298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788483391.271518:0:23534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23534:1875360098825088:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788483391.271532:0:23534:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788483391.271569:0:23534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23534:1875360098825216:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788483391.271602:0:23534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483391.271621:0:23534:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788483391.271637:0:24298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098825216 00000100:00100000:3.0:1788483391.271644:0:24298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098825216 00000100:00100000:3.0:1788483391.271688:0:24298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788483391.271696:0:24298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23534:x1875360098825216:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788483391.271719:0:24298:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1788483391.271759:0:24298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23534:x1875360098825216:12345-0@lo:5:osp-pre-1-1.0 Request processed in 64us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483391.271765:0:24298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788483391.271789:0:23534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23534:1875360098825216:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788483391.271798:0:23534:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788483391.271819:0:23534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c452ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23534:1875360098825344:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788483391.271839:0:23534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483391.271848:0:23534:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c3cd9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788483391.271858:0:24298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098825344 00000100:00100000:3.0:1788483391.271862:0:24298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098825344 00000100:00100000:3.0:1788483391.271877:0:24298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788483391.271882:0:24298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23534:x1875360098825344:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788483391.271902:0:24298:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:0.0:1788483391.272148:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483391.272157:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c360 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.272171:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788483391.272176:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483391.272182:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c360 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.272194:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c360 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.272204:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c360 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.272211:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c360 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.272227:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788483391.273360:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788483391.273371:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c359 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.273382:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401000 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483391.273387:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c359 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.273395:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c359 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.273424:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c359 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.273431:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c359 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.273456:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483391.273459:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c360 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.273465:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0400400 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483391.273468:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c360 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.273490:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c360 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.273501:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c360 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.273508:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c360 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.273521:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483391.273523:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483391.273525:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483391.273538:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788483391.273842:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788483391.273849:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000884460d5/0x1d7ea3d89ea1c367 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.273858:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=683s v=(0 0) 00010000:00010000:2.0:1788483391.273862:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483391.273868:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000884460d5/0x1d7ea3d89ea1c367 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.273878:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000884460d5/0x1d7ea3d89ea1c367 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.273886:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000884460d5/0x1d7ea3d89ea1c367 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.273900:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000884460d5/0x1d7ea3d89ea1c367 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.273923:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788483391.274520:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788483391.274528:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1c36e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.274536:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=683s v=(0 0) 00010000:00010000:2.0:1788483391.274540:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483391.274543:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1c36e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.274552:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1c36e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.274560:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1c36e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.274567:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1c36e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.274581:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788483391.274588:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788483391.274592:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000884460d5/0x1d7ea3d89ea1c367 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.274605:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26600 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483391.274609:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000884460d5/0x1d7ea3d89ea1c367 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.274617:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000884460d5/0x1d7ea3d89ea1c367 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.274629:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000884460d5/0x1d7ea3d89ea1c367 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.274636:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000884460d5/0x1d7ea3d89ea1c367 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.274651:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483391.274654:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1c36e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.274660:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483391.274663:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1c36e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.274670:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1c36e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.274680:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1c36e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.274693:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b6a20f0/0x1d7ea3d89ea1c36e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.274705:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483391.274707:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483391.274709:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483391.274979:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788483391.275529:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788483391.275537:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1c375 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.275547:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=683s v=(0 0) 00010000:00010000:2.0:1788483391.275551:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483391.275556:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1c375 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.275566:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1c375 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.275575:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1c375 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.275582:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1c375 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.275598:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483391.275607:0:23946:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483391.275617:0:23946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1c375 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.275624:0:23946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27000 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483391.275628:0:23946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1c375 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.275635:0:23946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1c375 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.275647:0:23946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1c375 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.275654:0:23946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5605d9a/0x1d7ea3d89ea1c375 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.275667:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483391.275669:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483391.275670:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788483391.283040:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788483391.283055:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee665437/0x1d7ea3d89ea1c37c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.283072:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788483391.283085:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483391.283092:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee665437/0x1d7ea3d89ea1c37c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.283149:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee665437/0x1d7ea3d89ea1c37c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.283161:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee665437/0x1d7ea3d89ea1c37c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.283180:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee665437/0x1d7ea3d89ea1c37c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.283212:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483391.283227:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483391.283233:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee665437/0x1d7ea3d89ea1c37c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.283241:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0600 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483391.283246:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee665437/0x1d7ea3d89ea1c37c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.283254:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee665437/0x1d7ea3d89ea1c37c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.283273:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee665437/0x1d7ea3d89ea1c37c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.283281:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee665437/0x1d7ea3d89ea1c37c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.283307:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483391.283311:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483391.283314:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788483391.285769:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788483391.285801:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096979fad/0x1d7ea3d89ea1c383 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.285818:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788483391.285822:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483391.285828:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096979fad/0x1d7ea3d89ea1c383 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.285840:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096979fad/0x1d7ea3d89ea1c383 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.285850:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096979fad/0x1d7ea3d89ea1c383 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.285858:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096979fad/0x1d7ea3d89ea1c383 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.285880:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483391.285892:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483391.285898:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096979fad/0x1d7ea3d89ea1c383 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.285906:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1a00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483391.285910:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096979fad/0x1d7ea3d89ea1c383 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.285919:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096979fad/0x1d7ea3d89ea1c383 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.285941:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096979fad/0x1d7ea3d89ea1c383 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.285949:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096979fad/0x1d7ea3d89ea1c383 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.285978:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483391.285981:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483391.285983:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788483391.286459:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788483391.286466:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feccbdf7/0x1d7ea3d89ea1c38a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.286475:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788483391.286479:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483391.286483:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000feccbdf7/0x1d7ea3d89ea1c38a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.286492:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000feccbdf7/0x1d7ea3d89ea1c38a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.286499:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feccbdf7/0x1d7ea3d89ea1c38a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.286505:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000feccbdf7/0x1d7ea3d89ea1c38a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.286534:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483391.286544:0:23946:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483391.286548:0:23946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000feccbdf7/0x1d7ea3d89ea1c38a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.286554:0:23946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0800 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483391.286558:0:23946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000feccbdf7/0x1d7ea3d89ea1c38a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.286564:0:23946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000feccbdf7/0x1d7ea3d89ea1c38a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.286575:0:23946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000feccbdf7/0x1d7ea3d89ea1c38a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.286582:0:23946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000feccbdf7/0x1d7ea3d89ea1c38a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.286599:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483391.286601:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483391.286603:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788483391.286916:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788483391.286922:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068fc6045/0x1d7ea3d89ea1c391 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.286931:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788483391.286939:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483391.286944:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068fc6045/0x1d7ea3d89ea1c391 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.286953:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068fc6045/0x1d7ea3d89ea1c391 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.286962:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068fc6045/0x1d7ea3d89ea1c391 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.286981:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068fc6045/0x1d7ea3d89ea1c391 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.286995:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483391.287003:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483391.287008:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068fc6045/0x1d7ea3d89ea1c391 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.287015:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1600 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483391.287018:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068fc6045/0x1d7ea3d89ea1c391 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.287026:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068fc6045/0x1d7ea3d89ea1c391 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.287038:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068fc6045/0x1d7ea3d89ea1c391 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.287057:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068fc6045/0x1d7ea3d89ea1c391 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.287071:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483391.287073:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483391.287075:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788483391.290273:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788483391.290285:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001360315b/0x1d7ea3d89ea1c398 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.290303:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788483391.290307:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483391.290313:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001360315b/0x1d7ea3d89ea1c398 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.290326:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001360315b/0x1d7ea3d89ea1c398 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.290336:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001360315b/0x1d7ea3d89ea1c398 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.290344:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001360315b/0x1d7ea3d89ea1c398 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.290364:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483391.290617:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483391.290631:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001360315b/0x1d7ea3d89ea1c398 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.290639:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0000 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483391.290644:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001360315b/0x1d7ea3d89ea1c398 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.290655:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001360315b/0x1d7ea3d89ea1c398 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.290671:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001360315b/0x1d7ea3d89ea1c398 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.290678:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001360315b/0x1d7ea3d89ea1c398 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.290697:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483391.290699:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483391.290700:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483391.292669:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483391.292681:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041957bd0/0x1d7ea3d89ea1c39f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.292706:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=683s v=(0 0) 00010000:00010000:1.0:1788483391.292710:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483391.292716:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041957bd0/0x1d7ea3d89ea1c39f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.292729:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041957bd0/0x1d7ea3d89ea1c39f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.292738:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041957bd0/0x1d7ea3d89ea1c39f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.292745:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041957bd0/0x1d7ea3d89ea1c39f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.292769:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788483391.295597:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483391.295609:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a1d00eb/0x1d7ea3d89ea1c3a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.295625:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=683s v=(0 0) 00010000:00010000:1.0:1788483391.295630:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483391.295635:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a1d00eb/0x1d7ea3d89ea1c3a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.295649:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a1d00eb/0x1d7ea3d89ea1c3a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.295670:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a1d00eb/0x1d7ea3d89ea1c3a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.295678:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a1d00eb/0x1d7ea3d89ea1c3a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.295701:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788483391.295710:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788483391.295719:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041957bd0/0x1d7ea3d89ea1c39f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.295730:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c8685a00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483391.295734:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041957bd0/0x1d7ea3d89ea1c39f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.295757:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041957bd0/0x1d7ea3d89ea1c39f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.295869:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041957bd0/0x1d7ea3d89ea1c39f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.295880:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041957bd0/0x1d7ea3d89ea1c39f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.295902:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483391.295906:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a1d00eb/0x1d7ea3d89ea1c3a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.295913:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c8684c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:3.0:1788483391.295916:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a1d00eb/0x1d7ea3d89ea1c3a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.295924:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a1d00eb/0x1d7ea3d89ea1c3a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.295936:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a1d00eb/0x1d7ea3d89ea1c3a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.295943:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a1d00eb/0x1d7ea3d89ea1c3a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483391.295977:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483391.295979:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483391.295981:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483391.296014:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483391.297579:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483391.297590:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf124394/0x1d7ea3d89ea1c3ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.297604:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=683s v=(0 0) 00010000:00010000:1.0:1788483391.297609:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483391.297614:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf124394/0x1d7ea3d89ea1c3ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.297625:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf124394/0x1d7ea3d89ea1c3ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.297634:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf124394/0x1d7ea3d89ea1c3ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.297642:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf124394/0x1d7ea3d89ea1c3ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.297679:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483391.298055:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483391.298066:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf124394/0x1d7ea3d89ea1c3ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.298074:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c8685c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483391.298086:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf124394/0x1d7ea3d89ea1c3ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.298093:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf124394/0x1d7ea3d89ea1c3ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.298134:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf124394/0x1d7ea3d89ea1c3ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.298151:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf124394/0x1d7ea3d89ea1c3ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.298170:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483391.298172:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483391.298179:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483391.300585:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483391.300597:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7380325/0x1d7ea3d89ea1c3b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.300613:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788483391.300618:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483391.300624:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7380325/0x1d7ea3d89ea1c3b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.300650:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7380325/0x1d7ea3d89ea1c3b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.300660:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7380325/0x1d7ea3d89ea1c3b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.300668:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7380325/0x1d7ea3d89ea1c3b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.300684:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483391.301009:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483391.301016:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7380325/0x1d7ea3d89ea1c3b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.301025:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401600 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483391.301030:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7380325/0x1d7ea3d89ea1c3b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.301039:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7380325/0x1d7ea3d89ea1c3b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.301056:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7380325/0x1d7ea3d89ea1c3b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.301064:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7380325/0x1d7ea3d89ea1c3b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.301091:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483391.301093:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483391.301126:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483391.302698:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483391.302711:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c3bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.302726:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788483391.302731:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483391.302736:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c3bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.302748:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c3bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.302758:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c3bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.302777:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c3bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.302795:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483391.302806:0:23946:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483391.302812:0:23946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c3bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.302819:0:23946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0400800 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483391.302823:0:23946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c3bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.302832:0:23946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c3bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.302845:0:23946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c3bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.302853:0:23946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c3bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.302869:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483391.302871:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483391.302873:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483391.304555:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483391.304574:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c3c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.304588:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788483391.304592:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483391.304597:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c3c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.304609:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c3c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.304617:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c3c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.304625:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c3c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.304643:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483391.304655:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483391.304659:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c3c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.304667:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401e00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483391.304671:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c3c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.304679:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c3c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.304700:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c3c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.304708:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c3c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.306173:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483391.306178:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483391.306181:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483391.308624:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483391.308636:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c3c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.308650:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788483391.308655:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483391.308661:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c3c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.308674:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c3c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.308683:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c3c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.308691:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c3c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.308730:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788483391.309255:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483391.309261:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c3d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.309270:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788483391.309273:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483391.309277:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c3d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.309286:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c3d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.309294:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c3d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.309302:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c3d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.309319:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788483391.309479:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788483391.309486:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c3c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.309493:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0400400 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483391.309504:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c3c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.309514:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c3c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.309529:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c3c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.309536:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0da9cdb/0x1d7ea3d89ea1c3c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.309552:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483391.309556:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c3d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.309562:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401000 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483391.309564:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c3d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.309571:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c3d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.309579:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c3d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.309586:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c3d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.309604:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483391.309605:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483391.309607:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483391.309990:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483391.311176:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483391.311186:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090617662/0x1d7ea3d89ea1c3d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.311199:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=683s v=(0 0) 00010000:00010000:1.0:1788483391.311203:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483391.311208:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090617662/0x1d7ea3d89ea1c3d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.311220:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090617662/0x1d7ea3d89ea1c3d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.311229:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090617662/0x1d7ea3d89ea1c3d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.311237:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090617662/0x1d7ea3d89ea1c3d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.311252:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483391.311821:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483391.311829:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090617662/0x1d7ea3d89ea1c3d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.311838:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c8685e00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483391.311850:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090617662/0x1d7ea3d89ea1c3d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.311859:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090617662/0x1d7ea3d89ea1c3d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.311876:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090617662/0x1d7ea3d89ea1c3d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.311883:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090617662/0x1d7ea3d89ea1c3d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.311904:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483391.311906:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483391.311908:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483391.312294:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483391.312301:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6bd868e/0x1d7ea3d89ea1c3de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.312321:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=683s v=(0 0) 00010000:00010000:1.0:1788483391.312324:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483391.312329:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6bd868e/0x1d7ea3d89ea1c3de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.312339:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6bd868e/0x1d7ea3d89ea1c3de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.312348:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6bd868e/0x1d7ea3d89ea1c3de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.312356:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6bd868e/0x1d7ea3d89ea1c3de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.312376:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483391.312588:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483391.312593:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6bd868e/0x1d7ea3d89ea1c3de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.312601:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c8684e00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483391.312604:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6bd868e/0x1d7ea3d89ea1c3de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.312611:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6bd868e/0x1d7ea3d89ea1c3de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.312623:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6bd868e/0x1d7ea3d89ea1c3de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.312637:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6bd868e/0x1d7ea3d89ea1c3de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.312652:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483391.312654:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483391.312655:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483391.315822:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483391.315836:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000905c4ce5/0x1d7ea3d89ea1c3e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.315852:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788483391.315856:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483391.315862:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000905c4ce5/0x1d7ea3d89ea1c3e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.315874:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000905c4ce5/0x1d7ea3d89ea1c3e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.315884:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000905c4ce5/0x1d7ea3d89ea1c3e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.315892:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000905c4ce5/0x1d7ea3d89ea1c3e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.315917:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788483391.316494:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483391.316519:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c3ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.316528:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788483391.316531:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483391.316535:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c3ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.316543:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c3ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.316551:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c3ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.316556:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c3ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.316570:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788483391.316579:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788483391.316584:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000905c4ce5/0x1d7ea3d89ea1c3e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.316590:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401400 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483391.316595:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000905c4ce5/0x1d7ea3d89ea1c3e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.316603:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000905c4ce5/0x1d7ea3d89ea1c3e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.316625:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000905c4ce5/0x1d7ea3d89ea1c3e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.316631:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000905c4ce5/0x1d7ea3d89ea1c3e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.316648:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483391.316651:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c3ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.316656:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401800 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483391.316659:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c3ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.316665:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c3ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.316671:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c3ec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.316677:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c3ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.316696:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483391.316698:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483391.316705:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483391.317395:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483391.317738:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788483391.317748:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bab66a57/0x1d7ea3d89ea1c3f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.317760:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=683s v=(0 0) 00010000:00010000:1.0:1788483391.317764:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483391.317770:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bab66a57/0x1d7ea3d89ea1c3f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.317781:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bab66a57/0x1d7ea3d89ea1c3f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.317796:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bab66a57/0x1d7ea3d89ea1c3f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.317803:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bab66a57/0x1d7ea3d89ea1c3f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.317818:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483391.318243:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483391.318250:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bab66a57/0x1d7ea3d89ea1c3f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.318259:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c8685200 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483391.318264:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bab66a57/0x1d7ea3d89ea1c3f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.318273:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bab66a57/0x1d7ea3d89ea1c3f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.318285:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bab66a57/0x1d7ea3d89ea1c3f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.318293:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bab66a57/0x1d7ea3d89ea1c3f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.318308:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483391.318310:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483391.318311:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483391.320344:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483391.320355:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c3fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.320375:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788483391.320379:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483391.320384:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c3fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.320404:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c3fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.320413:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c3fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.320421:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c3fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.320440:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483391.320452:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483391.320457:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c3fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.320464:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401e00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483391.320469:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c3fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.320476:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c3fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.320492:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c3fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.320499:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c3fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.320524:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483391.320525:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483391.320527:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483391.324501:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483391.324514:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c401 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.324529:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788483391.324533:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483391.324549:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c401 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.324562:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c401 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.324570:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c401 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.324577:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c401 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.324604:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483391.325274:0:23946:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483391.325282:0:23946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c401 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.325305:0:23946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0400800 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483391.325310:0:23946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c401 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.325318:0:23946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c401 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.325335:0:23946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c401 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.325342:0:23946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c401 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.325362:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483391.325364:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483391.325366:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483391.325772:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483391.325779:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c408 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.325788:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788483391.325791:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483391.325796:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c408 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.325805:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c408 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.325819:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c408 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.325826:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c408 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.325847:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483391.326293:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483391.326300:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c408 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.326308:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401000 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483391.326311:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c408 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.326319:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c408 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.326331:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c408 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.326339:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040fcef93/0x1d7ea3d89ea1c408 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.326357:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483391.326366:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483391.326367:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483391.327404:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483391.327414:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c40f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.327426:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788483391.327430:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483391.327435:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c40f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.327446:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c40f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.327456:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c40f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.327464:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c40f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.327498:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483391.329359:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483391.329372:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c40f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.329385:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401800 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483391.329390:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c40f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.329400:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c40f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.329419:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c40f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.329427:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fd742e5/0x1d7ea3d89ea1c40f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.329452:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483391.329454:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483391.329456:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483391.330837:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483391.330847:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c416 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.330862:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788483391.330866:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483391.330872:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c416 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.330883:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c416 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.330892:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c416 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.330900:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c416 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.330922:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483391.335004:0:23946:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483391.335017:0:23946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c416 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.335030:0:23946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401e00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483391.335036:0:23946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c416 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.335068:0:23946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c416 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.335087:0:23946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c416 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.335120:0:23946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfe2b535/0x1d7ea3d89ea1c416 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.335157:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483391.335159:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483391.335160:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483391.335325:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483391.335333:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000905c4ce5/0x1d7ea3d89ea1c41d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.335344:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788483391.335353:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483391.335359:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000905c4ce5/0x1d7ea3d89ea1c41d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.335370:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000905c4ce5/0x1d7ea3d89ea1c41d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.335379:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000905c4ce5/0x1d7ea3d89ea1c41d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.335386:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000905c4ce5/0x1d7ea3d89ea1c41d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.335409:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483391.336385:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483391.336395:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000905c4ce5/0x1d7ea3d89ea1c41d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.336406:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401400 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483391.336410:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000905c4ce5/0x1d7ea3d89ea1c41d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.336419:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000905c4ce5/0x1d7ea3d89ea1c41d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.336435:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000905c4ce5/0x1d7ea3d89ea1c41d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.336460:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000905c4ce5/0x1d7ea3d89ea1c41d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483391.336481:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483391.336483:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483391.336485:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788483391.340158:0:24773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788483391.340172:0:24773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c424 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.340189:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788483391.340193:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483391.340199:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c424 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.340213:0:24773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c424 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.340223:0:24773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c424 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.340238:0:24773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c424 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483391.340253:0:24773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788483391.340331:0:24773:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:0.0:1788483391.340420:0:24773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22815:x1875360098824832:12345-0@lo:5:osp-pre-1-0.0 Request processed in 109506us (109988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483391.340431:0:24773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788483391.340479:0:22815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f5265f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22815:1875360098824832:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788483391.340494:0:22815:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:0.0:1788483391.340538:0:22815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22815:1875360098825472:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788483391.340569:0:22815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483391.340589:0:22815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d1c45540 going to sleep for 11 seconds 00000100:00100000:0.0:1788483391.340606:0:24299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098825472 00000100:00100000:0.0:1788483391.340612:0:24299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098825472 00000100:00100000:0.0:1788483391.340649:0:24299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788483391.340658:0:24299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22815:x1875360098825472:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788483391.340689:0:24299:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:1.0:1788483391.341232:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483391.341240:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c424 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.341249:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0400800 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:1.0:1788483391.341253:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c424 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.341273:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c424 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.341291:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c424 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.341298:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa3463c0/0x1d7ea3d89ea1c424 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483391.341317:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483391.341319:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483391.341320:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483391.353483:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788483391.353725:0:25113:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1788483391.353768:0:25113:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788483391.353773:0:25113:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788483391.354776:0:24298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23534:x1875360098825344:12345-0@lo:5:osp-pre-1-1.0 Request processed in 82888us (82930us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788483391.354787:0:24298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788483391.355001:0:23534:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788483391.355008:0:23534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c452ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23534:1875360098825344:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788483391.355033:0:23534:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1788483391.355079:0:23534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23534:1875360098825600:0@lo:900:osp-pre-1-1.0 00000001:00080000:2.0:1788483391.356009:0:25113:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:2.0:1788483391.357270:0:24299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22815:x1875360098825472:12345-0@lo:5:osp-pre-1-0.0 Request processed in 16608us (16695us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788483391.357282:0:24299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788483391.358365:0:23534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483391.358402:0:23534:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d2f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788483391.358439:0:22815:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1788483391.358447:0:22815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22815:1875360098825472:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788483391.358461:0:22815:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000100:00100000:1.0:1788483391.363701:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098825600 00000100:00100000:1.0:1788483391.363716:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098825600 00000100:00100000:1.0:1788483391.363764:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788483391.363774:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23534:x1875360098825600:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788483391.363871:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23534:x1875360098825600:12345-0@lo:900:osp-pre-1-1.0 Request processed in 98us (5509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483391.363877:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788483391.364302:0:23534:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69edb85500 x1875360098825600/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788483407 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483391.364319:0:23534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23534:1875360098825600:0@lo:900:osp-pre-1-1.0 00000040:00080000:2.0:1788483391.743743:0:22826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788483392.379251:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788483392.702521:0:25467:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg654-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788483393.275223:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788483393.275246:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098825728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788483393.275310:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483393.275586:0:24302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098825728 00000100:00100000:2.0:1788483393.275595:0:24302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098825728 00000100:00100000:2.0:1788483393.275643:0:24302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788483393.275653:0:24302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098825728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788483393.275679:0:24302:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788483393.275724:0:24302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098825728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483393.275731:0:24302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788483393.275750:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788483393.275791:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098825728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788483393.292164:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788483393.292186:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098825856:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788483393.292249:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483393.292669:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098825856 00000100:00100000:1.0:1788483393.292677:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098825856 00000100:00100000:1.0:1788483393.292734:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788483393.292743:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098825856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788483393.292787:0:22794:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788483393.292844:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098825856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483393.292851:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788483393.292901:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098825856:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788483393.403206:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788483393.724049:0:25520:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788483393.725809:0:25520:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788483393.788146:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788483393.788172:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098825984:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788483393.788235:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483393.788898:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098825984 00000100:00100000:0.0:1788483393.788907:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098825984 00000100:00100000:0.0:1788483393.788953:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788483393.788962:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098825984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788483393.788995:0:22793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788483393.789049:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098825984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483393.789056:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788483393.789139:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098825984:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788483394.297985:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788483394.298007:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69edb85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098826112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788483394.298069:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483394.298203:0:24302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098826112 00000100:00100000:2.0:1788483394.298211:0:24302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098826112 00000100:00100000:2.0:1788483394.298267:0:24302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788483394.298277:0:24302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098826112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788483394.298297:0:24302:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788483394.298355:0:24302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098826112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483394.298362:0:24302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788483394.298386:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483394.298467:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69edb85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098826112:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788483394.424243:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788483394.424765:0:23542:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1788483394.944548:0:25571:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788483394.944848:0:25571:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788483395.336634:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483395.336758:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087164544 00000100:00100000:3.0:1788483395.336772:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087164544 00000100:00100000:3.0:1788483395.339517:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 117 00000100:00100000:3.0:1788483395.339528:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2389:x1875360087164544:12345-192.168.206.54@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788483395.339576:0:22783:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 3cdddebc-d84c-4d1f-9b94-1e40ffcda201@192.168.206.54@tcp t0 exp 0000000000000000 cur 687 last 0 00000020:00000080:3.0:1788483395.339610:0:22783:0:(genops.c:1385:class_connect()) connect: client 3cdddebc-d84c-4d1f-9b94-1e40ffcda201, cookie 0x1d7ea3d89ea1c42b 00000100:00080000:3.0:1788483395.339747:0:22783:0:(import.c:65:import_set_state_nolock()) ffff9a68c3d8b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788483395.339824:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+5:2389:x1875360087164544:12345-192.168.206.54@tcp:250:mount.lustre.0 Request processed in 295us (3206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483395.339832:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 117 00000100:00100000:0.0:1788483395.365841:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483395.366018:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087164672 00000100:00100000:1.0:1788483395.366033:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087164672 00000100:00100000:1.0:1788483395.366177:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 118 00000100:00100000:1.0:1788483395.366190:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c7547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+5:18076:x1875360087164672:12345-192.168.206.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788483395.366212:0:22782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483395.366235:0:22782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c8685000/0x1d7ea3d89ea1c432 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e7d2 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483395.366269:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c8685000/0x1d7ea3d89ea1c432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7d2 expref: 6 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483395.366282:0:22782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c8685000/0x1d7ea3d89ea1c432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7d2 expref: 6 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483395.366293:0:22782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c8685000, rc 0) 00000100:00100000:1.0:1788483395.366386:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c7547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+6:18076:x1875360087164672:12345-192.168.206.54@tcp:101:mount.lustre.0 Request processed in 199us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483395.366395:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 118 00000100:00100000:1.0:1788483395.371787:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483395.371907:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087164800 00000100:00100000:0.0:1788483395.371920:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087164800 00000100:00100000:0.0:1788483395.371989:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 119 00000100:00100000:0.0:1788483395.372003:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c7546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+6:18076:x1875360087164800:12345-192.168.206.54@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788483395.372244:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c7546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+6:18076:x1875360087164800:12345-192.168.206.54@tcp:501:mount.lustre.0 Request processed in 245us (472us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788483395.372254:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 119 00000100:00100000:2.0:1788483395.378992:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483395.379750:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087164928 00000100:00100000:3.0:1788483395.379765:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087164928 00000100:00100000:3.0:1788483395.379842:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 120 00000100:00100000:3.0:1788483395.379854:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c7545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+6:18076:x1875360087164928:12345-192.168.206.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788483395.379883:0:22783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483395.379908:0:22783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecee1600/0x1d7ea3d89ea1c439 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e7d9 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483395.379963:0:22783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecee1600/0x1d7ea3d89ea1c439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7d9 expref: 7 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483395.379976:0:22783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecee1600/0x1d7ea3d89ea1c439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e7d9 expref: 7 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483395.379987:0:22783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1600, rc 0) 00000100:00100000:3.0:1788483395.380496:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c7545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+7:18076:x1875360087164928:12345-192.168.206.54@tcp:101:mount.lustre.0 Request processed in 640us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483395.380505:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 120 00000100:00100000:2.0:1788483395.395569:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483395.399251:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087165056 00000100:00100000:1.0:1788483395.399267:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087165056 00000100:00100000:1.0:1788483395.399343:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 121 00000100:00100000:1.0:1788483395.399353:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c7546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+7:18076:x1875360087165056:12345-192.168.206.54@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788483395.399520:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c7546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+8:18076:x1875360087165056:12345-192.168.206.54@tcp:501:mount.lustre.0 Request processed in 168us (3960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483395.399529:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 121 00000100:00100000:1.0:1788483395.412083:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483395.412658:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087165184 00000100:00100000:0.0:1788483395.412677:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087165184 00000100:00100000:0.0:1788483395.412763:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 122 00000100:00100000:0.0:1788483395.412784:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c7547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+8:18076:x1875360087165184:12345-192.168.206.54@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788483395.413995:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c7547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+8:18076:x1875360087165184:12345-192.168.206.54@tcp:503:mount.lustre.0 Request processed in 1202us (1910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483395.414009:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 122 00000100:00100000:2.0:1788483395.430955:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483395.431159:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087165312 00000100:00100000:3.0:1788483395.431179:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087165312 00000100:00100000:3.0:1788483395.431319:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 123 00000100:00100000:3.0:1788483395.431332:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c7544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+8:18095:x1875360087165312:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788483395.434866:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c7544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+8:18095:x1875360087165312:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 3526us (3909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483395.434881:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 123 00000100:00100000:2.0:1788483395.452942:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483395.454379:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087165440 00000100:00100000:1.0:1788483395.454390:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087165440 00000100:00100000:1.0:1788483395.454458:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 124 00000100:00100000:1.0:1788483395.454469:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c7544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+8:18095:x1875360087165440:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788483395.454649:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c7544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+8:18095:x1875360087165440:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 181us (1717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483395.454658:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 124 00010000:00010000:0.0:1788483395.455824:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483395.461331:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483395.468360:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087165568 00000100:00100000:3.0:1788483395.468375:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087165568 00000100:00100000:3.0:1788483395.468443:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 125 00000100:00100000:3.0:1788483395.468454:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c7547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+8:18095:x1875360087165568:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788483395.468615:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c7547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+8:18095:x1875360087165568:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 161us (7290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483395.468623:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 125 00000100:00100000:3.0:1788483395.487500:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483395.487667:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087165696 00000100:00100000:2.0:1788483395.487677:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087165696 00000100:00100000:2.0:1788483395.487731:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 126 00000100:00100000:2.0:1788483395.487741:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c7546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+8:18076:x1875360087165696:12345-192.168.206.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788483395.487756:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483395.487772:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecf27c00/0x1d7ea3d89ea1c440 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e80a expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483395.487799:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecf27c00/0x1d7ea3d89ea1c440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e80a expref: 9 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483395.487818:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecf27c00/0x1d7ea3d89ea1c440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e80a expref: 9 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483395.487828:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf27c00, rc 0) 00000100:00100000:2.0:1788483395.487890:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c7546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+9:18076:x1875360087165696:12345-192.168.206.54@tcp:101:mount.lustre.0 Request processed in 150us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483395.487897:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 126 00000100:00100000:2.0:1788483395.500977:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483395.501164:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087165824 00000100:00100000:1.0:1788483395.501177:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087165824 00000100:00100000:1.0:1788483395.501252:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 127 00000100:00100000:1.0:1788483395.501265:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c7545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+9:18076:x1875360087165824:12345-192.168.206.54@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788483395.501300:0:22782:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788483395.501332:0:22782:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788483395.501336:0:22782:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788483395.501340:0:22782:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788483395.501343:0:22782:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788483395.501346:0:22782:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1788483395.504579:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c7545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+9:18076:x1875360087165824:12345-192.168.206.54@tcp:256:mount.lustre.0 Request processed in 3300us (3600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483395.504598:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 127 00000100:00100000:3.0:1788483395.510824:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483395.511057:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087165952 00000100:00100000:1.0:1788483395.511070:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087165952 00000100:00100000:1.0:1788483395.511217:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 128 00000100:00100000:1.0:1788483395.511230:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+9:18076:x1875360087165952:12345-192.168.206.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788483395.511264:0:22783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483395.511287:0:22783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c8684c00/0x1d7ea3d89ea1c447 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e811 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483395.511323:0:22783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c8684c00/0x1d7ea3d89ea1c447 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e811 expref: 10 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483395.511337:0:22783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c8684c00/0x1d7ea3d89ea1c447 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e811 expref: 10 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483395.511348:0:22783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c8684c00, rc 0) 00000100:00100000:1.0:1788483395.511427:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+10:18076:x1875360087165952:12345-192.168.206.54@tcp:101:mount.lustre.0 Request processed in 199us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483395.511435:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 128 00000100:00100000:2.0:1788483395.514628:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483395.514745:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087166080 00000100:00100000:0.0:1788483395.514758:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087166080 00000100:00100000:0.0:1788483395.514829:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 129 00000100:00100000:0.0:1788483395.514840:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+10:18076:x1875360087166080:12345-192.168.206.54@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788483395.515042:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+10:18076:x1875360087166080:12345-192.168.206.54@tcp:501:mount.lustre.0 Request processed in 204us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483395.515069:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 129 00000100:00100000:3.0:1788483395.519173:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483395.519474:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087166208 00000100:00100000:2.0:1788483395.519489:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087166208 00000100:00100000:2.0:1788483395.519553:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 130 00000100:00100000:2.0:1788483395.519579:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+10:18076:x1875360087166208:12345-192.168.206.54@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788483395.519795:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+10:18076:x1875360087166208:12345-192.168.206.54@tcp:503:mount.lustre.0 Request processed in 218us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483395.519803:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 130 00000100:00100000:3.0:1788483395.524214:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483395.524499:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087166336 00000100:00100000:1.0:1788483395.524512:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087166336 00000100:00100000:1.0:1788483395.524592:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 131 00000100:00100000:1.0:1788483395.524603:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+10:18101:x1875360087166336:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788483395.524934:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+10:18101:x1875360087166336:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 331us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483395.524942:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 131 00000100:00100000:3.0:1788483395.532048:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483395.532470:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087166464 00000100:00100000:0.0:1788483395.532484:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087166464 00000100:00100000:0.0:1788483395.532557:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 132 00000100:00100000:0.0:1788483395.532570:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+10:18101:x1875360087166464:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788483395.532787:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+10:18101:x1875360087166464:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 219us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483395.532797:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 132 00000100:00100000:3.0:1788483395.563508:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483395.563562:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483395.563848:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087166592 00000100:00100000:0.0:1788483395.563861:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087166592 00000100:00100000:0.0:1788483395.563912:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087166848 00000100:00100000:0.0:1788483395.563915:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087166848 00000100:00100000:0.0:1788483395.563931:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 7 00000100:00100000:0.0:1788483395.563940:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1875360087166592:12345-192.168.206.54@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788483395.563983:0:22789:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 7da1a6cb-751c-451d-9aac-f6cbb68c7f97@192.168.206.54@tcp t0 exp 0000000000000000 cur 687 last 0 00000020:00000080:0.0:1788483395.564047:0:22789:0:(genops.c:1385:class_connect()) connect: client 7da1a6cb-751c-451d-9aac-f6cbb68c7f97, cookie 0x1d7ea3d89ea1c44e 00000004:00100000:0.0:1788483395.564079:0:22789:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:0.0:1788483395.564394:0:22789:0:(import.c:65:import_set_state_nolock()) ffff9a68c462d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788483395.564475:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+6:2389:x1875360087166592:12345-192.168.206.54@tcp:38:mount.lustre.0 Request processed in 534us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483395.564483:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 7 00000100:00100000:0.0:1788483395.564504:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 8 00000100:00100000:0.0:1788483395.564510:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c452ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1875360087166848:12345-192.168.206.54@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788483395.564527:0:22789:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 7da1a6cb-751c-451d-9aac-f6cbb68c7f97@192.168.206.54@tcp t0 exp 0000000000000000 cur 687 last 0 00000020:00000080:0.0:1788483395.564580:0:22789:0:(genops.c:1385:class_connect()) connect: client 7da1a6cb-751c-451d-9aac-f6cbb68c7f97, cookie 0x1d7ea3d89ea1c455 00000004:00100000:0.0:1788483395.564594:0:22789:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:0.0:1788483395.565260:0:22789:0:(import.c:65:import_set_state_nolock()) ffff9a68c4629800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788483395.565341:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c452ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+6:2389:x1875360087166848:12345-192.168.206.54@tcp:38:mount.lustre.0 Request processed in 827us (1775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483395.565352:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 8 00000100:00100000:3.0:1788483395.582683:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483395.582740:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483395.582783:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483395.582915:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087167104 00000100:00100000:2.0:1788483395.582928:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087167104 00000100:00100000:2.0:1788483395.583004:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087166976 00000100:00100000:2.0:1788483395.583008:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087166976 00000100:00100000:2.0:1788483395.583029:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087166720 00000100:00100000:2.0:1788483395.583032:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087166720 00000100:00100000:2.0:1788483395.583049:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 9 00000100:00100000:2.0:1788483395.583060:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+7:18076:x1875360087167104:12345-192.168.206.54@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788483395.583169:0:22788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788483395.583284:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+7:18076:x1875360087167104:12345-192.168.206.54@tcp:41:mount.lustre.0 Request processed in 224us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483395.583309:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 9 00000100:00100000:2.0:1788483395.583329:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 10 00000100:00100000:2.0:1788483395.583335:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+6:0:x1875360087166976:12345-192.168.206.54@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788483395.583356:0:22788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788483395.583404:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+6:0:x1875360087166976:12345-192.168.206.54@tcp:41:mount.lustre.0 Request processed in 67us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483395.583413:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 10 00000100:00100000:2.0:1788483395.583441:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 11 00000100:00100000:2.0:1788483395.583450:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+6:0:x1875360087166720:12345-192.168.206.54@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788483395.583465:0:22788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788483395.583491:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+6:0:x1875360087166720:12345-192.168.206.54@tcp:41:mount.lustre.0 Request processed in 42us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483395.583497:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 11 00000100:00080000:3.0:1788483395.584978:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788483395.584991:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788483395.592842:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483395.595341:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087167232 00000100:00100000:1.0:1788483395.595356:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087167232 00000100:00100000:1.0:1788483395.595432:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 12 00000100:00100000:1.0:1788483395.595443:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+6:18076:x1875360087167232:12345-192.168.206.54@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788483395.595580:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+6:18076:x1875360087167232:12345-192.168.206.54@tcp:40:mount.lustre.0 Request processed in 138us (2751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483395.595588:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 12 00000100:00100000:0.0:1788483395.603686:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483395.603739:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483395.603776:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483395.603861:0:24300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087167360 00000100:00100000:2.0:1788483395.603878:0:24300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087167360 00000100:00100000:1.0:1788483395.603887:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087167616 00000100:00100000:1.0:1788483395.603900:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087167616 00000100:00100000:2.0:1788483395.603944:0:24300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087167488 00000100:00100000:2.0:1788483395.603951:0:24300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087167488 00000100:00100000:1.0:1788483395.603967:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 3 00000100:00100000:1.0:1788483395.603982:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+6:18076:x1875360087167616:12345-192.168.206.54@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788483395.603992:0:24300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 20 00000100:00100000:2.0:1788483395.604002:0:24300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1875360087167360:12345-192.168.206.54@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788483395.604054:0:24300:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7da1a6cb-751c-451d-9aac-f6cbb68c7f97@192.168.206.54@tcp t0 exp 0000000000000000 cur 687 last 0 00000100:00100000:1.0:1788483395.604079:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+6:18076:x1875360087167616:12345-192.168.206.54@tcp:900:mount.lustre.0 Request processed in 96us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483395.604090:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 3 00000020:00000080:2.0:1788483395.604173:0:24300:0:(genops.c:1385:class_connect()) connect: client 7da1a6cb-751c-451d-9aac-f6cbb68c7f97, cookie 0x1d7ea3d89ea1c45c 00002000:00100000:2.0:1788483395.604192:0:24300:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7da1a6cb-751c-451d-9aac-f6cbb68c7f97/ffff9a68c2575000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788483395.604220:0:24300:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00000100:00100000:1.0:1788483395.604260:0:24299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 21 00000100:00100000:1.0:1788483395.604267:0:24299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69edb84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2389:x1875360087167488:12345-192.168.206.54@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788483395.604296:0:24299:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7da1a6cb-751c-451d-9aac-f6cbb68c7f97@192.168.206.54@tcp t0 exp 0000000000000000 cur 687 last 0 00000020:00000080:1.0:1788483395.604324:0:24299:0:(genops.c:1385:class_connect()) connect: client 7da1a6cb-751c-451d-9aac-f6cbb68c7f97, cookie 0x1d7ea3d89ea1c463 00002000:00100000:1.0:1788483395.604336:0:24299:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7da1a6cb-751c-451d-9aac-f6cbb68c7f97/ffff9a69efebd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788483395.604353:0:24299:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1788483395.604684:0:24299:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788483395.604722:0:24299:0:(import.c:65:import_set_state_nolock()) ffff9a69efeba800 : changing import state from RECOVER to FULL 00002000:00080000:2.0:1788483395.604752:0:24300:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1788483395.604772:0:24299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+6:2389:x1875360087167488:12345-192.168.206.54@tcp:8:mount.lustre.0 Request processed in 501us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483395.604782:0:24299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 21 00000100:00080000:2.0:1788483395.604792:0:24300:0:(import.c:65:import_set_state_nolock()) ffff9a68c2571800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788483395.604853:0:24300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69edb86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+6:2389:x1875360087167360:12345-192.168.206.54@tcp:8:mount.lustre.0 Request processed in 849us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483395.604863:0:24300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 20 00000100:00100000:3.0:1788483395.620604:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483395.624776:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087167744 00000100:00100000:1.0:1788483395.624791:0:22791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087167744 00000100:00100000:1.0:1788483395.624861:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 0 00000100:00100000:1.0:1788483395.624884:0:22791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+6:18076:x1875360087167744:12345-192.168.206.54@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788483395.625698:0:22791:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 727us 00000004:00200000:1.0:1788483395.664413:0:22791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788483395.664550:0:22791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+6:18076:x1875360087167744:12345-192.168.206.54@tcp:33:mount.lustre.0 Request processed in 39662us (43954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483395.664561:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 0 00000100:00100000:3.0:1788483395.940272:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483395.940501:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087167872 00000100:00100000:0.0:1788483395.940513:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087167872 00000100:00100000:0.0:1788483395.940928:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 13 00000100:00100000:0.0:1788483395.940953:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+6:18124:x1875360087167872:12345-192.168.206.54@tcp:101:mkdir.0 00010000:00010000:0.0:1788483395.940976:0:22790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483395.941004:0:22790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400400/0x1d7ea3d89ea1c46a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e842 expref: -99 pid: 22790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483395.941154:0:22790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1c471 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483395.941168:0:22790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1c471 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483395.941183:0:22790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1c471 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483395.941238:0:22790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788483395.941243:0:22790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788483395.941281:0:22790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1c471 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483395.941326:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400400/0x1d7ea3d89ea1c46a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e842 expref: 8 pid: 22790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483395.941348:0:22790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1c471 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e842 expref: 7 pid: 22790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483395.941357:0:22790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c3603000) 00010000:00010000:0.0:1788483395.941360:0:22790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788483395.941363:0:22790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69d0400800, rc 0) 00000100:00100000:0.0:1788483395.941433:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+7:18124:x1875360087167872:12345-192.168.206.54@tcp:101:mkdir.0 Request processed in 491us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483395.941440:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 13 00000100:00100000:3.0:1788483396.344411:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098826240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788483396.344510:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483396.344930:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098826368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788483396.344964:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483396.345067:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098826240 00000100:00100000:1.0:1788483396.345078:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098826240 00000100:00100000:1.0:1788483396.345178:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098826368 00000100:00100000:1.0:1788483396.345181:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098826368 00000100:00100000:1.0:1788483396.345206:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788483396.345216:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098826240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788483396.345254:0:24301:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788483396.345312:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098826240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483396.345319:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788483396.345342:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788483396.345349:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098826368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788483396.345360:0:24301:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788483396.345402:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098826368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483396.345409:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788483396.345455:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098826368:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788483396.345622:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788483396.345649:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098826240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788483396.347079:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3619:1875360098826496:0@lo:400:kworker.0 00000100:00100000:3.0:1788483396.347184:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483396.347283:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098826496 00000100:00100000:2.0:1788483396.347292:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098826496 00000100:00100000:2.0:1788483396.347349:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788483396.347359:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c45cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:3619:x1875360098826496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483396.347771:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098826624:0@lo:400:kworker.0 00000100:00100000:1.0:1788483396.347806:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483396.347895:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098826624 00000100:00100000:1.0:1788483396.347913:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098826624 00000100:00100000:1.0:1788483396.347947:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788483396.347954:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098826624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483396.347996:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098826624:12345-0@lo:400:kworker.0 Request processed in 42us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483396.348004:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788483396.348054:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098826624:0@lo:400:kworker.0 00000100:00100000:2.0:1788483396.351366:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c45cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:3619:x1875360098826496:12345-0@lo:400:kworker.0 Request processed in 3999us (4172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483396.351380:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788483396.351491:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3619:1875360098826496:0@lo:400:kworker.0 00000100:00100000:1.0:1788483396.352717:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098826752:0@lo:400:kworker.0 00000100:00100000:1.0:1788483396.352785:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483396.352876:0:24298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098826752 00000100:00100000:2.0:1788483396.352884:0:24298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098826752 00000100:00100000:2.0:1788483396.352958:0:24298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788483396.352967:0:24298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098826752:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788483396.353120:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788483396.353913:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098826880:0@lo:400:kworker.0 00000100:00100000:3.0:1788483396.353968:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483396.354031:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098826880 00000100:00100000:3.0:1788483396.354037:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098826880 00000100:00100000:3.0:1788483396.354574:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788483396.354584:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098826880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483396.354639:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875360098826880:12345-0@lo:400:kworker.0 Request processed in 56us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483396.354647:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788483396.354691:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875360098826880:0@lo:400:kworker.0 00000100:00100000:2.0:1788483396.361640:0:24298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098826752:12345-0@lo:400:kworker.0 Request processed in 8664us (8844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483396.361655:0:24298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788483396.365640:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098826752:0@lo:400:kworker.0 00000100:00100000:2.0:1788483396.368982:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098827136:0@lo:400:kworker.0 00000100:00100000:0.0:1788483396.368996:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1875360098827392:0@lo:400:kworker.0 00000100:00100000:3.0:1788483396.369079:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098827008:0@lo:400:kworker.0 00000100:00100000:2.0:1788483396.370601:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483396.370646:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1875360098827648:0@lo:400:kworker.0 00000100:00100000:2.0:1788483396.370683:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483396.370731:0:24300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098827136 00000100:00100000:2.0:1788483396.370739:0:24300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098827136 00000100:00100000:2.0:1788483396.370791:0:24300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788483396.370800:0:24300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098827136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483396.370876:0:24300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098827136:12345-0@lo:400:kworker.0 Request processed in 77us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483396.370884:0:24300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788483396.370924:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098827136:0@lo:400:kworker.0 00000100:00080000:2.0:1788483396.370962:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788483396.371048:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098827264:0@lo:400:kworker.0 00000100:00100000:1.0:1788483396.371188:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483396.371210:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098827776:0@lo:400:kworker.0 00000100:00100000:1.0:1788483396.371232:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483396.371269:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098827648 00000100:00100000:1.0:1788483396.371273:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098827648 00000100:00100000:1.0:1788483396.371298:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098827264 00000100:00100000:1.0:1788483396.371301:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098827264 00000100:00100000:1.0:1788483396.371312:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098827776 00000100:00100000:1.0:1788483396.371315:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098827776 00000100:00100000:1.0:1788483396.371481:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788483396.371491:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875360098827648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483396.371715:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875360098827648:12345-0@lo:400:kworker.0 Request processed in 225us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483396.371722:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788483396.371739:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788483396.371753:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098827264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483396.371789:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098827264:12345-0@lo:400:kworker.0 Request processed in 37us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483396.371795:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788483396.371808:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788483396.371814:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098827776:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788483396.373384:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788483396.373393:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788483396.373453:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1875360098827648:0@lo:400:kworker.0 00000100:00100000:2.0:1788483396.373546:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098827264:0@lo:400:kworker.0 00000100:00100000:1.0:1788483396.373702:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098827776:12345-0@lo:400:kworker.0 Request processed in 1888us (2468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483396.373711:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1788483396.374302:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c34fca80 x1875360098827776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483396.374315:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098827776:0@lo:400:kworker.0 00000100:00100000:0.0:1788483396.374895:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483396.376843:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098827392 00000100:00100000:1.0:1788483396.376857:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098827392 00000100:00100000:1.0:1788483396.376937:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788483396.376948:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875360098827392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483396.377048:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875360098827392:12345-0@lo:400:kworker.0 Request processed in 102us (2154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483396.377068:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1788483396.377537:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788483396.377578:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3622:1875360098827392:0@lo:400:kworker.0 00000100:00100000:3.0:1788483396.382023:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483396.382081:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098827520:0@lo:400:kworker.0 00000100:00100000:3.0:1788483396.382159:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483396.382345:0:23530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098827008 00000100:00100000:0.0:1788483396.382354:0:23530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098827008 00000100:00100000:0.0:1788483396.382412:0:23530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788483396.382421:0:23530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098827008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483396.382488:0:23530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098827008:12345-0@lo:400:kworker.0 Request processed in 67us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483396.382496:0:23530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788483396.382625:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098827008:0@lo:400:kworker.0 00000100:00100000:1.0:1788483396.382703:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098827520 00000100:00100000:1.0:1788483396.382708:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098827520 00000100:00100000:1.0:1788483396.382830:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788483396.382838:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098827520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483396.382884:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875360098827520:12345-0@lo:400:kworker.0 Request processed in 47us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483396.382891:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1788483396.382990:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c34fc700 x1875360098827520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483396.383001:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3619:1875360098827520:0@lo:400:kworker.0 00000100:00080000:0.0:1788483396.383163:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788483396.472592:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483397.496406:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788483397.883953:0:25113:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7da1a6cb-751c-451d-9aac-f6cbb68c7f97 00000100:00100000:0.0:1788483398.170304:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483398.170346:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087168000 00000100:00100000:2.0:1788483398.170368:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087168000 00000100:00100000:2.0:1788483398.170469:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 14 00000100:00100000:2.0:1788483398.170482:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+7:18176:x1875360087168000:12345-192.168.206.54@tcp:41:lfs.0 00000004:00000024:2.0:1788483398.170534:0:22790:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788483398.170672:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+7:18176:x1875360087168000:12345-192.168.206.54@tcp:41:lfs.0 Request processed in 192us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483398.170681:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 14 00000100:00080000:0.0:1788483398.172033:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788483398.178216:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483398.178410:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087168128 00000100:00100000:2.0:1788483398.178431:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087168128 00000100:00080000:3.0:1788483398.178623:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788483398.178673:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 15 00000100:00100000:2.0:1788483398.178707:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+6:18176:x1875360087168128:12345-192.168.206.54@tcp:41:lfs.0 00000004:00000024:2.0:1788483398.178760:0:22788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788483398.178888:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+6:18176:x1875360087168128:12345-192.168.206.54@tcp:41:lfs.0 Request processed in 185us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483398.178896:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 15 00000100:00100000:3.0:1788483398.187951:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483398.188831:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087168256 00000100:00100000:1.0:1788483398.188849:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087168256 00000100:00100000:1.0:1788483398.188957:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 11 00000100:00100000:1.0:1788483398.188988:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+6:18176:x1875360087168256:12345-192.168.206.54@tcp:13:lfs.0 00002000:00000024:1.0:1788483398.189032:0:24301:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00080000:3.0:1788483398.189416:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788483398.190885:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+6:18176:x1875360087168256:12345-192.168.206.54@tcp:13:lfs.0 Request processed in 1883us (2926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483398.190901:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 11 00000100:00100000:3.0:1788483398.208023:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483398.211598:0:24302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087168384 00000100:00100000:2.0:1788483398.211620:0:24302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087168384 00000100:00100000:2.0:1788483398.211747:0:24302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 12 00000100:00080000:3.0:1788483398.211749:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788483398.211765:0:24302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+5:18176:x1875360087168384:12345-192.168.206.54@tcp:13:lfs.0 00002000:00000024:2.0:1788483398.211852:0:24302:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788483398.211978:0:24302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+5:18176:x1875360087168384:12345-192.168.206.54@tcp:13:lfs.0 Request processed in 220us (3963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483398.211987:0:24302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 12 00000100:00100000:1.0:1788483398.392454:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788483398.393051:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098827904:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788483398.393063:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098828032:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788483398.406282:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483398.408890:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483398.409073:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098828032 00000100:00100000:0.0:1788483398.409091:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098828032 00000100:00100000:0.0:1788483398.409205:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788483398.409222:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098828032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788483398.409269:0:22793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788483398.409316:0:24302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098827904 00000100:00100000:3.0:1788483398.409328:0:24302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098827904 00000100:00100000:3.0:1788483398.409451:0:24302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788483398.409462:0:24302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098827904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788483398.409491:0:24302:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788483398.410838:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098828032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1617us (4558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483398.410850:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788483398.410928:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098828032:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788483398.411496:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788483398.414823:0:24302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098827904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5350us (5932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483398.414841:0:24302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788483398.415051:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098827904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788483398.512789:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483398.512892:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087168512 00000100:00100000:1.0:1788483398.512905:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087168512 00000100:00100000:1.0:1788483398.512976:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 134 00000100:00100000:1.0:1788483398.512988:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ca988050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+10:18209:x1875360087168512:12345-192.168.206.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788483398.513012:0:22783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483398.513037:0:22783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c8685e00/0x1d7ea3d89ea1c478 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e849 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483398.513088:0:22783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c8685e00/0x1d7ea3d89ea1c478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e849 expref: 11 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483398.513165:0:22783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c8685e00/0x1d7ea3d89ea1c478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e849 expref: 11 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483398.513177:0:22783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c8685e00, rc 0) 00000100:00100000:1.0:1788483398.513262:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ca988050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+11:18209:x1875360087168512:12345-192.168.206.54@tcp:101:mount.lustre.0 Request processed in 277us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483398.513292:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 134 00010000:00010000:0.0:1788483398.520340:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483398.521018:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483398.521168:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087168640 00000100:00100000:2.0:1788483398.521178:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087168640 00000100:00100000:2.0:1788483398.521242:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 135 00000100:00100000:2.0:1788483398.521253:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d463fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+11:18209:x1875360087168640:12345-192.168.206.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788483398.521417:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d463fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+11:18209:x1875360087168640:12345-192.168.206.54@tcp:501:mount.lustre.0 Request processed in 165us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483398.521426:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 135 00000100:00100000:3.0:1788483398.527203:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483398.530578:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087168768 00000100:00100000:0.0:1788483398.530604:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087168768 00000100:00100000:0.0:1788483398.530705:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 136 00000100:00100000:0.0:1788483398.530718:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d463d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+11:18209:x1875360087168768:12345-192.168.206.54@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788483398.530958:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d463d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+11:18209:x1875360087168768:12345-192.168.206.54@tcp:503:mount.lustre.0 Request processed in 241us (3765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483398.530967:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 136 00000100:00100000:0.0:1788483398.551309:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483398.551576:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087168896 00000100:00100000:1.0:1788483398.551592:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087168896 00000100:00100000:1.0:1788483398.551680:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 137 00000100:00100000:1.0:1788483398.551693:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69d463f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+11:18214:x1875360087168896:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788483398.551858:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69d463f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+11:18214:x1875360087168896:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 168us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483398.551868:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 137 00000100:00100000:3.0:1788483398.589707:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483398.589850:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087169024 00000100:00100000:2.0:1788483398.589866:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087169024 00000100:00100000:2.0:1788483398.589947:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 138 00000100:00100000:2.0:1788483398.589960:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c998f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+11:18214:x1875360087169024:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788483398.590273:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c998f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+11:18214:x1875360087169024:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 314us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483398.590289:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 138 00000100:00100000:3.0:1788483398.595741:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483398.597285:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087169152 00000100:00100000:0.0:1788483398.597307:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087169152 00000100:00100000:0.0:1788483398.597393:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 139 00000100:00100000:0.0:1788483398.597409:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+11:18214:x1875360087169152:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788483398.597647:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+11:18214:x1875360087169152:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 242us (1918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483398.597667:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 139 00000100:00100000:0.0:1788483398.601331:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483398.601497:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087169280 00000100:00100000:1.0:1788483398.601512:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087169280 00000100:00100000:1.0:1788483398.601589:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 140 00000100:00100000:1.0:1788483398.601600:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+11:18209:x1875360087169280:12345-192.168.206.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788483398.601624:0:22783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483398.601651:0:22783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c8684e00/0x1d7ea3d89ea1c47f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e87a expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483398.601687:0:22783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c8684e00/0x1d7ea3d89ea1c47f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e87a expref: 12 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483398.601699:0:22783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c8684e00/0x1d7ea3d89ea1c47f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e87a expref: 12 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483398.601710:0:22783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c8684e00, rc 0) 00000100:00100000:1.0:1788483398.601786:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+12:18209:x1875360087169280:12345-192.168.206.54@tcp:101:mount.lustre.0 Request processed in 188us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483398.601793:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 140 00000100:00100000:3.0:1788483398.611486:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483398.611614:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087169408 00000100:00100000:2.0:1788483398.611627:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087169408 00000100:00100000:2.0:1788483398.611702:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 141 00000100:00100000:2.0:1788483398.611714:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+12:18209:x1875360087169408:12345-192.168.206.54@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788483398.611749:0:22780:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788483398.611780:0:22780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788483398.611785:0:22780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788483398.611788:0:22780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788483398.611792:0:22780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788483398.611794:0:22780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1788483398.614075:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+12:18209:x1875360087169408:12345-192.168.206.54@tcp:256:mount.lustre.0 Request processed in 2339us (2579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483398.614156:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 141 00000100:00100000:0.0:1788483398.618542:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483398.618660:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087169536 00000100:00100000:1.0:1788483398.618675:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087169536 00000100:00100000:1.0:1788483398.618752:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 142 00000100:00100000:1.0:1788483398.618764:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+12:18209:x1875360087169536:12345-192.168.206.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788483398.618788:0:22782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483398.618811:0:22782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69c8685200/0x1d7ea3d89ea1c486 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e881 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483398.618847:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c8685200/0x1d7ea3d89ea1c486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e881 expref: 13 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483398.618859:0:22782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69c8685200/0x1d7ea3d89ea1c486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e881 expref: 13 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483398.618869:0:22782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c8685200, rc 0) 00000100:00100000:1.0:1788483398.618945:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+13:18209:x1875360087169536:12345-192.168.206.54@tcp:101:mount.lustre.0 Request processed in 184us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483398.618953:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 142 00000100:00100000:3.0:1788483398.624007:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483398.627956:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087169664 00000100:00100000:2.0:1788483398.627978:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087169664 00000100:00100000:2.0:1788483398.628094:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 143 00000100:00100000:2.0:1788483398.628152:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+13:18209:x1875360087169664:12345-192.168.206.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788483398.628396:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+13:18209:x1875360087169664:12345-192.168.206.54@tcp:501:mount.lustre.0 Request processed in 246us (4413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483398.628406:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 143 00000100:00100000:0.0:1788483398.639676:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483398.639800:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087169792 00000100:00100000:3.0:1788483398.639813:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087169792 00000100:00100000:3.0:1788483398.639888:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 144 00000100:00100000:3.0:1788483398.639900:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+13:18209:x1875360087169792:12345-192.168.206.54@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788483398.640166:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+13:18209:x1875360087169792:12345-192.168.206.54@tcp:503:mount.lustre.0 Request processed in 268us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483398.640175:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 144 00000100:00100000:0.0:1788483398.646813:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483398.646965:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087169920 00000100:00100000:1.0:1788483398.646982:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087169920 00000100:00100000:1.0:1788483398.647068:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 145 00000100:00100000:1.0:1788483398.647080:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+13:18219:x1875360087169920:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788483398.647344:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+13:18219:x1875360087169920:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 266us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483398.647353:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 145 00000100:00100000:0.0:1788483398.663197:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483398.663327:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087170048 00000100:00100000:2.0:1788483398.663341:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087170048 00000100:00100000:2.0:1788483398.663407:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 146 00000100:00100000:2.0:1788483398.663419:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+13:18219:x1875360087170048:12345-192.168.206.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788483398.663649:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+13:18219:x1875360087170048:12345-192.168.206.54@tcp:502:llog_process_th.0 Request processed in 230us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483398.663658:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 146 00000100:00100000:0.0:1788483398.680264:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483398.680324:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483398.680441:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087170176 00000100:00100000:1.0:1788483398.680458:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087170176 00000100:00100000:1.0:1788483398.680545:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087170432 00000100:00100000:1.0:1788483398.680549:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087170432 00000100:00100000:1.0:1788483398.680566:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 16 00000100:00100000:1.0:1788483398.680575:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1875360087170176:12345-192.168.206.54@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788483398.680612:0:22789:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from aac9511e-8a30-458e-9fb5-28ad23b758b4@192.168.206.54@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:1.0:1788483398.680665:0:22789:0:(genops.c:1385:class_connect()) connect: client aac9511e-8a30-458e-9fb5-28ad23b758b4, cookie 0x1d7ea3d89ea1c48d 00000004:00100000:1.0:1788483398.680698:0:22789:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:1.0:1788483398.680826:0:22789:0:(import.c:65:import_set_state_nolock()) ffff9a69f4619000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788483398.680919:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aac9511e-8a30-458e-9fb5-28ad23b758b4+6:2389:x1875360087170176:12345-192.168.206.54@tcp:38:mount.lustre.0 Request processed in 343us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483398.680929:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 16 00000100:00100000:1.0:1788483398.680952:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 17 00000100:00100000:1.0:1788483398.680957:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1875360087170432:12345-192.168.206.54@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788483398.680974:0:22789:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from aac9511e-8a30-458e-9fb5-28ad23b758b4@192.168.206.54@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:1.0:1788483398.680998:0:22789:0:(genops.c:1385:class_connect()) connect: client aac9511e-8a30-458e-9fb5-28ad23b758b4, cookie 0x1d7ea3d89ea1c494 00000004:00100000:1.0:1788483398.681012:0:22789:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:1.0:1788483398.681058:0:22789:0:(import.c:65:import_set_state_nolock()) ffff9a69f461c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788483398.681080:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aac9511e-8a30-458e-9fb5-28ad23b758b4+6:2389:x1875360087170432:12345-192.168.206.54@tcp:38:mount.lustre.0 Request processed in 122us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483398.681087:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 17 00000100:00100000:0.0:1788483398.688663:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483398.688708:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483398.688776:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483398.688906:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087170688 00000100:00100000:3.0:1788483398.688920:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087170688 00000100:00100000:3.0:1788483398.688998:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087170560 00000100:00100000:3.0:1788483398.689002:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087170560 00000100:00100000:3.0:1788483398.689019:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087170304 00000100:00100000:3.0:1788483398.689022:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087170304 00000100:00100000:3.0:1788483398.689038:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 18 00000100:00100000:3.0:1788483398.689049:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aac9511e-8a30-458e-9fb5-28ad23b758b4+7:18209:x1875360087170688:12345-192.168.206.54@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788483398.689159:0:22788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00080000:0.0:1788483398.689363:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788483398.689368:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788483398.689481:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aac9511e-8a30-458e-9fb5-28ad23b758b4+7:18209:x1875360087170688:12345-192.168.206.54@tcp:41:mount.lustre.0 Request processed in 430us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483398.689490:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 18 00000100:00100000:3.0:1788483398.689516:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 19 00000100:00100000:3.0:1788483398.689524:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aac9511e-8a30-458e-9fb5-28ad23b758b4+6:0:x1875360087170560:12345-192.168.206.54@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788483398.689539:0:22788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788483398.689568:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aac9511e-8a30-458e-9fb5-28ad23b758b4+6:0:x1875360087170560:12345-192.168.206.54@tcp:41:mount.lustre.0 Request processed in 46us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483398.689574:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 19 00000100:00100000:3.0:1788483398.689586:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 20 00000100:00100000:3.0:1788483398.689591:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aac9511e-8a30-458e-9fb5-28ad23b758b4+6:0:x1875360087170304:12345-192.168.206.54@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788483398.689601:0:22788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788483398.689622:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aac9511e-8a30-458e-9fb5-28ad23b758b4+6:0:x1875360087170304:12345-192.168.206.54@tcp:41:mount.lustre.0 Request processed in 30us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483398.689628:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 20 00000100:00100000:0.0:1788483398.705069:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483398.710414:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087170816 00000100:00100000:3.0:1788483398.710436:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087170816 00000100:00100000:2.0:1788483398.717510:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 21 00000100:00100000:2.0:1788483398.717531:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aac9511e-8a30-458e-9fb5-28ad23b758b4+6:18209:x1875360087170816:12345-192.168.206.54@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788483398.719026:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aac9511e-8a30-458e-9fb5-28ad23b758b4+6:18209:x1875360087170816:12345-192.168.206.54@tcp:40:mount.lustre.0 Request processed in 1488us (13959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483398.719043:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 21 00000100:00100000:0.0:1788483398.731744:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483398.731791:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483398.731824:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483398.731919:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087171200 00000100:00100000:1.0:1788483398.731931:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087171200 00000100:00100000:1.0:1788483398.732008:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 4 00000100:00100000:1.0:1788483398.732020:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:aac9511e-8a30-458e-9fb5-28ad23b758b4+6:18209:x1875360087171200:12345-192.168.206.54@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788483398.732169:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:aac9511e-8a30-458e-9fb5-28ad23b758b4+6:18209:x1875360087171200:12345-192.168.206.54@tcp:900:mount.lustre.0 Request processed in 150us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483398.732197:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 4 00000100:00100000:3.0:1788483398.732657:0:24299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087170944 00000100:00100000:3.0:1788483398.732665:0:24299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087170944 00000100:00100000:3.0:1788483398.732701:0:24299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087171072 00000100:00100000:3.0:1788483398.732704:0:24299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087171072 00000100:00100000:3.0:1788483398.732722:0:24299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 22 00000100:00100000:3.0:1788483398.732729:0:24299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2389:x1875360087170944:12345-192.168.206.54@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788483398.732762:0:24299:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from aac9511e-8a30-458e-9fb5-28ad23b758b4@192.168.206.54@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:3.0:1788483398.732805:0:24299:0:(genops.c:1385:class_connect()) connect: client aac9511e-8a30-458e-9fb5-28ad23b758b4, cookie 0x1d7ea3d89ea1c49b 00002000:00100000:3.0:1788483398.732819:0:24299:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aac9511e-8a30-458e-9fb5-28ad23b758b4/ffff9a69c6a82000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788483398.732833:0:24299:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:3.0:1788483398.732922:0:24299:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788483398.732959:0:24299:0:(import.c:65:import_set_state_nolock()) ffff9a69c626f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788483398.733006:0:24299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aac9511e-8a30-458e-9fb5-28ad23b758b4+6:2389:x1875360087170944:12345-192.168.206.54@tcp:8:mount.lustre.0 Request processed in 276us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483398.733014:0:24299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 22 00000100:00100000:3.0:1788483398.733030:0:24299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 23 00000100:00100000:3.0:1788483398.733034:0:24299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2389:x1875360087171072:12345-192.168.206.54@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788483398.733051:0:24299:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from aac9511e-8a30-458e-9fb5-28ad23b758b4@192.168.206.54@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:3.0:1788483398.733067:0:24299:0:(genops.c:1385:class_connect()) connect: client aac9511e-8a30-458e-9fb5-28ad23b758b4, cookie 0x1d7ea3d89ea1c4a2 00002000:00100000:3.0:1788483398.733172:0:24299:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aac9511e-8a30-458e-9fb5-28ad23b758b4/ffff9a69c626e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788483398.733179:0:24299:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:3.0:1788483398.733295:0:24299:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788483398.733311:0:24299:0:(import.c:65:import_set_state_nolock()) ffff9a69c626d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788483398.733337:0:24299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aac9511e-8a30-458e-9fb5-28ad23b758b4+6:2389:x1875360087171072:12345-192.168.206.54@tcp:8:mount.lustre.0 Request processed in 300us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483398.733344:0:24299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 23 00000100:00100000:0.0:1788483398.742878:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483398.743021:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087171328 00000100:00100000:2.0:1788483398.743033:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087171328 00000100:00100000:2.0:1788483398.743152:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 1 00000100:00100000:2.0:1788483398.743165:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aac9511e-8a30-458e-9fb5-28ad23b758b4+6:18209:x1875360087171328:12345-192.168.206.54@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788483398.743287:0:22792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788483398.743398:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aac9511e-8a30-458e-9fb5-28ad23b758b4+6:18209:x1875360087171328:12345-192.168.206.54@tcp:33:mount.lustre.0 Request processed in 235us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483398.743406:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 1 00000100:00100000:2.0:1788483398.904902:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098828160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483398.905005:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483398.905145:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098828160 00000100:00100000:1.0:1788483398.905157:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098828160 00000100:00100000:1.0:1788483398.905233:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788483398.905245:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098828160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788483398.905293:0:22794:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788483398.905354:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098828160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483398.905362:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788483398.905419:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098828160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483398.978330:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483398.978453:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087171456 00000100:00100000:1.0:1788483398.978467:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087171456 00000100:00100000:1.0:1788483398.978542:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 22 00000100:00100000:1.0:1788483398.978555:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aac9511e-8a30-458e-9fb5-28ad23b758b4+6:18242:x1875360087171456:12345-192.168.206.54@tcp:101:mkdir.0 00010000:00010000:1.0:1788483398.978582:0:22789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483398.978613:0:22789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685800/0x1d7ea3d89ea1c4a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e8b2 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483398.978696:0:22789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684600/0x1d7ea3d89ea1c4b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483398.978713:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684600/0x1d7ea3d89ea1c4b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483398.979091:0:22789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684600/0x1d7ea3d89ea1c4b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483398.979219:0:22789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788483398.979223:0:22789:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788483398.979247:0:22789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684600/0x1d7ea3d89ea1c4b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483398.979279:0:22789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685800/0x1d7ea3d89ea1c4a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8b2 expref: 8 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483398.979300:0:22789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684600/0x1d7ea3d89ea1c4b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8b2 expref: 7 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483398.979311:0:22789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c3603000) 00010000:00010000:1.0:1788483398.979314:0:22789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788483398.979319:0:22789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c8684600, rc 0) 00000100:00100000:1.0:1788483398.979440:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aac9511e-8a30-458e-9fb5-28ad23b758b4+7:18242:x1875360087171456:12345-192.168.206.54@tcp:101:mkdir.0 Request processed in 886us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483398.979448:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 22 00000100:00100000:1.0:1788483399.416897:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c34fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098828288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788483399.417001:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483399.417179:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098828288 00000100:00100000:3.0:1788483399.417191:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098828288 00000100:00100000:3.0:1788483399.417275:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788483399.417287:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098828288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788483399.417318:0:24301:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788483399.417394:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098828288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483399.417402:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788483399.417514:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788483399.417561:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c34fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098828288:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788483399.547566:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483400.568311:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483401.464680:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788483401.464703:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098828416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788483401.464791:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483401.465219:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098828416 00000100:00100000:3.0:1788483401.465227:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098828416 00000100:00100000:3.0:1788483401.465275:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788483401.465284:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098828416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788483401.465325:0:24301:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788483401.465378:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098828416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483401.465385:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788483401.465720:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098828544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483401.465763:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788483401.465806:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788483401.465833:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098828416:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788483401.466033:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098828544 00000100:00100000:0.0:1788483401.466038:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098828544 00000100:00100000:0.0:1788483401.466076:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788483401.466092:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098828544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788483401.466128:0:24301:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788483401.466164:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098828544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483401.466180:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788483401.466210:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098828544:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788483401.466327:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788483401.466812:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098828800:0@lo:400:kworker.0 00000100:00100000:3.0:1788483401.466860:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483401.466883:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098829312:0@lo:400:kworker.0 00000100:00100000:3.0:1788483401.466902:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483401.466917:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098829824:0@lo:400:kworker.0 00000100:00100000:3.0:1788483401.466952:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483401.466968:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788483401.466972:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098828928:0@lo:400:kworker.0 00000100:00100000:3.0:1788483401.466991:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483401.467003:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098829440:0@lo:400:kworker.0 00000100:00100000:3.0:1788483401.467019:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483401.467042:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098829952:0@lo:400:kworker.0 00000100:00100000:3.0:1788483401.467063:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483401.467118:0:24299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098829312 00000100:00100000:3.0:1788483401.467123:0:24299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098829312 00000100:00100000:3.0:1788483401.467161:0:24299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098828928 00000100:00100000:3.0:1788483401.467164:0:24299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098828928 00000100:00100000:1.0:1788483401.467427:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098829824 00000100:00100000:1.0:1788483401.467432:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098829824 00000100:00100000:1.0:1788483401.467454:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098829440 00000100:00100000:1.0:1788483401.467457:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098829440 00000100:00100000:1.0:1788483401.467467:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098829952 00000100:00100000:1.0:1788483401.467469:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098829952 00000100:00100000:1.0:1788483401.467482:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788483401.467488:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098829824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483401.467534:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098829824:12345-0@lo:400:kworker.0 Request processed in 46us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483401.467540:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788483401.467556:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788483401.467562:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098829440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483401.467586:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875360098829440:12345-0@lo:400:kworker.0 Request processed in 24us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483401.467591:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788483401.467602:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788483401.467608:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098829952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483401.467631:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875360098829952:12345-0@lo:400:kworker.0 Request processed in 24us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483401.467636:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788483401.467665:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875360098829440:0@lo:400:kworker.0 00010000:00080000:1.0:1788483401.467677:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd8f5880 x1875360098829952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483401.467693:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3621:1875360098829952:0@lo:400:kworker.0 00000100:00100000:1.0:1788483401.467705:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098829824:0@lo:400:kworker.0 00000100:00100000:2.0:1788483401.467876:0:24298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788483401.467929:0:24299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788483401.467976:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788483401.467981:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788483401.467983:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483401.468034:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3620:1875360098828672:0@lo:400:kworker.0 00000100:00100000:0.0:1788483401.468066:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483401.471116:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098829184:0@lo:400:kworker.0 00000100:00100000:0.0:1788483401.471192:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483401.471233:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098829696:0@lo:400:kworker.0 00000100:00100000:0.0:1788483401.471259:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483401.471288:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788483401.471296:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098829056:0@lo:400:kworker.0 00000100:00100000:0.0:1788483401.471317:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483401.471342:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098829568:0@lo:400:kworker.0 00000100:00100000:0.0:1788483401.471364:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483401.471402:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098828800 00000100:00100000:0.0:1788483401.471408:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098828800 00000100:00100000:0.0:1788483401.471448:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098829184 00000100:00100000:0.0:1788483401.471452:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098829184 00000100:00100000:0.0:1788483401.471467:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788483401.471474:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098828800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483401.471530:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098828800:12345-0@lo:400:kworker.0 Request processed in 55us (4669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483401.471537:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788483401.471553:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788483401.471559:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098829184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483401.471588:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098829184:12345-0@lo:400:kworker.0 Request processed in 29us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483401.471593:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788483401.471622:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098829696 00000100:00100000:0.0:1788483401.471626:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098829696 00000100:00100000:0.0:1788483401.471644:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098829056 00000100:00100000:0.0:1788483401.471646:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098829056 00000100:00100000:0.0:1788483401.471653:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098829568 00000100:00100000:0.0:1788483401.471655:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098829568 00000100:00100000:0.0:1788483401.471666:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788483401.471671:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098829696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483401.471698:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875360098829696:12345-0@lo:400:kworker.0 Request processed in 27us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483401.471703:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788483401.471712:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788483401.471717:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098829056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483401.471738:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098829056:12345-0@lo:400:kworker.0 Request processed in 21us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483401.471743:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788483401.471753:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788483401.471759:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098829568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483401.471799:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875360098829568:12345-0@lo:400:kworker.0 Request processed in 41us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483401.471805:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788483401.471820:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098828672 00000100:00100000:0.0:1788483401.471823:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098828672 00000100:00100000:0.0:1788483401.471880:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788483401.471887:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:3620:x1875360098828672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483401.471912:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:3620:x1875360098828672:12345-0@lo:400:kworker.0 Request processed in 26us (3846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483401.471927:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788483401.471986:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098829056:0@lo:400:kworker.0 00000100:00100000:0.0:1788483401.471996:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3620:1875360098829568:0@lo:400:kworker.0 00000100:00100000:0.0:1788483401.472005:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3620:1875360098828672:0@lo:400:kworker.0 00000100:00100000:0.0:1788483401.472013:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098829184:0@lo:400:kworker.0 00010000:00080000:0.0:1788483401.472023:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69fd8f6d80 x1875360098829696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483401.472033:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3620:1875360098829696:0@lo:400:kworker.0 00000100:00100000:0.0:1788483401.472074:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098828800:0@lo:400:kworker.0 00000100:00100000:2.0:1788483401.473783:0:24298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098829312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483401.473863:0:24298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098829312:12345-0@lo:400:kworker.0 Request processed in 5979us (6959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483401.473878:0:24298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788483401.474148:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098829312:0@lo:400:kworker.0 00000001:00100000:0.0:1788483401.474993:0:23522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of aac9511e-8a30-458e-9fb5-28ad23b758b4 00000001:00100000:0.0:1788483401.475001:0:23522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7da1a6cb-751c-451d-9aac-f6cbb68c7f97 00000001:00100000:2.0:1788483401.475059:0:22768:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aac9511e-8a30-458e-9fb5-28ad23b758b4 00000001:00100000:2.0:1788483401.475065:0:22768:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7da1a6cb-751c-451d-9aac-f6cbb68c7f97 00000100:00100000:3.0:1788483401.479664:0:24299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098828928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483401.479788:0:24299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098828928:12345-0@lo:400:kworker.0 Request processed in 11852us (12794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483401.479799:0:24299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788483401.479864:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098828928:0@lo:400:kworker.0 00000100:00080000:1.0:1788483401.481563:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788483401.481570:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:2.0:1788483401.483573:0:24294:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aac9511e-8a30-458e-9fb5-28ad23b758b4 00000001:00100000:2.0:1788483401.483583:0:24294:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7da1a6cb-751c-451d-9aac-f6cbb68c7f97 00010000:00010000:0.0:1788483401.592349:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788483401.976955:0:22826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1788483402.579951:0:25669:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788483402.620962:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483403.512739:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098830080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788483403.512808:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483403.512923:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098830080 00000100:00100000:2.0:1788483403.512931:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098830080 00000100:00100000:2.0:1788483403.512989:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788483403.513000:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098830080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788483403.513025:0:24301:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788483403.513086:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098830080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483403.513094:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788483403.513302:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483403.513337:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098830080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788483403.513355:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788483403.513362:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098830208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788483403.513387:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483403.513560:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098830208 00000100:00100000:2.0:1788483403.513565:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098830208 00000100:00100000:2.0:1788483403.513600:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788483403.513608:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c34fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098830208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788483403.513651:0:22793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788483403.513695:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c34fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875360098830208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483403.513702:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788483403.513769:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3619:1875360098830208:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788483403.645205:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483403.923820:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483403.923864:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483403.923890:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483403.923909:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483403.923926:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483403.923942:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483403.923958:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483403.923987:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483403.924018:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483403.924060:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087171840 00000100:00100000:1.0:1788483403.924069:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087171840 00000100:00100000:1.0:1788483403.924159:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087172352 00000100:00100000:1.0:1788483403.924163:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087172352 00000100:00100000:1.0:1788483403.924191:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087171712 00000100:00100000:1.0:1788483403.924195:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087171712 00000100:00100000:1.0:1788483403.924206:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087172224 00000100:00100000:1.0:1788483403.924208:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087172224 00000100:00100000:1.0:1788483403.924222:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 51 00000100:00100000:1.0:1788483403.924232:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+5:2390:x1875360087171840:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483403.924558:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+5:2390:x1875360087171840:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 326us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483403.924566:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 51 00000100:00100000:1.0:1788483403.924586:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 52 00000100:00100000:1.0:1788483403.924593:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aac9511e-8a30-458e-9fb5-28ad23b758b4+5:2390:x1875360087172352:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483403.924617:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aac9511e-8a30-458e-9fb5-28ad23b758b4+5:2390:x1875360087172352:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 25us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483403.924624:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 52 00000100:00100000:1.0:1788483403.924635:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 53 00000100:00100000:1.0:1788483403.924642:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+6:2390:x1875360087171712:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483403.924667:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+6:2390:x1875360087171712:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 26us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483403.924674:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 53 00000100:00100000:1.0:1788483403.924699:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 54 00000100:00100000:1.0:1788483403.924706:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aac9511e-8a30-458e-9fb5-28ad23b758b4+6:2390:x1875360087172224:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483403.924729:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aac9511e-8a30-458e-9fb5-28ad23b758b4+6:2390:x1875360087172224:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 24us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483403.924735:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 54 00000100:00100000:1.0:1788483403.924755:0:24300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087172096 00000100:00100000:1.0:1788483403.924759:0:24300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087172096 00000100:00100000:1.0:1788483403.924780:0:24300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087172608 00000100:00100000:1.0:1788483403.924783:0:24300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087172608 00000100:00100000:1.0:1788483403.924795:0:24300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087171968 00000100:00100000:1.0:1788483403.924798:0:24300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087171968 00000100:00100000:1.0:1788483403.924810:0:24300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087172480 00000100:00100000:1.0:1788483403.924819:0:24300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087172480 00000100:00100000:1.0:1788483403.924837:0:24300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 9 00000100:00100000:1.0:1788483403.924843:0:24300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+5:2390:x1875360087172096:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483403.924868:0:24300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+5:2390:x1875360087172096:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 26us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483403.924875:0:24300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 9 00000100:00100000:1.0:1788483403.924886:0:24300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 10 00000100:00100000:1.0:1788483403.924892:0:24300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aac9511e-8a30-458e-9fb5-28ad23b758b4+6:2390:x1875360087172608:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483403.924915:0:24300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aac9511e-8a30-458e-9fb5-28ad23b758b4+6:2390:x1875360087172608:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 23us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483403.924921:0:24300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 10 00000100:00100000:1.0:1788483403.924931:0:24300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 11 00000100:00100000:1.0:1788483403.924936:0:24300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69efe9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+5:2390:x1875360087171968:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483403.924958:0:24300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69efe9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+5:2390:x1875360087171968:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 21us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483403.924963:0:24300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 11 00000100:00100000:1.0:1788483403.924987:0:24300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 12 00000100:00100000:1.0:1788483403.924993:0:24300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aac9511e-8a30-458e-9fb5-28ad23b758b4+5:2390:x1875360087172480:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:1.0:1788483403.925016:0:24300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aac9511e-8a30-458e-9fb5-28ad23b758b4+5:2390:x1875360087172480:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 23us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483403.925022:0:24300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 12 00000100:00080000:1.0:1788483403.925361:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788483403.925366:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788483403.925368:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788483403.925377:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788483403.925562:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087171584 00000100:00100000:0.0:1788483403.925567:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087171584 00000100:00100000:0.0:1788483403.925606:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 148 00000100:00100000:0.0:1788483403.925613:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+13:2390:x1875360087171584:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:0.0:1788483403.925647:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+13:2390:x1875360087171584:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 34us (1837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483403.925653:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 148 00000100:00100000:2.0:1788483404.025371:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788483404.025395:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098830336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788483404.025460:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483404.025507:0:23530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098830336 00000100:00100000:2.0:1788483404.025513:0:23530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098830336 00000100:00100000:2.0:1788483404.025569:0:23530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788483404.025580:0:23530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098830336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788483404.025619:0:23530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788483404.027494:0:23530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875360098830336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1912us (2030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483404.027504:0:23530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788483404.028696:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3622:1875360098830336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788483404.537706:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788483404.537748:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098830464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788483404.537839:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483404.537901:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098830464 00000100:00100000:0.0:1788483404.537910:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098830464 00000100:00100000:0.0:1788483404.537980:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788483404.537992:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098830464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788483404.538019:0:24301:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788483404.538085:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098830464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483404.538093:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788483404.538139:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483404.538199:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098830464:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788483404.578164:0:25113:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aac9511e-8a30-458e-9fb5-28ad23b758b4 00000040:00080000:3.0:1788483404.664933:0:23542:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788483404.668138:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483405.688208:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483406.585375:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3620:1875360098830720:0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.585487:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483406.585546:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098831232:0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.585577:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483406.585598:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098831744:0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.585620:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483406.585637:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098832256:0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.585658:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483406.585685:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788483406.585692:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098830592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483406.585720:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483406.585737:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098831104:0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.585763:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483406.585780:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098831616:0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.585801:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483406.585817:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1875360098832128:0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.585837:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483406.585860:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098830848:0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.586015:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483406.586318:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098831360:0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.586374:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483406.586444:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098831872:0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.586488:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483406.586507:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788483406.586514:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098830976:0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.586538:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483406.586558:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098831488:0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.586581:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483406.586600:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098832000:0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.586621:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483406.586705:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098830720 00000100:00100000:1.0:1788483406.586714:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098830720 00000100:00100000:1.0:1788483406.586769:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788483406.586780:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:3620:x1875360098830720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.586847:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:3620:x1875360098830720:12345-0@lo:400:kworker.0 Request processed in 68us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483406.586855:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788483406.587038:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098831232 00000100:00100000:1.0:1788483406.587043:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098831232 00000100:00100000:1.0:1788483406.587074:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098831744 00000100:00100000:1.0:1788483406.587077:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098831744 00000100:00100000:1.0:1788483406.587090:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098832256 00000100:00100000:1.0:1788483406.587093:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098832256 00000100:00100000:1.0:1788483406.587148:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098832128 00000100:00100000:1.0:1788483406.587151:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098832128 00000100:00100000:1.0:1788483406.587165:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098831872 00000100:00100000:1.0:1788483406.587167:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098831872 00000100:00100000:0.0:1788483406.587319:0:24301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098830592 00000100:00100000:0.0:1788483406.587325:0:24301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098830592 00000100:00100000:0.0:1788483406.587359:0:24301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788483406.587368:0:24301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098830592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788483406.587398:0:24301:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788483406.587444:0:24301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098830592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (1721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483406.587475:0:24301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788483406.587562:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098832000 00000100:00100000:1.0:1788483406.587566:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098832000 00000100:00100000:1.0:1788483406.587582:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788483406.587588:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098831232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.587628:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875360098831232:12345-0@lo:400:kworker.0 Request processed in 41us (2051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483406.587635:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788483406.587648:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788483406.587653:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098831744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.587677:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875360098831744:12345-0@lo:400:kworker.0 Request processed in 24us (2056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483406.587682:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788483406.587692:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788483406.587697:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875360098832256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.587723:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875360098832256:12345-0@lo:400:kworker.0 Request processed in 26us (2064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483406.587728:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788483406.587739:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788483406.587744:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875360098832128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.587767:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875360098832128:12345-0@lo:400:kworker.0 Request processed in 24us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483406.587772:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788483406.587783:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788483406.587788:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098831872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.587812:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875360098831872:12345-0@lo:400:kworker.0 Request processed in 25us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483406.587818:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788483406.587828:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788483406.587833:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098832000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.587867:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098832000:12345-0@lo:400:kworker.0 Request processed in 33us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483406.587873:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788483406.587920:0:24300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098831104 00000100:00100000:1.0:1788483406.587924:0:24300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098831104 00000100:00100000:1.0:1788483406.587939:0:24300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098831616 00000100:00100000:1.0:1788483406.587942:0:24300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098831616 00000100:00100000:1.0:1788483406.587951:0:24300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098830976 00000100:00100000:1.0:1788483406.587954:0:24300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098830976 00000100:00100000:1.0:1788483406.587965:0:24300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098831488 00000100:00100000:1.0:1788483406.587968:0:24300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098831488 00000100:00100000:1.0:1788483406.587978:0:24300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788483406.587983:0:24300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098831104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.588019:0:24300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098831104:12345-0@lo:400:kworker.0 Request processed in 30us (2249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483406.588025:0:24300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788483406.588037:0:24300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788483406.588043:0:24300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098831616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.588080:0:24300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098831616:12345-0@lo:400:kworker.0 Request processed in 37us (2278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483406.588086:0:24300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788483406.588120:0:24300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788483406.588127:0:24300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098830976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.588155:0:24300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098830976:12345-0@lo:400:kworker.0 Request processed in 29us (1616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483406.588160:0:24300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788483406.588172:0:24300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788483406.588651:0:24300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098831488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.588709:0:24300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098831488:12345-0@lo:400:kworker.0 Request processed in 60us (2126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483406.588716:0:24300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788483406.588755:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788483406.588772:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098832384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788483406.588810:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483406.588881:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098830976:0@lo:400:kworker.0 00000100:00100000:3.0:1788483406.589343:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098830848 00000100:00100000:3.0:1788483406.589351:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098830848 00000100:00100000:3.0:1788483406.589394:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098831360 00000100:00100000:3.0:1788483406.589397:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098831360 00000100:00100000:3.0:1788483406.589417:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788483406.589425:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098830848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483406.589476:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098830848:12345-0@lo:400:kworker.0 Request processed in 53us (3462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483406.589484:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788483406.589500:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788483406.589506:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098831360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483406.589546:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098831360:12345-0@lo:400:kworker.0 Request processed in 29us (3161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483406.589552:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788483406.591296:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098831488:0@lo:400:kworker.0 00010000:00080000:1.0:1788483406.591319:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f73f8e00 x1875360098832000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483406.591332:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098832000:0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.591347:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098830848:0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.591361:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098831360:0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.591374:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3621:1875360098831872:0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.596309:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098830592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483406.596370:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098831104:0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.596386:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098831616:0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.596400:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3620:1875360098832128:0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.596414:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3620:1875360098830720:0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.596429:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875360098831232:0@lo:400:kworker.0 00000100:00100000:1.0:1788483406.596980:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875360098831744:0@lo:400:kworker.0 00010000:00080000:1.0:1788483406.597003:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a69f73fa680 x1875360098832256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483406.597016:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3620:1875360098832256:0@lo:400:kworker.0 00000100:00080000:0.0:1788483406.597402:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788483406.597409:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788483406.597412:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788483406.597415:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788483406.597437:0:24302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098832384 00000100:00100000:0.0:1788483406.597445:0:24302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098832384 00000100:00100000:0.0:1788483406.597567:0:24302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788483406.597579:0:24302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd934e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098832384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788483406.597613:0:24302:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788483406.597715:0:24302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd934e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875360098832384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 138us (8903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483406.597724:0:24302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788483406.597812:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3622:1875360098832384:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788483406.712445:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788483407.198796:0:25816:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3eeabbf0 20000000:00000080:1.0:1788483407.198813:0:25816:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a69f7f64400 uarg=0000000000000000 20000000:01000000:1.0:1788483407.199286:0:25816:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788483407.199292:0:25816:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788483407.199297:0:25816:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788483407.203656:0:25817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788483407.205377:0:25816:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788483407.219251:0:25816:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788483407.219309:0:25816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a69c8685a00/0x1d7ea3d89ea1c4b7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483407.219328:0:25816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69edb8b200/0x1d7ea3d89ea1c114 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c10d expref: 23 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483407.219336:0:25816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69d0401c00/0x1d7ea3d89ea1c122 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c11b expref: 23 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483407.219342:0:25816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69edb8ac00/0x1d7ea3d89ea1c161 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c15a expref: 23 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483407.219349:0:25816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69d0401a00/0x1d7ea3d89ea1c2e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c2db expref: 23 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483407.219357:0:25816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c8684c00/0x1d7ea3d89ea1c447 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e811 expref: 12 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483407.219383:0:25816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69c8685200/0x1d7ea3d89ea1c486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e881 expref: 12 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483407.219389:0:25816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a69c8685a00/0x1d7ea3d89ea1c4b7 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483407.219431:0:25816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c8685200/0x1d7ea3d89ea1c486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e881 expref: 12 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483407.219447:0:25816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69c8685200/0x1d7ea3d89ea1c486 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e881 expref: 12 pid: 22782 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483407.219461:0:25816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25816:1875360098832512:192.168.206.54@tcp:104: 00010000:00010000:1.0:1788483407.219605:0:25816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69c8684c00/0x1d7ea3d89ea1c447 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e811 expref: 12 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483407.219614:0:25816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69c8684c00/0x1d7ea3d89ea1c447 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e811 expref: 12 pid: 22783 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483407.219622:0:25816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd937100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25816:1875360098832640:192.168.206.54@tcp:104: 00010000:00010000:1.0:1788483407.219654:0:25816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69d0401a00/0x1d7ea3d89ea1c2e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1c2db expref: 23 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483407.219662:0:25816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69d0401a00/0x1d7ea3d89ea1c2e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c2db expref: 23 pid: 22782 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483407.219671:0:25816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd934700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25816:1875360098832768:0@lo:104: 00000100:00100000:1.0:1788483407.219706:0:25816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788483407.219760:0:25816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69edb8ac00/0x1d7ea3d89ea1c161 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1c15a expref: 23 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483407.219768:0:25816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69edb8ac00/0x1d7ea3d89ea1c161 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c15a expref: 23 pid: 22780 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483407.219775:0:25816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd935880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25816:1875360098832896:0@lo:104: 00000100:00100000:1.0:1788483407.219795:0:25816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788483407.219824:0:25816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69d0401c00/0x1d7ea3d89ea1c122 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1c11b expref: 23 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483407.219843:0:25816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69d0401c00/0x1d7ea3d89ea1c122 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c11b expref: 23 pid: 22782 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483407.219851:0:25816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd936300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25816:1875360098833024:0@lo:104: 00000100:00100000:1.0:1788483407.219872:0:25816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788483407.219889:0:25816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69edb8b200/0x1d7ea3d89ea1c114 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d7ea3d89ea1c10d expref: 23 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483407.219896:0:25816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69edb8b200/0x1d7ea3d89ea1c114 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c10d expref: 23 pid: 22780 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483407.219904:0:25816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25816:1875360098833152:0@lo:104: 00000100:00100000:1.0:1788483407.219923:0:25816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483407.219931:0:25816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f63d93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788483407.220247:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098832768 00000100:00100000:2.0:1788483407.220255:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098832768 00000100:00100000:2.0:1788483407.220288:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098832896 00000100:00100000:2.0:1788483407.220290:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098832896 00000100:00100000:2.0:1788483407.220299:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098833024 00000100:00100000:2.0:1788483407.220301:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098833024 00000100:00100000:2.0:1788483407.220307:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098833152 00000100:00100000:2.0:1788483407.220309:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098833152 00000100:00100000:2.0:1788483407.220320:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788483407.220328:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd934380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+6:25816:x1875360098832768:12345-0@lo:104: 00010000:00010000:2.0:1788483407.220340:0:22771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69c8684400/0x1d7ea3d89ea1c2db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1c2e2 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.220397:0:22771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788483407.220404:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd934380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+6:25816:x1875360098832768:12345-0@lo:104: Request processed in 76us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483407.220410:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788483407.220426:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788483407.220432:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+5:25816:x1875360098832896:12345-0@lo:104: 00010000:00010000:2.0:1788483407.220440:0:22771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1c15a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1c161 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.220485:0:22771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788483407.220490:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+5:25816:x1875360098832896:12345-0@lo:104: Request processed in 58us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483407.220496:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788483407.220508:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788483407.220514:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+4:25816:x1875360098833024:12345-0@lo:104: 00010000:00010000:2.0:1788483407.220521:0:22771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c11b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1c122 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.220552:0:22771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788483407.220557:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+4:25816:x1875360098833024:12345-0@lo:104: Request processed in 44us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483407.220563:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788483407.220574:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788483407.220579:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+3:25816:x1875360098833152:12345-0@lo:104: 00010000:00010000:2.0:1788483407.220586:0:22771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.154@tcp lock: ffff9a69d0400e00/0x1d7ea3d89ea1c10d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1c114 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.220611:0:22771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788483407.220615:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+3:25816:x1875360098833152:12345-0@lo:104: Request processed in 37us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483407.220621:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788483407.220636:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788483407.220641:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69c8684400/0x1d7ea3d89ea1c2db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1c2e2 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.220657:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c8684400 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:2.0:1788483407.220661:0:22777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69c8684400/0x1d7ea3d89ea1c2db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1c2e2 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.220669:0:22777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69c8684400/0x1d7ea3d89ea1c2db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1c2e2 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483407.220676:0:22777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69c8684400/0x1d7ea3d89ea1c2db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1c2e2 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483407.220682:0:22777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788483407.220708:0:22777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69c8684400/0x1d7ea3d89ea1c2db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c2e2 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.220714:0:22777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788483407.220732:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69c8684400/0x1d7ea3d89ea1c2db lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c2e2 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.220738:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69c8684400/0x1d7ea3d89ea1c2db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c2e2 expref: -99 pid: 25112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.220750:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788483407.220753:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1c15a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1c161 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.220759:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0200 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:2.0:1788483407.220761:0:22777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1c15a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1c161 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.220776:0:22777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1c15a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1c161 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483407.220783:0:22777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1c15a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1c161 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483407.220788:0:22777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788483407.220801:0:22777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1c15a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c161 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.220806:0:22777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788483407.220820:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1c15a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c161 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.220826:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecee0200/0x1d7ea3d89ea1c15a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c161 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.220834:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788483407.220837:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c11b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1c122 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.220842:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1c00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:2.0:1788483407.220844:0:22777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c11b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1c122 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.220850:0:22777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c11b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1c122 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483407.220855:0:22777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c11b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1c122 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483407.220866:0:22777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788483407.220880:0:22777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c11b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c122 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.220885:0:22777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788483407.220891:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c11b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c122 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.220897:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c11b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c122 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.220906:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483407.220909:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.154@tcp lock: ffff9a69d0400e00/0x1d7ea3d89ea1c10d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d7ea3d89ea1c114 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.220913:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0400e00 already unused, calling callback (ffffffffc1480c20) 10000000:00010000:2.0:1788483407.220916:0:22777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.154@tcp lock: ffff9a69d0400e00/0x1d7ea3d89ea1c10d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d7ea3d89ea1c114 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.220922:0:22777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.154@tcp lock: ffff9a69d0400e00/0x1d7ea3d89ea1c10d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d7ea3d89ea1c114 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483407.220928:0:22777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.154@tcp lock: ffff9a69d0400e00/0x1d7ea3d89ea1c10d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d7ea3d89ea1c114 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483407.220934:0:22777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788483407.220944:0:22777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.154@tcp lock: ffff9a69d0400e00/0x1d7ea3d89ea1c10d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c114 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.220949:0:22777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788483407.220961:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.154@tcp lock: ffff9a69d0400e00/0x1d7ea3d89ea1c10d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c114 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.220967:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.154@tcp lock: ffff9a69d0400e00/0x1d7ea3d89ea1c10d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d7ea3d89ea1c114 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.220979:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483407.220980:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483407.220982:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483407.220989:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483407.220994:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483407.221013:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3622:1875360098833280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483407.221044:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483407.221089:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788483407.221116:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3622:1875360098833664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483407.221136:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483407.221168:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3619:1875360098833408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483407.221188:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483407.221206:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788483407.221212:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3619:1875360098833536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483407.221230:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483407.221257:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098833280 00000100:00100000:2.0:1788483407.221261:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098833280 00010000:00010000:2.0:1788483407.221280:0:22775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69d0401a00/0x1d7ea3d89ea1c2e2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c2db expref: 24 pid: 22782 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483407.221293:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098833664 00000100:00100000:2.0:1788483407.221296:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098833664 00010000:00010000:2.0:1788483407.221305:0:22775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69edb8b200/0x1d7ea3d89ea1c114 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c10d expref: 25 pid: 22780 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483407.221322:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098833408 00000100:00100000:2.0:1788483407.221325:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098833408 00010000:00010000:2.0:1788483407.221336:0:22775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69edb8ac00/0x1d7ea3d89ea1c161 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c15a expref: 26 pid: 22780 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483407.221345:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098833536 00000100:00100000:2.0:1788483407.221347:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098833536 00010000:00010000:2.0:1788483407.221356:0:22775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69d0401c00/0x1d7ea3d89ea1c122 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c11b expref: 27 pid: 22782 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483407.221368:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788483407.221374:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+27:3622:x1875360098833280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483407.221383:0:22775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483407.221388:0:22775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69d0401a00/0x1d7ea3d89ea1c2e2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c2db expref: 27 pid: 22782 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.221397:0:22775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69d0401a00/0x1d7ea3d89ea1c2e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c2db expref: 27 pid: 22782 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.221411:0:22775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483407.221438:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+27:3622:x1875360098833280:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483407.221445:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788483407.221458:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788483407.221464:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+26:3622:x1875360098833664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483407.221484:0:22775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483407.221489:0:22775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69edb8b200/0x1d7ea3d89ea1c114 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c10d expref: 26 pid: 22780 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.221506:0:22775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69edb8b200/0x1d7ea3d89ea1c114 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c10d expref: 26 pid: 22780 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.221515:0:22775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483407.221537:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+26:3622:x1875360098833664:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483407.221543:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788483407.221556:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788483407.221562:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+25:3619:x1875360098833408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483407.221569:0:22775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483407.221574:0:22775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69edb8ac00/0x1d7ea3d89ea1c161 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c15a expref: 25 pid: 22780 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.221581:0:22775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69edb8ac00/0x1d7ea3d89ea1c161 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c15a expref: 25 pid: 22780 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.221589:0:22775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483407.221611:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+25:3619:x1875360098833408:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483407.221616:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788483407.221627:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788483407.221633:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:3619:x1875360098833536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483407.221640:0:22775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483407.221644:0:22775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69d0401c00/0x1d7ea3d89ea1c122 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c11b expref: 24 pid: 22782 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.221651:0:22775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69d0401c00/0x1d7ea3d89ea1c122 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c11b expref: 24 pid: 22782 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.221665:0:22775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483407.221689:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:3619:x1875360098833536:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483407.221695:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788483407.221729:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3619:1875360098833536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483407.221736:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3619:1875360098833408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483407.221755:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3622:1875360098833664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483407.221762:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3622:1875360098833280:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788483407.223489:0:25816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69d0401a00/0x1d7ea3d89ea1c2e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c2db expref: 23 pid: 22782 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483407.223509:0:25816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25816:1875360098832768:0@lo:104: 00010000:00010000:1.0:1788483407.223522:0:25816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69edb8ac00/0x1d7ea3d89ea1c161 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c15a expref: 22 pid: 22780 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483407.223545:0:25816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd935880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25816:1875360098832896:0@lo:104: 00010000:00010000:1.0:1788483407.223557:0:25816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69d0401c00/0x1d7ea3d89ea1c122 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c11b expref: 21 pid: 22782 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483407.223565:0:25816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd936300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25816:1875360098833024:0@lo:104: 00010000:00010000:1.0:1788483407.223573:0:25816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69edb8b200/0x1d7ea3d89ea1c114 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d7ea3d89ea1c10d expref: 20 pid: 22780 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483407.223582:0:25816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25816:1875360098833152:0@lo:104: 00000100:00100000:1.0:1788483407.227021:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483407.227069:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483407.227199:0:25816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd934000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25816:1875360098832512:192.168.206.54@tcp:104: 00000100:00100000:0.0:1788483407.227213:0:25816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd937100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25816:1875360098832640:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483407.227246:0:25816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a69c8685a00/0x1d7ea3d89ea1c4b7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483407.227379:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087172736 00000100:00100000:2.0:1788483407.227386:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087172736 00010000:00010000:2.0:1788483407.227418:0:22773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c8685200/0x1d7ea3d89ea1c486 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e881 expref: 13 pid: 22782 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483407.227454:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087172864 00000100:00100000:2.0:1788483407.227457:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087172864 00010000:00010000:2.0:1788483407.227468:0:22773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69c8684c00/0x1d7ea3d89ea1c447 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e811 expref: 14 pid: 22783 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483407.227485:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 13 00000100:00100000:2.0:1788483407.227493:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e0009450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+14:2393:x1875360087172736:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483407.227506:0:22773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483407.227512:0:22773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c8685200/0x1d7ea3d89ea1c486 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e881 expref: 14 pid: 22782 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.227522:0:22773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c8685200/0x1d7ea3d89ea1c486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e881 expref: 14 pid: 22782 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.227555:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c8685200/0x1d7ea3d89ea1c486 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e881 expref: 14 pid: 22782 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.227568:0:22773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483407.227618:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e0009450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+13:2393:x1875360087172736:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 125us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483407.227625:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 13 00000100:00100000:2.0:1788483407.227680:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 14 00000100:00100000:2.0:1788483407.227687:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+12:2392:x1875360087172864:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483407.227695:0:22773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483407.227700:0:22773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69c8684c00/0x1d7ea3d89ea1c447 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e811 expref: 12 pid: 22783 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.227710:0:22773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69c8684c00/0x1d7ea3d89ea1c447 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e811 expref: 12 pid: 22783 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.227720:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c8684c00/0x1d7ea3d89ea1c447 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e811 expref: 12 pid: 22783 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.227729:0:22773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a69c8685a00/0x1d7ea3d89ea1c4b7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.227737:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69c8685a00/0x1d7ea3d89ea1c4b7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.227749:0:22773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69c8685a00/0x1d7ea3d89ea1c4b7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.227766:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69c8685a00/0x1d7ea3d89ea1c4b7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.227773:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a69c8685a00/0x1d7ea3d89ea1c4b7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.227779:0:22773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a69c8685a00/0x1d7ea3d89ea1c4b7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.227784:0:22773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c8685a00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483407.227789:0:22773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a69c8685a00/0x1d7ea3d89ea1c4b7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.227796:0:22773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a69c8685a00/0x1d7ea3d89ea1c4b7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.227808:0:22773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a69c8685a00/0x1d7ea3d89ea1c4b7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.227817:0:22773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483407.227914:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+11:2392:x1875360087172864:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 226us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483407.227921:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 14 00010000:00010000:0.0:1788483407.228254:0:25816:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a69c8685a00/0x1d7ea3d89ea1c4b7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483407.228262:0:25816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a69c8685a00/0x1d7ea3d89ea1c4b7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483407.228268:0:25816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69c8685a00/0x1d7ea3d89ea1c4b7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483407.736245:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483408.632878:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788483408.634242:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788483408.634272:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098833920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788483408.634331:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483408.634514:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098833920 00000100:00100000:2.0:1788483408.634523:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098833920 00000100:00100000:2.0:1788483408.634571:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788483408.634579:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098833920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788483408.634610:0:22793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788483408.634668:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098833920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483408.634675:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788483408.634713:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098833920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788483408.635985:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098833792:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788483408.637522:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483408.651289:0:24302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098833792 00000100:00100000:0.0:1788483408.651304:0:24302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098833792 00000100:00100000:0.0:1788483408.651377:0:24302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788483408.651389:0:24302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098833792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788483408.651420:0:24302:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788483408.651492:0:24302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098833792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (13976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483408.651499:0:24302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788483408.651553:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098833792:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788483408.652357:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788483408.761336:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483408.823365:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483408.823506:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087172992 00000100:00100000:1.0:1788483408.823523:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087172992 00000100:00080000:0.0:1788483408.823712:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788483408.824493:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 23 00000100:00100000:1.0:1788483408.824510:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+6:18711:x1875360087172992:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788483408.824530:0:22790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483408.824551:0:22790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685800/0x1d7ea3d89ea1c4be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e8b9 expref: -99 pid: 22790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.824625:0:22790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684c00/0x1d7ea3d89ea1c4c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.824639:0:22790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684c00/0x1d7ea3d89ea1c4c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.824663:0:22790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684c00/0x1d7ea3d89ea1c4c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.824679:0:22790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685200/0x1d7ea3d89ea1c4cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.824686:0:22790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685200/0x1d7ea3d89ea1c4cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.824693:0:22790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685200/0x1d7ea3d89ea1c4cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.824764:0:22790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685a00/0x1d7ea3d89ea1c4d3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.824773:0:22790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685a00/0x1d7ea3d89ea1c4d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.824780:0:22790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685a00/0x1d7ea3d89ea1c4d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483408.824808:0:22790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788483408.824812:0:22790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788483408.824848:0:22790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685a00/0x1d7ea3d89ea1c4d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.824859:0:22790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684c00/0x1d7ea3d89ea1c4c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.824866:0:22790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684c00/0x1d7ea3d89ea1c4c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.824882:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684c00/0x1d7ea3d89ea1c4c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.824888:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c8684c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483408.824892:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684c00/0x1d7ea3d89ea1c4c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.824899:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684c00/0x1d7ea3d89ea1c4c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.824909:0:22790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c3603000) 00010000:00010000:1.0:1788483408.824912:0:22790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483408.824915:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684c00/0x1d7ea3d89ea1c4c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.824920:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684c00/0x1d7ea3d89ea1c4c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.824934:0:22790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685200/0x1d7ea3d89ea1c4cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.824940:0:22790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685200/0x1d7ea3d89ea1c4cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.824946:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685200/0x1d7ea3d89ea1c4cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.824950:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c8685200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483408.824953:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685200/0x1d7ea3d89ea1c4cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.824969:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685200/0x1d7ea3d89ea1c4cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.824977:0:22790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a69f63cbd00) 00010000:00010000:1.0:1788483408.824979:0:22790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483408.824982:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685200/0x1d7ea3d89ea1c4cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.824987:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685200/0x1d7ea3d89ea1c4cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.825020:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685800/0x1d7ea3d89ea1c4be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8b9 expref: 8 pid: 22790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.825033:0:22790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685a00/0x1d7ea3d89ea1c4d3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8b9 expref: 7 pid: 22790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.825040:0:22790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a69f63cb900) 00010000:00010000:1.0:1788483408.825043:0:22790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788483408.825056:0:22790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69c8685a00, rc 0) 00000100:00100000:1.0:1788483408.825166:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+7:18711:x1875360087172992:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 662us (1814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483408.828824:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483408.828929:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087173120 00000100:00100000:0.0:1788483408.828939:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087173120 00000100:00100000:0.0:1788483408.828996:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 5 00000100:00100000:0.0:1788483408.829006:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+8:18711:x1875360087173120:12345-192.168.206.54@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788483408.829142:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+8:18711:x1875360087173120:12345-192.168.206.54@tcp:900:lhsmtool_posix.0 Request processed in 93us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483408.829151:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 5 00000100:00100000:0.0:1788483408.831832:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483408.831957:0:22789:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788483408.831966:0:22789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788483408.832259:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 23 00000100:00100000:1.0:1788483408.832284:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087173376 00000100:00100000:1.0:1788483408.832292:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087173376 00000100:00100000:1.0:1788483408.832321:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 24 00000100:00100000:1.0:1788483408.832330:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+7:18711:x1875360087173376:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788483408.832363:0:22790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483408.832382:0:22790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684400/0x1d7ea3d89ea1c4da lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e8c0 expref: -99 pid: 22790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.832462:0:22790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685c00/0x1d7ea3d89ea1c4e1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.832475:0:22790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685c00/0x1d7ea3d89ea1c4e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.832486:0:22790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685c00/0x1d7ea3d89ea1c4e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.832500:0:22790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684a00/0x1d7ea3d89ea1c4e8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.832507:0:22790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684a00/0x1d7ea3d89ea1c4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.832514:0:22790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684a00/0x1d7ea3d89ea1c4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.832629:0:22790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5273400/0x1d7ea3d89ea1c4ef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.832638:0:22790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5273400/0x1d7ea3d89ea1c4ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.832646:0:22790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5273400/0x1d7ea3d89ea1c4ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483408.832656:0:22790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788483408.832803:0:22790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685c00/0x1d7ea3d89ea1c4e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.832811:0:22790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685c00/0x1d7ea3d89ea1c4e1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.832817:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685c00/0x1d7ea3d89ea1c4e1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.832823:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c8685c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483408.832827:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685c00/0x1d7ea3d89ea1c4e1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.832834:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685c00/0x1d7ea3d89ea1c4e1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.832846:0:22790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a69f63cb900) 00010000:00010000:1.0:1788483408.832849:0:22790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483408.832853:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685c00/0x1d7ea3d89ea1c4e1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.832860:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8685c00/0x1d7ea3d89ea1c4e1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.832872:0:22790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684a00/0x1d7ea3d89ea1c4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.832878:0:22790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684a00/0x1d7ea3d89ea1c4e8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.832883:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684a00/0x1d7ea3d89ea1c4e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.832899:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69c8684a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483408.832902:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684a00/0x1d7ea3d89ea1c4e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.832907:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684a00/0x1d7ea3d89ea1c4e8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.833009:0:22790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a69f63cb600) 00010000:00010000:1.0:1788483408.833013:0:22790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483408.833088:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684a00/0x1d7ea3d89ea1c4e8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.833152:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684a00/0x1d7ea3d89ea1c4e8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.834306:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684400/0x1d7ea3d89ea1c4da lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8c0 expref: 10 pid: 22790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.834326:0:22790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5273400/0x1d7ea3d89ea1c4ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8c0 expref: 9 pid: 22790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.834335:0:22790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a69f63cb000) 00010000:00010000:1.0:1788483408.834338:0:22790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483408.834340:0:22790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69f5273400, rc 0) 00000100:00100000:1.0:1788483408.834412:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+9:18711:x1875360087173376:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 2082us (2587us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788483408.834420:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 24 00000100:00100000:0.0:1788483408.848703:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483408.848796:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087173504 00000100:00100000:3.0:1788483408.848806:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087173504 00000100:00100000:3.0:1788483408.848862:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 25 00000100:00100000:3.0:1788483408.848872:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+9:18711:x1875360087173504:12345-192.168.206.54@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788483408.848983:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+9:18711:x1875360087173504:12345-192.168.206.54@tcp:59:lhsmtool_posix.0 Request processed in 112us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483408.848990:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 25 00000100:00100000:3.0:1788483408.852857:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483408.852967:0:25830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087173632 00000100:00100000:2.0:1788483408.852976:0:25830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087173632 00000100:00100000:2.0:1788483408.853057:0:25830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 26 00000100:00100000:2.0:1788483408.853068:0:25830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+5:18711:x1875360087173632:12345-192.168.206.54@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1788483408.853294:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788483408.854237:0:25830:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 891us 00000100:00100000:0.0:1788483408.870603:0:25830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+5:18711:x1875360087173632:12345-192.168.206.54@tcp:59:lhsmtool_posix.0 Request processed in 17529us (17745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483408.870622:0:25830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 26 00000100:00100000:0.0:1788483408.890259:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483408.892969:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087173760 00000100:00100000:3.0:1788483408.892982:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087173760 00000100:00100000:3.0:1788483408.893195:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 27 00000100:00100000:3.0:1788483408.893206:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+9:18717:x1875360087173760:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:3.0:1788483408.893225:0:22788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483408.893248:0:22788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0000/0x1d7ea3d89ea1c4fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e8c7 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.893314:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0800/0x1d7ea3d89ea1c504 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.893327:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0800/0x1d7ea3d89ea1c504 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.893338:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0800/0x1d7ea3d89ea1c504 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.893353:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1c50b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.893374:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1c50b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.893381:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1c50b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.893425:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0800/0x1d7ea3d89ea1c504 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.893432:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0800/0x1d7ea3d89ea1c504 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.893438:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0800/0x1d7ea3d89ea1c504 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.893445:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483408.893450:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0800/0x1d7ea3d89ea1c504 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.893457:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0800/0x1d7ea3d89ea1c504 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.893469:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c3603000) 00010000:00010000:3.0:1788483408.893472:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483408.893476:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0800/0x1d7ea3d89ea1c504 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.893482:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0800/0x1d7ea3d89ea1c504 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.893495:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1c50b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.893507:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1c50b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.893513:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1c50b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.893517:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483408.893520:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1c50b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.893526:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1c50b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.893534:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a68c1c54000) 00010000:00010000:3.0:1788483408.893537:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483408.893539:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1c50b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.893545:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1c50b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.893575:0:22788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0000/0x1d7ea3d89ea1c4fd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8c7 expref: 10 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.893585:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c3603000) 00010000:00010000:3.0:1788483408.893587:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483408.893591:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0000/0x1d7ea3d89ea1c4fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8c7 expref: 10 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.893610:0:22788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee0000, rc 0) 00000100:00100000:3.0:1788483408.893665:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+9:18717:x1875360087173760:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 461us (3414us total) trans 0 rc 301/301 00000100:00100000:3.0:1788483408.893672:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 27 00000100:00100000:0.0:1788483408.902442:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483408.902550:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087173888 00000100:00100000:1.0:1788483408.902569:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087173888 00000100:00100000:1.0:1788483408.902620:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 0 00000100:00100000:1.0:1788483408.902629:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+9:18717:x1875360087173888:12345-192.168.206.54@tcp:700:lfs.0 00000100:00100000:1.0:1788483408.902702:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+9:18717:x1875360087173888:12345-192.168.206.54@tcp:700:lfs.0 Request processed in 73us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483408.902710:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 0 00000100:00100000:0.0:1788483408.905214:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483408.905510:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087174144 00000100:00100000:1.0:1788483408.905520:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087174144 00000100:00100000:1.0:1788483408.905580:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 28 00000100:00100000:1.0:1788483408.905589:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+9:18717:x1875360087174144:12345-192.168.206.54@tcp:36:lfs.0 00010000:00010000:1.0:1788483408.905647:0:22790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483408.905673:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1c471 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e842 expref: 9 pid: 22790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.905693:0:22790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c3603000) 00010000:00010000:1.0:1788483408.905698:0:22790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788483408.905755:0:22790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272000/0x1d7ea3d89ea1c512 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.905768:0:22790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684600/0x1d7ea3d89ea1c4b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8b2 expref: 5 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.905776:0:22790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272000/0x1d7ea3d89ea1c512 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.905805:0:22790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684600/0x1d7ea3d89ea1c4b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8b2 expref: 5 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.905836:0:22790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684600/0x1d7ea3d89ea1c4b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8b2 expref: 5 pid: 22789 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483408.905850:0:22790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22790:1875360098834048:192.168.206.54@tcp:104: 00000100:00100000:1.0:1788483408.905935:0:22790:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f63d9900 going to sleep for 11 seconds 00000100:00100000:0.0:1788483408.908633:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483408.908744:0:22790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22790:1875360098834048:192.168.206.54@tcp:104: 00010000:00010000:1.0:1788483408.908769:0:22790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272000/0x1d7ea3d89ea1c512 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483408.909038:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087174272 00000100:00100000:2.0:1788483408.909054:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087174272 00010000:00010000:2.0:1788483408.909127:0:22773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684600/0x1d7ea3d89ea1c4b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8b2 expref: 6 pid: 22789 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483408.909160:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 15 00000100:00100000:2.0:1788483408.909169:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd934000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aac9511e-8a30-458e-9fb5-28ad23b758b4+6:2392:x1875360087174272:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483408.909181:0:22773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483408.909188:0:22773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684600/0x1d7ea3d89ea1c4b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8b2 expref: 6 pid: 22789 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483408.909200:0:22773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684600/0x1d7ea3d89ea1c4b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8b2 expref: 6 pid: 22789 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483408.909220:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69c8684600/0x1d7ea3d89ea1c4b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8b2 expref: 6 pid: 22789 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483408.909252:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c3603000) 00010000:00010000:2.0:1788483408.909257:0:22773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272000/0x1d7ea3d89ea1c512 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483408.909265:0:22773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272000/0x1d7ea3d89ea1c512 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483408.909271:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272000/0x1d7ea3d89ea1c512 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788483408.909449:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788483408.910124:0:22773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483408.910191:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd934000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aac9511e-8a30-458e-9fb5-28ad23b758b4+5:2392:x1875360087174272:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 1020us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483408.910200:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 15 00010000:00010000:3.0:1788483408.912904:0:22790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272000/0x1d7ea3d89ea1c512 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.912931:0:22790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272000/0x1d7ea3d89ea1c512 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.912959:0:22790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0000/0x1d7ea3d89ea1c519 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.912971:0:22790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0000/0x1d7ea3d89ea1c519 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.912981:0:22790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0000/0x1d7ea3d89ea1c519 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.914941:0:22790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1c520 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.914959:0:22790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1c520 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.914968:0:22790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1c520 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788483408.914988:0:22790:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008cd817f2 reply state 0000000060d277f0 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1c520 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.915411:0:22790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1c520 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.915424:0:22790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a68c1c54200) 00010000:00010000:3.0:1788483408.915427:0:22790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788483408.915432:0:22790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788483408.915438:0:22790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788483408.915448:0:22790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272000/0x1d7ea3d89ea1c512 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.915455:0:22790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272000/0x1d7ea3d89ea1c512 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.915462:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272000/0x1d7ea3d89ea1c512 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.915468:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69f5272000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483408.915472:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272000/0x1d7ea3d89ea1c512 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.915480:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272000/0x1d7ea3d89ea1c512 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.915489:0:22790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c3603000) 00010000:00010000:3.0:1788483408.915492:0:22790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483408.915495:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272000/0x1d7ea3d89ea1c512 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.915501:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272000/0x1d7ea3d89ea1c512 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788483408.915532:0:22790:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008cd817f2 reply state 0000000060d277f0 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0000/0x1d7ea3d89ea1c519 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.915541:0:22790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0000/0x1d7ea3d89ea1c519 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483408.915547:0:22790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a68c1c54000) 00010000:00010000:3.0:1788483408.915550:0:22790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788483408.915552:0:22790:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788483408.915712:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+10:18717:x1875360087174144:12345-192.168.206.54@tcp:36:lfs.0 Request processed in 10119us (10501us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788483408.915721:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 28 00000100:00100000:3.0:1788483408.980976:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483408.981170:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087174400 00000100:00100000:1.0:1788483408.981186:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087174400 00000100:00100000:1.0:1788483408.981322:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 150 00000100:00100000:1.0:1788483408.981333:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+11:18090:x1875360087174400:12345-192.168.206.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788483408.981350:0:22783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483408.981369:0:22783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69f5273800/0x1d7ea3d89ea1c527 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e8ce expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.981398:0:22783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69f5273800/0x1d7ea3d89ea1c527 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8ce expref: 12 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.981484:0:22783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69f5273800/0x1d7ea3d89ea1c527 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8ce expref: 12 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483408.981493:0:22783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69f5273800, rc 0) 00000100:00100000:1.0:1788483408.981563:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+12:18090:x1875360087174400:12345-192.168.206.54@tcp:101:ll_cfg_requeue.0 Request processed in 231us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483408.981585:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 150 00000100:00100000:0.0:1788483408.985771:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483408.985879:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087174528 00000100:00100000:2.0:1788483408.985890:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087174528 00000100:00100000:2.0:1788483408.985957:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 151 00000100:00100000:2.0:1788483408.985967:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+12:18090:x1875360087174528:12345-192.168.206.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788483408.986150:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+12:18090:x1875360087174528:12345-192.168.206.54@tcp:501:ll_cfg_requeue.0 Request processed in 183us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483408.986159:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 151 00000100:00100000:2.0:1788483408.994694:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483408.995263:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087174656 00000100:00100000:1.0:1788483408.995273:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087174656 00000100:00100000:1.0:1788483408.995324:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 152 00000100:00100000:1.0:1788483408.995334:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+12:18090:x1875360087174656:12345-192.168.206.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788483408.995469:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+12:18090:x1875360087174656:12345-192.168.206.54@tcp:503:ll_cfg_requeue.0 Request processed in 135us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483408.995476:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 152 00000100:00100000:3.0:1788483409.008824:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483409.009038:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087174784 00000100:00100000:0.0:1788483409.009057:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087174784 00000100:00100000:0.0:1788483409.009150:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 153 00000100:00100000:0.0:1788483409.009161:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f62bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+12:18090:x1875360087174784:12345-192.168.206.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483409.009177:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483409.009195:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69d0401600/0x1d7ea3d89ea1c52e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e8d5 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.009224:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69d0401600/0x1d7ea3d89ea1c52e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8d5 expref: 13 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.009235:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69d0401600/0x1d7ea3d89ea1c52e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8d5 expref: 13 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.009245:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69d0401600, rc 0) 00000100:00100000:0.0:1788483409.009289:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f62bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+13:18090:x1875360087174784:12345-192.168.206.54@tcp:101:ll_cfg_requeue.0 Request processed in 131us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483409.009296:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 153 00000100:00100000:0.0:1788483409.015300:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483409.015389:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087174912 00000100:00100000:3.0:1788483409.015399:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087174912 00000100:00100000:3.0:1788483409.015452:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 154 00000100:00100000:3.0:1788483409.015462:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+13:18090:x1875360087174912:12345-192.168.206.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788483409.015604:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+13:18090:x1875360087174912:12345-192.168.206.54@tcp:501:ll_cfg_requeue.0 Request processed in 142us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483409.015612:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 154 00000100:00100000:2.0:1788483409.018895:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483409.019121:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087175040 00000100:00100000:1.0:1788483409.019131:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087175040 00000100:00100000:1.0:1788483409.019185:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 155 00000100:00100000:1.0:1788483409.019194:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdabbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+13:18090:x1875360087175040:12345-192.168.206.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788483409.019331:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdabbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cdddebc-d84c-4d1f-9b94-1e40ffcda201+13:18090:x1875360087175040:12345-192.168.206.54@tcp:503:ll_cfg_requeue.0 Request processed in 136us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483409.019338:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 155 00000100:00100000:1.0:1788483409.028511:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483409.028602:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087175168 00000100:00100000:3.0:1788483409.028611:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087175168 00000100:00100000:3.0:1788483409.028672:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 29 00000100:00100000:3.0:1788483409.028683:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+10:18725:x1875360087175168:12345-192.168.206.54@tcp:101:lctl.0 00010000:00010000:3.0:1788483409.028707:0:22788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483409.028753:0:22788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0800/0x1d7ea3d89ea1c535 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e8dc expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.028830:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0600/0x1d7ea3d89ea1c53c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.028842:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0600/0x1d7ea3d89ea1c53c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.028854:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0600/0x1d7ea3d89ea1c53c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483409.028901:0:22788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788483409.028906:0:22788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788483409.028957:0:22788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0600/0x1d7ea3d89ea1c53c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.028984:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0800/0x1d7ea3d89ea1c535 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8dc expref: 12 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.029003:0:22788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0600/0x1d7ea3d89ea1c53c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8dc expref: 11 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.029011:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c1c54e00) 00010000:00010000:3.0:1788483409.029023:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788483409.029027:0:22788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee0600, rc 0) 00000100:00100000:3.0:1788483409.029141:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+11:18725:x1875360087175168:12345-192.168.206.54@tcp:101:lctl.0 Request processed in 416us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483409.029148:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 29 00000100:00100000:0.0:1788483409.043865:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483409.043931:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483409.043967:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483409.043998:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483409.044030:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483409.044149:0:24773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087175296 00000100:00100000:3.0:1788483409.044165:0:24773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087175296 00000100:00100000:3.0:1788483409.044219:0:24773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087175808 00000100:00100000:3.0:1788483409.044223:0:24773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087175808 00000100:00100000:3.0:1788483409.044236:0:24773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087175424 00000100:00100000:3.0:1788483409.044239:0:24773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087175424 00000100:00100000:3.0:1788483409.044251:0:24773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087175680 00000100:00100000:3.0:1788483409.044254:0:24773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087175680 00000100:00100000:3.0:1788483409.044269:0:24773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 17 00000100:00100000:3.0:1788483409.044279:0:24773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+5:2391:x1875360087175296:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483409.044347:0:24773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+5:2391:x1875360087175296:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 69us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483409.044354:0:24773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 17 00000100:00100000:3.0:1788483409.044369:0:24773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 18 00000100:00100000:3.0:1788483409.044375:0:24773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f5ee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aac9511e-8a30-458e-9fb5-28ad23b758b4+5:2391:x1875360087175808:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483409.044400:0:24773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f5ee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aac9511e-8a30-458e-9fb5-28ad23b758b4+5:2391:x1875360087175808:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 24us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483409.044406:0:24773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 18 00000100:00100000:3.0:1788483409.044516:0:24773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 19 00000100:00100000:3.0:1788483409.044522:0:24773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+5:2391:x1875360087175424:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483409.044545:0:24773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+5:2391:x1875360087175424:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 23us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483409.044552:0:24773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 19 00000100:00100000:3.0:1788483409.044563:0:24773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 20 00000100:00100000:3.0:1788483409.044569:0:24773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aac9511e-8a30-458e-9fb5-28ad23b758b4+5:2391:x1875360087175680:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:3.0:1788483409.044590:0:24773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aac9511e-8a30-458e-9fb5-28ad23b758b4+5:2391:x1875360087175680:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 22us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483409.044602:0:24773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 20 00000100:00100000:2.0:1788483409.045656:0:25830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087175552 00000100:00100000:2.0:1788483409.045665:0:25830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087175552 00000100:00100000:2.0:1788483409.045715:0:25830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 61 00000100:00100000:2.0:1788483409.045723:0:25830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aac9511e-8a30-458e-9fb5-28ad23b758b4+5:2391:x1875360087175552:12345-192.168.206.54@tcp:400:kworker.0 00000100:00100000:2.0:1788483409.045799:0:25830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aac9511e-8a30-458e-9fb5-28ad23b758b4+5:2391:x1875360087175552:12345-192.168.206.54@tcp:400:kworker.0 Request processed in 77us (1868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483409.045806:0:25830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 61 00000100:00080000:0.0:1788483409.046345:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788483409.046350:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788483409.046353:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483409.072061:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483409.072174:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087175936 00000100:00100000:3.0:1788483409.072184:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087175936 00000100:00100000:3.0:1788483409.072242:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 30 00000100:00100000:3.0:1788483409.072251:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aac9511e-8a30-458e-9fb5-28ad23b758b4+5:18728:x1875360087175936:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:3.0:1788483409.072268:0:22788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483409.072288:0:22788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0800/0x1d7ea3d89ea1c543 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e8e3 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.072356:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c54a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.072369:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c54a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.072379:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c54a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483409.072422:0:22788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788483409.072427:0:22788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788483409.072447:0:22788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c54a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.072472:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0800/0x1d7ea3d89ea1c543 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8e3 expref: 7 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.072490:0:22788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1c00/0x1d7ea3d89ea1c54a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8e3 expref: 6 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.072517:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c1c54e00) 00010000:00010000:3.0:1788483409.072520:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788483409.072524:0:22788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee1c00, rc 0) 00000100:00100000:3.0:1788483409.072584:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aac9511e-8a30-458e-9fb5-28ad23b758b4+6:18728:x1875360087175936:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 334us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483409.072591:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 30 00000100:00100000:1.0:1788483409.075218:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483409.075341:0:25830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087176064 00000100:00100000:2.0:1788483409.075349:0:25830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087176064 00000100:00100000:2.0:1788483409.075401:0:25830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 31 00000100:00100000:2.0:1788483409.075411:0:25830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aac9511e-8a30-458e-9fb5-28ad23b758b4+6:18728:x1875360087176064:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:2.0:1788483409.075429:0:25830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483409.075446:0:25830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1c551 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e8ea expref: -99 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075509:0:25830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1c558 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075523:0:25830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1c558 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075533:0:25830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1c558 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075542:0:25830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1c55f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075548:0:25830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1c55f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075554:0:25830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1c55f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075621:0:25830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26e00/0x1d7ea3d89ea1c566 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075639:0:25830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26e00/0x1d7ea3d89ea1c566 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075646:0:25830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26e00/0x1d7ea3d89ea1c566 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483409.075683:0:25830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788483409.075687:0:25830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788483409.075707:0:25830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26e00/0x1d7ea3d89ea1c566 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075718:0:25830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1c558 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075725:0:25830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1c558 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075732:0:25830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1c558 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075738:0:25830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26600 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483409.075742:0:25830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1c558 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075749:0:25830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1c558 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075760:0:25830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c1c54e00) 00010000:00010000:2.0:1788483409.075762:0:25830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483409.075766:0:25830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1c558 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075783:0:25830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1c558 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075795:0:25830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1c55f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075801:0:25830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1c55f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075807:0:25830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1c55f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075812:0:25830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483409.075815:0:25830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1c55f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075821:0:25830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1c55f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075828:0:25830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a68c1c54000) 00010000:00010000:2.0:1788483409.075830:0:25830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483409.075833:0:25830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1c55f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075838:0:25830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1c55f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075865:0:25830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1c551 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8ea expref: 8 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075891:0:25830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26e00/0x1d7ea3d89ea1c566 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8ea expref: 7 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.075899:0:25830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a68c1c54200) 00010000:00010000:2.0:1788483409.075901:0:25830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788483409.075903:0:25830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf26e00, rc 0) 00000100:00100000:2.0:1788483409.075966:0:25830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aac9511e-8a30-458e-9fb5-28ad23b758b4+7:18728:x1875360087176064:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 556us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483409.075973:0:25830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 31 00000100:00100000:1.0:1788483409.088724:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483409.088956:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087176192 00000100:00100000:0.0:1788483409.088967:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087176192 00000100:00100000:0.0:1788483409.089030:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 6 00000100:00100000:0.0:1788483409.089040:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:aac9511e-8a30-458e-9fb5-28ad23b758b4+5:18728:x1875360087176192:12345-192.168.206.54@tcp:900:lfs.0 00000100:00100000:0.0:1788483409.089163:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:aac9511e-8a30-458e-9fb5-28ad23b758b4+5:18728:x1875360087176192:12345-192.168.206.54@tcp:900:lfs.0 Request processed in 123us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483409.089171:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 6 00000100:00100000:0.0:1788483409.097623:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483409.097700:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087176448 00000100:00100000:3.0:1788483409.097710:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087176448 00000100:00100000:3.0:1788483409.097765:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 32 00000100:00100000:3.0:1788483409.097774:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aac9511e-8a30-458e-9fb5-28ad23b758b4+7:18728:x1875360087176448:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:3.0:1788483409.097794:0:22788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483409.097813:0:22788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0800/0x1d7ea3d89ea1c56d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e8f1 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483409.098170:0:22788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788483409.098268:0:22788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0800/0x1d7ea3d89ea1c56d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8f1 expref: 9 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.098282:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c1c54e00) 00010000:00010000:3.0:1788483409.098286:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788483409.098291:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0800/0x1d7ea3d89ea1c56d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8f1 expref: 9 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.098304:0:22788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee0800, rc 0) 00000100:00100000:3.0:1788483409.098362:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aac9511e-8a30-458e-9fb5-28ad23b758b4+8:18728:x1875360087176448:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 588us (748us total) trans 12884901891 rc 301/301 00000100:00100000:3.0:1788483409.098380:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 32 00000100:00100000:1.0:1788483409.102563:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483409.102656:0:25830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087176704 00000100:00100000:2.0:1788483409.102665:0:25830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087176704 00000100:00100000:2.0:1788483409.102720:0:25830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 33 00000100:00100000:2.0:1788483409.102731:0:25830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aac9511e-8a30-458e-9fb5-28ad23b758b4+8:18728:x1875360087176704:12345-192.168.206.54@tcp:36:lfs.0 00010000:00010000:2.0:1788483409.102786:0:25830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483409.102812:0:25830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26e00/0x1d7ea3d89ea1c566 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8ea expref: 8 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.102830:0:25830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a68c1c54200) 00010000:00010000:2.0:1788483409.102835:0:25830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788483409.102859:0:25830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1c57b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.102871:0:25830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1c57b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.102881:0:25830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1c57b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788483409.103145:0:25830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000564ce453 reply state 00000000c9fb5c12 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1c57b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.103159:0:25830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1c57b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.103165:0:25830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a68c1c54200) 00010000:00010000:2.0:1788483409.103168:0:25830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1788483409.103171:0:25830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788483409.103179:0:25830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788483409.103241:0:25830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aac9511e-8a30-458e-9fb5-28ad23b758b4+9:18728:x1875360087176704:12345-192.168.206.54@tcp:36:lfs.0 Request processed in 512us (687us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788483409.103248:0:25830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 33 00000100:00100000:1.0:1788483409.119263:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483409.119441:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087176960 00000100:00100000:3.0:1788483409.119456:0:22791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087176960 00000100:00100000:3.0:1788483409.119540:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 2 00000100:00100000:3.0:1788483409.119552:0:22791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aac9511e-8a30-458e-9fb5-28ad23b758b4+9:18728:x1875360087176960:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:3.0:1788483409.119831:0:22791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aac9511e-8a30-458e-9fb5-28ad23b758b4+10:18728:x1875360087176960:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 280us (806us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788483409.119841:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 2 00000100:00100000:0.0:1788483409.130686:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483409.130790:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087177216 00000100:00100000:2.0:1788483409.130800:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087177216 00000100:00100000:2.0:1788483409.130862:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 34 00000100:00100000:2.0:1788483409.130872:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aac9511e-8a30-458e-9fb5-28ad23b758b4+10:18728:x1875360087177216:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:2.0:1788483409.130894:0:22789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483409.130912:0:22789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26e00/0x1d7ea3d89ea1c582 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e8f8 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.130987:0:22789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1c589 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.131000:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1c589 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.131011:0:22789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1c589 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.131040:0:22789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1c590 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.131057:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1c590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.131064:0:22789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1c590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483409.131211:0:22789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788483409.131292:0:22789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1c589 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.131299:0:22789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1c589 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.131305:0:22789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1c589 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.131311:0:22789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483409.131315:0:22789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1c589 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.131321:0:22789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1c589 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.131332:0:22789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c1c54e00) 00010000:00010000:2.0:1788483409.131334:0:22789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483409.131338:0:22789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1c589 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.131355:0:22789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1c589 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.131368:0:22789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1c590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.131375:0:22789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1c590 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.131381:0:22789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1c590 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.131386:0:22789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26600 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483409.131389:0:22789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1c590 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.131395:0:22789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1c590 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.131402:0:22789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a68c1c54000) 00010000:00010000:2.0:1788483409.131404:0:22789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483409.131408:0:22789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1c590 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.131414:0:22789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26600/0x1d7ea3d89ea1c590 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.131450:0:22789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26e00/0x1d7ea3d89ea1c582 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8f8 expref: 12 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.131471:0:22789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c1c54e00) 00010000:00010000:2.0:1788483409.131473:0:22789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788483409.131477:0:22789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26e00/0x1d7ea3d89ea1c582 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8f8 expref: 12 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.131487:0:22789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf26e00, rc 0) 00000100:00100000:2.0:1788483409.131545:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aac9511e-8a30-458e-9fb5-28ad23b758b4+11:18728:x1875360087177216:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 674us (868us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1788483409.131552:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 34 00000100:00100000:1.0:1788483409.142534:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483409.142610:0:25830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087177344 00000100:00100000:2.0:1788483409.142619:0:25830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087177344 00000100:00100000:2.0:1788483409.142674:0:25830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 35 00000100:00100000:2.0:1788483409.142684:0:25830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aac9511e-8a30-458e-9fb5-28ad23b758b4+11:18728:x1875360087177344:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:2.0:1788483409.142706:0:25830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483409.142725:0:25830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26000/0x1d7ea3d89ea1c59e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e8ff expref: -99 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.142824:0:25830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1c5a5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.142837:0:25830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1c5a5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.142847:0:25830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1c5a5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483409.142873:0:25830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788483409.142890:0:25830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788483409.142912:0:25830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1c5a5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.142938:0:25830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26000/0x1d7ea3d89ea1c59e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8ff expref: 13 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.142953:0:25830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1c5a5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8ff expref: 12 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.142961:0:25830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a68c1c54200) 00010000:00010000:2.0:1788483409.142963:0:25830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788483409.142967:0:25830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf26a00, rc 0) 00000100:00100000:2.0:1788483409.143025:0:25830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aac9511e-8a30-458e-9fb5-28ad23b758b4+12:18728:x1875360087177344:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 343us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483409.143032:0:25830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 35 00000040:00080000:1.0:1788483409.144726:0:22826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788483409.145139:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098834176:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788483409.145200:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483409.145953:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483409.146033:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098834176 00000100:00100000:1.0:1788483409.146041:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098834176 00000100:00100000:1.0:1788483409.146121:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788483409.146139:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098834176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788483409.146182:0:22794:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788483409.146236:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875360098834176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483409.146243:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788483409.146483:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3620:1875360098834176:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788483409.146552:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087177472 00000100:00100000:0.0:1788483409.146557:0:22791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087177472 00000100:00100000:0.0:1788483409.146592:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 3 00000100:00100000:0.0:1788483409.146599:0:22791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aac9511e-8a30-458e-9fb5-28ad23b758b4+12:18728:x1875360087177472:12345-192.168.206.54@tcp:37:lfs.0 00000100:00100000:0.0:1788483409.160751:0:22791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aac9511e-8a30-458e-9fb5-28ad23b758b4+12:18728:x1875360087177472:12345-192.168.206.54@tcp:37:lfs.0 Request processed in 14142us (14791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483409.160764:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 3 00000100:00100000:2.0:1788483409.174904:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483409.175143:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087177728 00000100:00100000:0.0:1788483409.175173:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087177728 00000100:00100000:0.0:1788483409.175225:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 4 00000100:00100000:0.0:1788483409.175234:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c69450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aac9511e-8a30-458e-9fb5-28ad23b758b4+12:18728:x1875360087177728:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:0.0:1788483409.175448:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c69450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aac9511e-8a30-458e-9fb5-28ad23b758b4+13:18728:x1875360087177728:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 213us (552us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788483409.175711:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 4 10000000:01000000:2.0:1788483409.208440:0:22785:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788483409.208447:0:22785:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69d18cc000 from 13 10000000:01000000:2.0:1788483409.208452:0:22785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788483409.208509:0:22785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26000/0x1d7ea3d89ea1c5ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.208519:0:22785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26000/0x1d7ea3d89ea1c5ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.208530:0:22785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26000/0x1d7ea3d89ea1c5ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483409.208559:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098834304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788483409.208637:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483409.208684:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d27016c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483409.208971:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098834304 00000100:00100000:0.0:1788483409.208980:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098834304 00000100:00100000:0.0:1788483409.209221:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788483409.209232:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdabb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+20:22785:x1875360098834304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483409.209245:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483409.209257:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69d0400e00/0x1d7ea3d89ea1c5b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1c5ac expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.209280:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69d0400e00/0x1d7ea3d89ea1c5b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c5ac expref: 21 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.209291:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69d0400e00/0x1d7ea3d89ea1c5b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c5ac expref: 21 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.209299:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69d0400e00, rc 0) 00000100:00100000:0.0:1788483409.209348:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdabb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:22785:x1875360098834304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483409.209354:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788483409.209433:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098834304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788483409.209448:0:22785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26000/0x1d7ea3d89ea1c5ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c5b3 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.209457:0:22785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26000/0x1d7ea3d89ea1c5ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1c5b3 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483409.209533:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098834432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788483409.209560:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483409.220230:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d27016c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483409.220985:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098834432 00000100:00100000:1.0:1788483409.220996:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098834432 00000100:00100000:1.0:1788483409.221071:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788483409.221082:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdaba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:22785:x1875360098834432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788483409.221408:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdaba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:22785:x1875360098834432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 327us (11845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483409.221415:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788483409.221521:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098834432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788483409.221564:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098834560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788483409.221612:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483409.221642:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d27016c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483409.221691:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098834560 00000100:00100000:1.0:1788483409.221695:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098834560 00000100:00100000:1.0:1788483409.221712:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788483409.221718:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdabb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:22785:x1875360098834560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788483409.221794:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdabb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:22785:x1875360098834560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483409.221801:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788483409.221985:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098834560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788483409.223534:0:25832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788483409.223697:0:22785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788483409.223720:0:22785:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788483409.223730:0:22785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26000/0x1d7ea3d89ea1c5ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c5b3 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.223741:0:22785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26000/0x1d7ea3d89ea1c5ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c5b3 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483409.223750:0:22785:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788483409.223763:0:22785:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69efe13000 from 13 10000000:01000000:2.0:1788483409.223766:0:22785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788483409.223797:0:22785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26e00/0x1d7ea3d89ea1c5ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.223804:0:22785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26e00/0x1d7ea3d89ea1c5ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.223813:0:22785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26e00/0x1d7ea3d89ea1c5ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483409.223835:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098834688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788483409.223885:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483409.223979:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d27016c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483409.224027:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098834688 00000100:00100000:1.0:1788483409.224034:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098834688 00000100:00100000:1.0:1788483409.224075:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788483409.224083:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+21:22785:x1875360098834688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788483409.224649:0:22783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483409.224668:0:22783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69f5272e00/0x1d7ea3d89ea1c5c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1c5ba expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483409.224702:0:22783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69f5272e00/0x1d7ea3d89ea1c5c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c5ba expref: 22 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483409.224712:0:22783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69f5272e00/0x1d7ea3d89ea1c5c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c5ba expref: 22 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483409.224720:0:22783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69f5272e00, rc 0) 00000100:00100000:1.0:1788483409.224768:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+22:22785:x1875360098834688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 685us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483409.224775:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788483409.224822:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098834688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788483409.224836:0:22785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26e00/0x1d7ea3d89ea1c5ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c5c1 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483409.224844:0:22785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26e00/0x1d7ea3d89ea1c5ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1c5c1 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483409.224901:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098834816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788483409.225578:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483409.225651:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f63d9840 going to sleep for 11 seconds 00000100:00100000:0.0:1788483409.226487:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098834816 00000100:00100000:0.0:1788483409.226497:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098834816 00000100:00100000:0.0:1788483409.226582:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788483409.226591:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdaba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+22:22785:x1875360098834816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483409.227501:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdaba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+22:22785:x1875360098834816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 907us (1920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483409.227512:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788483409.227622:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098834816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788483409.227671:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098834944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788483409.227722:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483409.227759:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d2701000 going to sleep for 11 seconds 00000100:00100000:0.0:1788483409.227796:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098834944 00000100:00100000:0.0:1788483409.227801:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098834944 00000100:00100000:0.0:1788483409.227902:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788483409.227911:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+22:22785:x1875360098834944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788483409.228030:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+22:22785:x1875360098834944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483409.228037:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788483409.228124:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098834944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788483409.229419:0:25833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788483409.229636:0:22785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788483409.229658:0:22785:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788483409.229668:0:22785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26e00/0x1d7ea3d89ea1c5ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c5c1 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483409.229679:0:22785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69ecf26e00/0x1d7ea3d89ea1c5ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c5c1 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483409.229703:0:22785:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788483409.229706:0:22785:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69efd92000 from 13 10000000:01000000:1.0:1788483409.229708:0:22785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788483409.229733:0:22785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69f5273200/0x1d7ea3d89ea1c5c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483409.229740:0:22785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69f5273200/0x1d7ea3d89ea1c5c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483409.229749:0:22785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69f5273200/0x1d7ea3d89ea1c5c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483409.229766:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098835072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788483409.229807:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483409.229842:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f63d9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788483409.229880:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098835072 00000100:00100000:2.0:1788483409.229886:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098835072 00000100:00100000:2.0:1788483409.229911:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788483409.230301:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdabb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+22:22785:x1875360098835072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788483409.230312:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483409.230323:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecf26600/0x1d7ea3d89ea1c5cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1c5c8 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.230353:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecf26600/0x1d7ea3d89ea1c5cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c5c8 expref: 23 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.230362:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecf26600/0x1d7ea3d89ea1c5cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c5c8 expref: 23 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.230370:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecf26600, rc 0) 00000100:00100000:2.0:1788483409.230413:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdabb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+23:22785:x1875360098835072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483409.230419:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788483409.230482:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098835072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788483409.230495:0:22785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69f5273200/0x1d7ea3d89ea1c5c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c5cf expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483409.230504:0:22785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69f5273200/0x1d7ea3d89ea1c5c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1c5cf expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483409.230550:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098835200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788483409.230572:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483409.230595:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f63d9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788483409.230628:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098835200 00000100:00100000:2.0:1788483409.230632:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098835200 00000100:00100000:2.0:1788483409.230647:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788483409.230652:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+23:22785:x1875360098835200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788483409.230741:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+23:22785:x1875360098835200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483409.230748:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788483409.230796:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098835200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788483409.230818:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098835328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788483409.230852:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483409.230869:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f63d9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788483409.230900:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098835328 00000100:00100000:2.0:1788483409.230903:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098835328 00000100:00100000:2.0:1788483409.231080:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788483409.231090:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+23:22785:x1875360098835328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788483409.231331:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+23:22785:x1875360098835328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 243us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483409.231338:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788483409.231468:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098835328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788483409.232643:0:25834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788483409.232809:0:22785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788483409.232828:0:22785:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788483409.232837:0:22785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69f5273200/0x1d7ea3d89ea1c5c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c5cf expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483409.232847:0:22785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69f5273200/0x1d7ea3d89ea1c5c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c5cf expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483409.232857:0:22785:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788483409.232859:0:22785:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a68c4d04800 from 13 10000000:01000000:1.0:1788483409.232862:0:22785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788483409.232891:0:22785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69f5272600/0x1d7ea3d89ea1c5d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483409.232898:0:22785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.154@tcp lock: ffff9a69f5272600/0x1d7ea3d89ea1c5d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483409.232907:0:22785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.154@tcp lock: ffff9a69f5272600/0x1d7ea3d89ea1c5d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483409.236706:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098835456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788483409.236774:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483409.236825:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f63d9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788483409.236892:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098835456 00000100:00100000:3.0:1788483409.236899:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098835456 00000100:00100000:3.0:1788483409.236959:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788483409.236968:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdaba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+23:22785:x1875360098835456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788483409.236982:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483409.236998:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69ecee0800/0x1d7ea3d89ea1c5dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d7ea3d89ea1c5d6 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.237288:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69ecee0800/0x1d7ea3d89ea1c5dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c5d6 expref: 24 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.237300:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69ecee0800/0x1d7ea3d89ea1c5dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d7ea3d89ea1c5d6 expref: 24 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.237309:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee0800, rc 0) 00000100:00100000:3.0:1788483409.237361:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdaba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:22785:x1875360098835456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 393us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483409.237368:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788483409.237484:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098835456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788483409.237499:0:22785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.154@tcp lock: ffff9a69f5272600/0x1d7ea3d89ea1c5d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c5dd expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483409.237516:0:22785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.154@tcp lock: ffff9a69f5272600/0x1d7ea3d89ea1c5d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d7ea3d89ea1c5dd expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483409.237579:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098835584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788483409.237606:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483409.237633:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f63d9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788483409.237677:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098835584 00000100:00100000:0.0:1788483409.237681:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098835584 00000100:00100000:0.0:1788483409.237715:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788483409.237722:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:22785:x1875360098835584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483409.237828:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:22785:x1875360098835584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483409.237834:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788483409.237897:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098835584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788483409.237939:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f73fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098835712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788483409.237976:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483409.237999:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f63d9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788483409.238122:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098835712 00000100:00100000:0.0:1788483409.238126:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098835712 00000100:00100000:0.0:1788483409.238162:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788483409.238169:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fdab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:22785:x1875360098835712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788483409.238242:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fdab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:22785:x1875360098835712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483409.238249:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788483409.238580:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f73fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:22785:1875360098835712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788483409.239615:0:25835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788483409.239900:0:22785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788483409.239996:0:22785:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788483409.240006:0:22785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.154@tcp lock: ffff9a69f5272600/0x1d7ea3d89ea1c5d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c5dd expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.240089:0:22785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.154@tcp lock: ffff9a69f5272600/0x1d7ea3d89ea1c5d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d7ea3d89ea1c5dd expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483409.264683:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483409.264862:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087177856 00000100:00100000:2.0:1788483409.264874:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087177856 00000100:00100000:2.0:1788483409.264970:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 36 00000100:00100000:2.0:1788483409.264982:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+11:18734:x1875360087177856:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:2.0:1788483409.265450:0:22789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483409.265486:0:22789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1c5e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e906 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.265567:0:22789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1c5eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.265584:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1c5eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.265597:0:22789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1c5eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.265609:0:22789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1c5f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.265615:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1c5f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.265621:0:22789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1c5f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.265714:0:22789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1c5f9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.265724:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1c5f9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.265731:0:22789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1c5f9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483409.265787:0:22789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788483409.265791:0:22789:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788483409.265834:0:22789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1c5f9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.265847:0:22789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1c5eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.265853:0:22789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1c5eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.265860:0:22789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1c5eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.265865:0:22789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483409.265869:0:22789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1c5eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.265877:0:22789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1c5eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.265890:0:22789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c1c54e00) 00010000:00010000:2.0:1788483409.265893:0:22789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483409.265898:0:22789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1c5eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.265904:0:22789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27a00/0x1d7ea3d89ea1c5eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.265919:0:22789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1c5f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.266953:0:22789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1c5f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.266961:0:22789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1c5f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.266967:0:22789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf26c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483409.266972:0:22789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1c5f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.266980:0:22789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1c5f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.267256:0:22789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a68c1c54000) 00010000:00010000:2.0:1788483409.267261:0:22789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483409.267266:0:22789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1c5f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.267274:0:22789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26c00/0x1d7ea3d89ea1c5f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.267329:0:22789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27800/0x1d7ea3d89ea1c5e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e906 expref: 13 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.267347:0:22789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77200/0x1d7ea3d89ea1c5f9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e906 expref: 12 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.267355:0:22789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a68c1c54200) 00010000:00010000:2.0:1788483409.267357:0:22789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788483409.267375:0:22789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f77200, rc 0) 00000100:00100000:2.0:1788483409.267472:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+12:18734:x1875360087177856:12345-192.168.206.54@tcp:101:bash.0 Request processed in 2490us (2803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483409.267482:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 36 00000100:00100000:0.0:1788483409.278412:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483409.278522:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087177984 00000100:00100000:1.0:1788483409.278532:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087177984 00000100:00100000:1.0:1788483409.278592:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 7 00000100:00100000:1.0:1788483409.278602:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+5:18734:x1875360087177984:12345-192.168.206.54@tcp:900:bash.0 00000100:00100000:1.0:1788483409.278687:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+5:18734:x1875360087177984:12345-192.168.206.54@tcp:900:bash.0 Request processed in 87us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483409.278696:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 7 00000100:00100000:1.0:1788483409.280414:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483409.280563:0:25830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087178240 00000100:00100000:2.0:1788483409.280581:0:25830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087178240 00000100:00100000:2.0:1788483409.280666:0:25830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 37 00000100:00100000:2.0:1788483409.280678:0:25830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+12:18734:x1875360087178240:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:2.0:1788483409.280702:0:25830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483409.280728:0:25830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76400/0x1d7ea3d89ea1c600 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e90d expref: -99 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.280866:0:25830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77400/0x1d7ea3d89ea1c607 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.280885:0:25830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1c5a5 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8ff expref: 12 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.280895:0:25830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77400/0x1d7ea3d89ea1c607 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.280954:0:25830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1c5a5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8ff expref: 12 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.280970:0:25830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1c5a5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8ff expref: 12 pid: 25830 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483409.280987:0:25830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25830:1875360098835840:192.168.206.54@tcp:104: 00000100:00100000:2.0:1788483409.281333:0:25830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69d2701b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788483409.290280:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483409.290414:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087178368 00000100:00100000:0.0:1788483409.290438:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087178368 00010000:00010000:0.0:1788483409.290480:0:22774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1c5a5 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8ff expref: 13 pid: 25830 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483409.290521:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 16 00000100:00100000:0.0:1788483409.290531:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aac9511e-8a30-458e-9fb5-28ad23b758b4+13:2392:x1875360087178368:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483409.290546:0:22774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483409.290554:0:22774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1c5a5 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8ff expref: 13 pid: 25830 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.290567:0:22774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1c5a5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8ff expref: 13 pid: 25830 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.290586:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a68c1c54200) 00010000:00010000:0.0:1788483409.290592:0:22774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77400/0x1d7ea3d89ea1c607 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.290601:0:22774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77400/0x1d7ea3d89ea1c607 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.290609:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77400/0x1d7ea3d89ea1c607 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.290627:0:22774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483409.290685:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aac9511e-8a30-458e-9fb5-28ad23b758b4+13:2392:x1875360087178368:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 155us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483409.290693:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 16 00010000:00010000:2.0:1788483409.293244:0:25830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf26a00/0x1d7ea3d89ea1c5a5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e8ff expref: 12 pid: 25830 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483409.293271:0:25830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25830:1875360098835840:192.168.206.54@tcp:104: 00010000:00010000:2.0:1788483409.293293:0:25830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77400/0x1d7ea3d89ea1c607 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.293303:0:25830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77400/0x1d7ea3d89ea1c607 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.293309:0:25830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77400/0x1d7ea3d89ea1c607 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.293370:0:25830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76a00/0x1d7ea3d89ea1c60e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.293381:0:25830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76a00/0x1d7ea3d89ea1c60e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.293391:0:25830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76a00/0x1d7ea3d89ea1c60e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.293838:0:25830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76600/0x1d7ea3d89ea1c615 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.293847:0:25830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76600/0x1d7ea3d89ea1c615 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.293854:0:25830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76600/0x1d7ea3d89ea1c615 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483409.293880:0:25830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788483409.293909:0:25830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77400/0x1d7ea3d89ea1c607 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.293916:0:25830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77400/0x1d7ea3d89ea1c607 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.293923:0:25830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77400/0x1d7ea3d89ea1c607 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.293929:0:25830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483409.293934:0:25830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77400/0x1d7ea3d89ea1c607 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.293942:0:25830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77400/0x1d7ea3d89ea1c607 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.293954:0:25830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a68c1c54200) 00010000:00010000:2.0:1788483409.293957:0:25830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483409.293960:0:25830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77400/0x1d7ea3d89ea1c607 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.293966:0:25830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77400/0x1d7ea3d89ea1c607 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788483409.293976:0:25830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006bc0d3af reply state 0000000029d1930b transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76a00/0x1d7ea3d89ea1c60e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.293984:0:25830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76a00/0x1d7ea3d89ea1c60e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.294000:0:25830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9a69ecd6cc00) 00010000:00010000:2.0:1788483409.294002:0:25830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788483409.294006:0:25830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788483409.295332:0:25830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76400/0x1d7ea3d89ea1c600 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e90d expref: 15 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.295353:0:25830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76600/0x1d7ea3d89ea1c615 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e90d expref: 14 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.295361:0:25830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a69ecd6c300) 00010000:00010000:2.0:1788483409.295364:0:25830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788483409.295367:0:25830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76600, rc 0) 00000100:00100000:2.0:1788483409.295420:0:25830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+15:18734:x1875360087178240:12345-192.168.206.54@tcp:101:bash.0 Request processed in 14745us (15013us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788483409.295428:0:25830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 37 00000100:00100000:1.0:1788483409.307578:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483409.311297:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087178496 00000100:00100000:3.0:1788483409.311314:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087178496 00000100:00100000:3.0:1788483409.311391:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 38 00000100:00100000:3.0:1788483409.311401:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+15:18734:x1875360087178496:12345-192.168.206.54@tcp:101:bash.0 00010000:00010000:3.0:1788483409.311423:0:22788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483409.311441:0:22788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c623 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e914 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.311508:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0400/0x1d7ea3d89ea1c62a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.311522:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0400/0x1d7ea3d89ea1c62a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.311532:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0400/0x1d7ea3d89ea1c62a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483409.311578:0:22788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788483409.311593:0:22788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788483409.311615:0:22788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0400/0x1d7ea3d89ea1c62a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.311626:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0400/0x1d7ea3d89ea1c62a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.311650:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c623 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e914 expref: 17 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.311668:0:22788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0400/0x1d7ea3d89ea1c62a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e914 expref: 16 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.311676:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a69ecd6c300) 00010000:00010000:3.0:1788483409.311679:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788483409.311682:0:22788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee0400, rc 0) 00000100:00100000:3.0:1788483409.311738:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+16:18734:x1875360087178496:12345-192.168.206.54@tcp:101:bash.0 Request processed in 339us (4170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483409.311745:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 38 00000100:00100000:0.0:1788483409.314586:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483409.314682:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087178752 00000100:00100000:2.0:1788483409.314693:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087178752 00000100:00100000:2.0:1788483409.314748:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 5 00000100:00100000:2.0:1788483409.314758:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+16:18734:x1875360087178752:12345-192.168.206.54@tcp:35:bash.0 00000100:00100000:2.0:1788483409.315176:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+17:18734:x1875360087178752:12345-192.168.206.54@tcp:35:bash.0 Request processed in 418us (598us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1788483409.315184:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 5 00000100:00100000:0.0:1788483409.423355:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483409.423459:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087179008 00000100:00100000:3.0:1788483409.423469:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087179008 00000100:00100000:3.0:1788483409.423527:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 39 00000100:00100000:3.0:1788483409.423537:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+17:18744:x1875360087179008:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:3.0:1788483409.423561:0:22790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483409.423580:0:22790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c631 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e91b expref: -99 pid: 22790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483409.423682:0:22790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788483409.423797:0:22790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c631 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e91b expref: 19 pid: 22790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.423817:0:22790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68c1c54e00) 00010000:00010000:3.0:1788483409.423820:0:22790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788483409.423824:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c631 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e91b expref: 19 pid: 22790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.423838:0:22790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee0200, rc 0) 00000100:00100000:3.0:1788483409.423897:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+18:18744:x1875360087179008:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 361us (552us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1788483409.423904:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 39 00000100:00100000:2.0:1788483409.429091:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483409.429319:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087179264 00000100:00100000:3.0:1788483409.429329:0:22791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087179264 00000100:00100000:3.0:1788483409.429376:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 6 00000100:00100000:3.0:1788483409.429386:0:22791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+18:18744:x1875360087179264:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:3.0:1788483409.429590:0:22791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+19:18744:x1875360087179264:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 205us (507us total) trans 12884901899 rc 0/0 00000100:00100000:3.0:1788483409.429598:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 6 00000100:00100000:0.0:1788483409.469599:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483409.469634:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087179520 00000100:00100000:0.0:1788483409.469643:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087179520 00000100:00100000:0.0:1788483409.469700:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 40 00000100:00100000:0.0:1788483409.469709:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+19:18747:x1875360087179520:12345-192.168.206.54@tcp:101:lfs.0 00010000:00010000:0.0:1788483409.469731:0:22788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483409.469765:0:22788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401a00/0x1d7ea3d89ea1c63f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e922 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.469871:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401e00/0x1d7ea3d89ea1c646 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.469885:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401e00/0x1d7ea3d89ea1c646 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.469896:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401e00/0x1d7ea3d89ea1c646 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483409.469908:0:22788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788483409.470011:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401a00/0x1d7ea3d89ea1c63f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e922 expref: 22 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.470028:0:22788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401e00/0x1d7ea3d89ea1c646 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e922 expref: 21 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.470037:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a69ecd6c300) 00010000:00010000:0.0:1788483409.470039:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788483409.470055:0:22788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69d0401e00, rc 0) 00000100:00100000:0.0:1788483409.470147:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+21:18747:x1875360087179520:12345-192.168.206.54@tcp:101:lfs.0 Request processed in 438us (556us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1788483409.470169:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 40 00000100:00100000:0.0:1788483409.474562:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483409.474605:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483409.474759:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087179776 00000100:00100000:3.0:1788483409.474769:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087179776 00000100:00100000:1.0:1788483409.474774:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087179648 00000100:00100000:1.0:1788483409.474777:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087179648 00000100:00100000:3.0:1788483409.474831:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 41 00000100:00100000:1.0:1788483409.474835:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 0 00000100:00100000:3.0:1788483409.474840:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+22:18747:x1875360087179776:12345-192.168.206.54@tcp:54:lfs.0 00000100:00100000:1.0:1788483409.474841:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+22:2393:x1875360087179648:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483409.474856:0:22775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483409.474879:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401e00/0x1d7ea3d89ea1c646 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e922 expref: 22 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.474895:0:22790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c654 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483409.474896:0:22775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a69ecd6c300) 00010000:00010000:1.0:1788483409.474900:0:22775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788483409.474908:0:22790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c654 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.474927:0:22790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c654 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483409.474955:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+21:2393:x1875360087179648:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 113us (401us total) trans 0 rc 0/0 00010000:00010000:3.0:1788483409.474959:0:22790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c654 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483409.474961:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 0 00010000:00010000:3.0:1788483409.474965:0:22790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c654 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.474971:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c654 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.474976:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483409.474981:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c654 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.474988:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c654 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.475002:0:22790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a69ecd6c300) 00010000:00010000:3.0:1788483409.475004:0:22790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788483409.475008:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c654 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.475014:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c654 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483409.475055:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+20:18747:x1875360087179776:12345-192.168.206.54@tcp:54:lfs.0 Request processed in 217us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483409.475062:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 41 00000100:00100000:1.0:1788483409.478874:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483409.479289:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087180032 00000100:00100000:3.0:1788483409.479299:0:22791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087180032 00000100:00100000:3.0:1788483409.479359:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 7 00000100:00100000:3.0:1788483409.479370:0:22791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+20:18747:x1875360087180032:12345-192.168.206.54@tcp:35:lfs.0 00000100:00100000:3.0:1788483409.479587:0:22791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+21:18747:x1875360087180032:12345-192.168.206.54@tcp:35:lfs.0 Request processed in 219us (723us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1788483409.479595:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 7 00000100:00100000:1.0:1788483409.656343:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e03e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098835968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788483409.656415:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483409.656522:0:24302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098835968 00000100:00100000:0.0:1788483409.656530:0:24302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098835968 00000100:00100000:0.0:1788483409.656609:0:24302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788483409.656618:0:24302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098835968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788483409.656639:0:24302:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788483409.656681:0:24302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098835968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483409.656688:0:24302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788483409.656742:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788483409.656775:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e03e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098835968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788483409.754886:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483409.755048:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087180288 00000100:00100000:3.0:1788483409.755063:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087180288 00000100:00100000:3.0:1788483409.755336:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 42 00000100:00100000:3.0:1788483409.755349:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+21:18778:x1875360087180288:12345-192.168.206.54@tcp:101:cat.0 00010000:00010000:3.0:1788483409.755382:0:22788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483409.755409:0:22788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c65b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e929 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.755541:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0c00/0x1d7ea3d89ea1c662 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.755559:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0c00/0x1d7ea3d89ea1c662 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.755575:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0c00/0x1d7ea3d89ea1c662 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483409.755587:0:22788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788483409.755766:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c65b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e929 expref: 24 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.755791:0:22788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0c00/0x1d7ea3d89ea1c662 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e929 expref: 23 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.755820:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a69ecd6c300) 00010000:00010000:3.0:1788483409.755823:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788483409.755828:0:22788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee0c00, rc 0) 00000100:00100000:3.0:1788483409.755913:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+23:18778:x1875360087180288:12345-192.168.206.54@tcp:101:cat.0 Request processed in 566us (1042us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1788483409.755921:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 42 00000100:00100000:0.0:1788483409.764539:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483409.765550:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087180544 00000100:00100000:2.0:1788483409.765568:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087180544 00000100:00100000:2.0:1788483409.765647:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 8 00000100:00100000:2.0:1788483409.765681:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+23:18778:x1875360087180544:12345-192.168.206.54@tcp:35:cat.0 00000100:00100000:2.0:1788483409.766183:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+24:18778:x1875360087180544:12345-192.168.206.54@tcp:35:cat.0 Request processed in 502us (1657us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1788483409.766192:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 8 00000100:00100000:0.0:1788483409.766817:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483409.767118:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087180672 00000100:00100000:2.0:1788483409.767449:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087180672 00000100:00100000:2.0:1788483409.767524:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 1 00000100:00100000:2.0:1788483409.767535:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+24:2392:x1875360087180672:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483409.767551:0:22774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483409.767585:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0c00/0x1d7ea3d89ea1c662 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e929 expref: 24 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.767608:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a69ecd6c300) 00010000:00010000:2.0:1788483409.767614:0:22774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483409.767674:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+23:2392:x1875360087180672:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 140us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483409.767682:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 1 00010000:00010000:2.0:1788483409.784407:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788483409.785704:0:23542:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788483409.856024:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483409.857599:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087180928 00000100:00100000:3.0:1788483409.857621:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087180928 00000100:00100000:3.0:1788483409.857717:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 43 00000100:00100000:3.0:1788483409.857729:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+23:18784:x1875360087180928:12345-192.168.206.54@tcp:101:dd.0 00010000:00010000:3.0:1788483409.857761:0:22790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483409.857788:0:22790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c670 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e930 expref: -99 pid: 22790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.857916:0:22790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0c00/0x1d7ea3d89ea1c677 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.857933:0:22790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76600/0x1d7ea3d89ea1c615 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e90d expref: 24 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.857942:0:22790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0400/0x1d7ea3d89ea1c62a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e914 expref: 24 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.857951:0:22790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0c00/0x1d7ea3d89ea1c677 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.858017:0:22790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0400/0x1d7ea3d89ea1c62a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e914 expref: 24 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.858033:0:22790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0400/0x1d7ea3d89ea1c62a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e914 expref: 24 pid: 22788 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483409.858060:0:22790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22790:1875360098836096:192.168.206.54@tcp:104: 00010000:00010000:2.0:1788483409.858773:0:22790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76600/0x1d7ea3d89ea1c615 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e90d expref: 24 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.858791:0:22790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76600/0x1d7ea3d89ea1c615 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e90d expref: 24 pid: 25830 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483409.858805:0:22790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22790:1875360098836224:192.168.206.54@tcp:104: 00000100:00100000:2.0:1788483409.858854:0:22790:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c2623e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788483409.864334:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483409.864398:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483409.864471:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087181056 00000100:00100000:0.0:1788483409.864487:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087181056 00000100:00100000:3.0:1788483409.864498:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087181184 00000100:00100000:3.0:1788483409.864509:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087181184 00010000:00010000:0.0:1788483409.864542:0:22773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0400/0x1d7ea3d89ea1c62a lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e914 expref: 26 pid: 22788 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.864557:0:22775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76600/0x1d7ea3d89ea1c615 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e90d expref: 26 pid: 25830 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483409.864657:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 17 00000100:00100000:0.0:1788483409.864670:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6231f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+26:2393:x1875360087181056:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483409.864685:0:22773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483409.864694:0:22773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0400/0x1d7ea3d89ea1c62a lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e914 expref: 26 pid: 22788 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.864707:0:22773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0400/0x1d7ea3d89ea1c62a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e914 expref: 26 pid: 22788 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.864742:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a69ecd6c300) 00010000:00010000:0.0:1788483409.864747:0:22773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0c00/0x1d7ea3d89ea1c677 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.864755:0:22773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0c00/0x1d7ea3d89ea1c677 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.864761:0:22773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483409.864834:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6231f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+26:2393:x1875360087181056:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 166us (514us total) trans 0 rc 0/0 00010000:00010000:2.0:1788483409.864841:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0400/0x1d7ea3d89ea1c62a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e914 expref: 26 pid: 22788 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483409.864852:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 17 00000100:00100000:2.0:1788483409.864882:0:22790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22790:1875360098836096:192.168.206.54@tcp:104: 00000100:00100000:0.0:1788483409.864891:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 18 00000100:00100000:0.0:1788483409.864908:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e000b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+24:2393:x1875360087181184:12345-192.168.206.54@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788483409.864917:0:22790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22790:1875360098836224:192.168.206.54@tcp:104: 00010000:00010000:0.0:1788483409.864918:0:22773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483409.864933:0:22773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76600/0x1d7ea3d89ea1c615 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e90d expref: 24 pid: 25830 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.864953:0:22773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76600/0x1d7ea3d89ea1c615 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e90d expref: 24 pid: 25830 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.864967:0:22790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0c00/0x1d7ea3d89ea1c677 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.864973:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76600/0x1d7ea3d89ea1c615 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e90d expref: 24 pid: 25830 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.864999:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a69ecd6c300) 00010000:00010000:0.0:1788483409.865004:0:22773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0c00/0x1d7ea3d89ea1c677 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.865021:0:22773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0c00/0x1d7ea3d89ea1c677 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.865028:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0c00/0x1d7ea3d89ea1c677 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.865064:0:22773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483409.865092:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e000b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+23:2393:x1875360087181184:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 185us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483409.865161:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 18 00010000:00010000:3.0:1788483409.865191:0:22790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0c00/0x1d7ea3d89ea1c677 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.865201:0:22790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0c00/0x1d7ea3d89ea1c677 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483409.865222:0:22790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788483409.865419:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c670 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e930 expref: 24 pid: 22790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.865439:0:22790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0c00/0x1d7ea3d89ea1c677 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e930 expref: 23 pid: 22790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.865448:0:22790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a69ecd6c300) 00010000:00010000:3.0:1788483409.865451:0:22790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788483409.865468:0:22790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69ecee0c00, rc 0) 00000100:00100000:0.0:1788483409.865768:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+23:18784:x1875360087180928:12345-192.168.206.54@tcp:101:dd.0 Request processed in 8038us (9749us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1788483409.865777:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 43 00000100:00100000:1.0:1788483409.874523:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483409.877805:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087181312 00000100:00100000:2.0:1788483409.877829:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087181312 00000100:00100000:2.0:1788483409.877910:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 44 00000100:00100000:2.0:1788483409.877920:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+23:18784:x1875360087181312:12345-192.168.206.54@tcp:101:dd.0 00010000:00010000:2.0:1788483409.877943:0:22789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483409.877964:0:22789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77400/0x1d7ea3d89ea1c685 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e937 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.878002:0:22789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77a00/0x1d7ea3d89ea1c68c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.878016:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77a00/0x1d7ea3d89ea1c68c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.878026:0:22789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77a00/0x1d7ea3d89ea1c68c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.878186:0:22789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77400/0x1d7ea3d89ea1c685 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e937 expref: 25 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.878204:0:22789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77a00/0x1d7ea3d89ea1c68c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e937 expref: 24 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.878220:0:22789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a69ecd6c300) 00010000:00010000:2.0:1788483409.878223:0:22789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788483409.878226:0:22789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f77a00, rc 0) 00000100:00100000:2.0:1788483409.878281:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+24:18784:x1875360087181312:12345-192.168.206.54@tcp:101:dd.0 Request processed in 362us (3767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483409.878299:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 44 00000100:00100000:2.0:1788483409.884555:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483409.884935:0:25830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087181568 00000100:00100000:3.0:1788483409.884945:0:25830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087181568 00000100:00100000:3.0:1788483409.885002:0:25830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 45 00000100:00100000:3.0:1788483409.885012:0:25830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+24:18784:x1875360087181568:12345-192.168.206.54@tcp:36:dd.0 00010000:00010000:3.0:1788483409.885282:0:25830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c693 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.885315:0:25830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c693 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.885328:0:25830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c693 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788483409.885375:0:25830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1788483409.885399:0:25830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2aca98f reply state 00000000e97bdaf6 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c693 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.885412:0:25830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c693 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483409.885419:0:25830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a69ecd6c300) 00010000:00010000:3.0:1788483409.885422:0:25830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788483409.885425:0:25830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788483409.885749:0:25830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+27:18784:x1875360087181568:12345-192.168.206.54@tcp:36:dd.0 Request processed in 737us (1200us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1788483409.885758:0:25830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 45 00000020:00080000:3.0:1788483409.885763:0:25830:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788483409.897464:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483409.897781:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087181696 00000100:00100000:2.0:1788483409.897790:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087181696 00000100:00100000:2.0:1788483409.897858:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 46 00000100:00100000:2.0:1788483409.897868:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+27:18784:x1875360087181696:12345-192.168.206.54@tcp:101:dd.0 00010000:00010000:2.0:1788483409.897892:0:22789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483409.897913:0:22789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77400/0x1d7ea3d89ea1c69a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e93e expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.897969:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77400/0x1d7ea3d89ea1c69a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e93e expref: 28 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.897984:0:22789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77400/0x1d7ea3d89ea1c69a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e93e expref: 28 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.898002:0:22789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a69ecd6c300) 00010000:00010000:2.0:1788483409.898006:0:22789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788483409.898020:0:22789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f77400, rc 0) 00000100:00100000:2.0:1788483409.898091:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+28:18784:x1875360087181696:12345-192.168.206.54@tcp:101:dd.0 Request processed in 224us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483409.898134:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 46 00000100:00100000:1.0:1788483409.925150:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483409.929556:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087181952 00000100:00100000:0.0:1788483409.929571:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087181952 00000100:00100000:0.0:1788483409.929652:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 2 00000100:00100000:0.0:1788483409.929664:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6233480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+28:18784:x1875360087181952:12345-192.168.206.54@tcp:103:dd.0 00010000:00010000:0.0:1788483409.929679:0:22773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483409.929703:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77400/0x1d7ea3d89ea1c69a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e93e expref: 28 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.929726:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a69ecd6c300) 00010000:00010000:0.0:1788483409.929732:0:22773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483409.929809:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6233480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+27:18784:x1875360087181952:12345-192.168.206.54@tcp:103:dd.0 Request processed in 148us (4668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483409.929964:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 2 00000100:00100000:0.0:1788483409.936526:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483409.936685:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087182080 00000100:00100000:2.0:1788483409.936695:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087182080 00000100:00100000:2.0:1788483409.936764:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 47 00000100:00100000:2.0:1788483409.936774:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+27:18784:x1875360087182080:12345-192.168.206.54@tcp:58:dd.0 00010000:00010000:2.0:1788483409.936900:0:22790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77e00/0x1d7ea3d89ea1c6a1 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.936919:0:22790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77e00/0x1d7ea3d89ea1c6a1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483409.936931:0:22790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77e00/0x1d7ea3d89ea1c6a1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788483409.940567:0:22790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788483409.940599:0:22790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1788483409.942027:0:22790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1788483409.942251:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+27:18784:x1875360087182080:12345-192.168.206.54@tcp:58:dd.0 Request processed in 5473us (5731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483409.942261:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 47 00000100:00100000:2.0:1788483409.946833:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483409.948966:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087182208 00000100:00100000:0.0:1788483409.948981:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087182208 00000100:00100000:0.0:1788483409.949123:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 48 00000100:00100000:0.0:1788483409.949134:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+27:18784:x1875360087182208:12345-192.168.206.54@tcp:101:dd.0 00010000:00010000:0.0:1788483409.949152:0:22789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483409.949184:0:22789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1c6a8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e945 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.949238:0:22789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77e00/0x1d7ea3d89ea1c6a1 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.949249:0:22789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1c6a8 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e945 expref: 28 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.949266:0:22789:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77e00/0x1d7ea3d89ea1c6a1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.949278:0:22789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1c6a8 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e945 expref: 28 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.949303:0:22789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a69ecd6c300) 00010000:00010000:0.0:1788483409.949306:0:22789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788483409.949310:0:22789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1c6a8 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e945 expref: 28 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483409.949318:0:22789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69d0400800, rc 0) 00000100:00100000:0.0:1788483409.949378:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+28:18784:x1875360087182208:12345-192.168.206.54@tcp:101:dd.0 Request processed in 246us (2564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483409.949400:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 48 00000040:00080000:1.0:1788483410.168377:0:22826:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788483410.168386:0:22826:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788483410.168427:0:22826:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788483410.168436:0:22826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788483410.168575:0:22826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6231500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22826:1875360098836352:192.168.206.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788483410.168678:0:22826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f63d9300 going to sleep for 11 seconds 00000100:00100000:1.0:1788483410.171889:0:22826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6231500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22826:1875360098836352:192.168.206.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788483410.174784:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483410.174916:0:25830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087182336 00000100:00100000:3.0:1788483410.174925:0:25830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087182336 00000100:00100000:3.0:1788483410.175051:0:25830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 49 00000100:00100000:3.0:1788483410.175074:0:25830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+28:18785:x1875360087182336:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788483410.175149:0:25830:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788483410.175261:0:25830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+28:18785:x1875360087182336:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 Request processed in 188us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483410.175268:0:25830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 49 00000100:00080000:1.0:1788483410.175492:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788483410.185476:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483410.185550:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087182464 00000100:00100000:3.0:1788483410.185560:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087182464 00000100:00100000:3.0:1788483410.185614:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 50 00000100:00100000:3.0:1788483410.185625:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+28:18785:x1875360087182464:12345-192.168.206.54@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788483410.185703:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0400/0x1d7ea3d89ea1c6af lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.185720:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0400/0x1d7ea3d89ea1c6af lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.185745:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0400/0x1d7ea3d89ea1c6af lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.185806:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1c6b6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.185814:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1c6b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.185821:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1c6b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.185850:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7e00/0x1d7ea3d89ea1c6bd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.185885:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7e00/0x1d7ea3d89ea1c6bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.185892:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7e00/0x1d7ea3d89ea1c6bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483410.185951:0:22788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788483410.185956:0:22788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788483410.185973:0:22788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7e00/0x1d7ea3d89ea1c6bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.185986:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0400/0x1d7ea3d89ea1c6af lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.185992:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0400/0x1d7ea3d89ea1c6af lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.186000:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0400/0x1d7ea3d89ea1c6af lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.186007:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0400 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483410.186022:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0400/0x1d7ea3d89ea1c6af lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.186029:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0400/0x1d7ea3d89ea1c6af lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.186341:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a69f63cb000) 00010000:00010000:3.0:1788483410.186345:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483410.186350:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0400/0x1d7ea3d89ea1c6af lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.186367:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0400/0x1d7ea3d89ea1c6af lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.186386:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1c6b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.186391:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1c6b6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.186397:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1c6b6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.186402:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483410.186405:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1c6b6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.186410:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1c6b6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.186417:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9a68c1c54100) 00010000:00010000:3.0:1788483410.186419:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483410.186422:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1c6b6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.186426:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6a00/0x1d7ea3d89ea1c6b6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.186441:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7e00/0x1d7ea3d89ea1c6bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.186447:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7e00/0x1d7ea3d89ea1c6bd lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.186459:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7e00/0x1d7ea3d89ea1c6bd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.186464:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c7e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:3.0:1788483410.186468:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7e00/0x1d7ea3d89ea1c6bd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.186474:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7e00/0x1d7ea3d89ea1c6bd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.186482:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a69ecd6c300) 00010000:00010000:3.0:1788483410.186484:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483410.186487:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7e00/0x1d7ea3d89ea1c6bd lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.186492:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7e00/0x1d7ea3d89ea1c6bd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483410.186590:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+28:18785:x1875360087182464:12345-192.168.206.54@tcp:34:lhsmtool_posix.0 Request processed in 965us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483410.186598:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 50 00000100:00100000:3.0:1788483410.198438:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483410.200156:0:25830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087182720 00000100:00100000:2.0:1788483410.200177:0:25830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087182720 00000100:00100000:2.0:1788483410.200250:0:25830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 51 00000100:00100000:2.0:1788483410.200261:0:25830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+28:18785:x1875360087182720:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788483410.200280:0:25830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483410.200313:0:25830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76200/0x1d7ea3d89ea1c6c4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e94c expref: -99 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.200430:0:25830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77000/0x1d7ea3d89ea1c6cb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.200445:0:25830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77000/0x1d7ea3d89ea1c6cb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.200455:0:25830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77000/0x1d7ea3d89ea1c6cb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483410.200466:0:25830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788483410.200543:0:25830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77000/0x1d7ea3d89ea1c6cb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.200551:0:25830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77000/0x1d7ea3d89ea1c6cb lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.200557:0:25830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77000/0x1d7ea3d89ea1c6cb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.200563:0:25830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:2.0:1788483410.200567:0:25830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77000/0x1d7ea3d89ea1c6cb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.200574:0:25830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77000/0x1d7ea3d89ea1c6cb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.200586:0:25830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a69ecd6c300) 00010000:00010000:2.0:1788483410.200589:0:25830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788483410.200594:0:25830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77000/0x1d7ea3d89ea1c6cb lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.200610:0:25830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77000/0x1d7ea3d89ea1c6cb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.200656:0:25830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76200/0x1d7ea3d89ea1c6c4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e94c expref: 30 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.200666:0:25830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a69f63cb000) 00010000:00010000:2.0:1788483410.200668:0:25830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788483410.200672:0:25830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76200/0x1d7ea3d89ea1c6c4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e94c expref: 30 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.200680:0:25830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76200, rc 0) 00000100:00100000:2.0:1788483410.200748:0:25830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+29:18785:x1875360087182720:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 489us (2319us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1788483410.200756:0:25830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 51 00000100:00100000:2.0:1788483410.212679:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483410.212769:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087182848 00000100:00100000:0.0:1788483410.212778:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087182848 00000100:00100000:0.0:1788483410.212832:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 52 00000100:00100000:0.0:1788483410.212842:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+29:18785:x1875360087182848:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788483410.212876:0:22789:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788483410.213004:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+29:18785:x1875360087182848:12345-192.168.206.54@tcp:53:lhsmtool_posix.0 Request processed in 162us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483410.213021:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 52 00000100:00100000:3.0:1788483410.224294:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483410.224436:0:25830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087183104 00000100:00100000:2.0:1788483410.224445:0:25830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087183104 00000100:00100000:2.0:1788483410.224504:0:25830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 53 00000100:00100000:2.0:1788483410.224514:0:25830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+29:18785:x1875360087183104:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788483410.224533:0:25830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483410.224553:0:25830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76200/0x1d7ea3d89ea1c6d9 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e953 expref: -99 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788483410.224926:0:25830:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =60 00000004:00080000:2.0:1788483410.224933:0:25830:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+60 in llog 00000004:00080000:2.0:1788483410.224963:0:25830:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:2.0:1788483410.225142:0:25830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77000/0x1d7ea3d89ea1c6e0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.225155:0:25830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77000/0x1d7ea3d89ea1c6e0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.225166:0:25830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77000/0x1d7ea3d89ea1c6e0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.225229:0:25830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76200/0x1d7ea3d89ea1c6d9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e953 expref: 32 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.225245:0:25830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77000/0x1d7ea3d89ea1c6e0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e953 expref: 31 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.225254:0:25830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a69ecd6c100) 00010000:00010000:2.0:1788483410.225256:0:25830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483410.225259:0:25830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f77000, rc 0) 00000100:00100000:2.0:1788483410.225328:0:25830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+31:18785:x1875360087183104:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 811us (1038us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1788483410.225336:0:25830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 53 00000100:00100000:1.0:1788483410.229854:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483410.229944:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087183360 00000100:00100000:0.0:1788483410.229953:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087183360 00000100:00100000:0.0:1788483410.230009:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 54 00000100:00100000:0.0:1788483410.230028:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6231500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+31:18785:x1875360087183360:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788483410.230133:0:22789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483410.230167:0:22789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77000/0x1d7ea3d89ea1c6e0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e953 expref: 31 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.230187:0:22789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a69ecd6c100) 00010000:00010000:0.0:1788483410.230197:0:22789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788483410.230222:0:22789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1c6ee lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.230235:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1c6ee lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.230244:0:22789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1c6ee lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.230350:0:22789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1c6f5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa7d55838 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.230360:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1c6f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa7d55838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.230367:0:22789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1c6f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa7d55838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.230409:0:22789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1c6ee lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.230417:0:22789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1c6ee lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.230424:0:22789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1c6ee lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.230431:0:22789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483410.230435:0:22789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1c6ee lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.230444:0:22789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1c6ee lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.230452:0:22789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a68c1c54200) 00010000:00010000:0.0:1788483410.230455:0:22789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483410.230458:0:22789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1c6ee lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.230464:0:22789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401800/0x1d7ea3d89ea1c6ee lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.230480:0:22789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1c6f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa7d55838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.230486:0:22789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1c6f5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa7d55838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.230492:0:22789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1c6f5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa7d55838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.230498:0:22789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483410.230501:0:22789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1c6f5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa7d55838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.230507:0:22789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1c6f5 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa7d55838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.230514:0:22789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xa7d55838 (ffff9a68c3603e00) 00010000:00010000:0.0:1788483410.230516:0:22789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483410.230519:0:22789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1c6f5 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa7d55838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.230523:0:22789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1c6f5 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa7d55838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483410.230599:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6231500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+30:18785:x1875360087183360:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 Request processed in 571us (752us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788483410.230607:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 54 00000100:00100000:3.0:1788483410.247127:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483410.247233:0:25830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087183488 00000100:00100000:2.0:1788483410.247243:0:25830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087183488 00000100:00100000:2.0:1788483410.247301:0:25830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 55 00000100:00100000:2.0:1788483410.247314:0:25830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+30:18785:x1875360087183488:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788483410.247332:0:25830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483410.247353:0:25830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76200/0x1d7ea3d89ea1c6fc lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e95a expref: -99 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.247411:0:25830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1c703 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.247422:0:25830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1c703 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.247432:0:25830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1c703 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.247538:0:25830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76200/0x1d7ea3d89ea1c6fc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e95a expref: 32 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.247556:0:25830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77600/0x1d7ea3d89ea1c703 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e95a expref: 31 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.247563:0:25830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a69ecd6c400) 00010000:00010000:2.0:1788483410.247566:0:25830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788483410.247569:0:25830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f77600, rc 0) 00000100:00100000:2.0:1788483410.247630:0:25830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+31:18785:x1875360087183488:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 320us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483410.247637:0:25830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 55 00000100:00100000:2.0:1788483410.256837:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483410.256933:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087183744 00000100:00100000:0.0:1788483410.256942:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087183744 00000100:00100000:0.0:1788483410.257001:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 56 00000100:00100000:0.0:1788483410.257031:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+31:18785:x1875360087183744:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788483410.257150:0:22789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1c70a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.257175:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1c70a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.257186:0:22789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1c70a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788483410.257356:0:22789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:0.0:1788483410.257366:0:22789:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702520268568ns, next at 703520266480ns, rc = 0 00000004:00010000:0.0:1788483410.257425:0:22789:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044ceb1c6 reply state 0000000061c27664 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1c70a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.257437:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1c70a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.257445:0:22789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a69ecd6c400) 00010000:00010000:0.0:1788483410.257447:0:22789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788483410.257451:0:22789:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788483410.257548:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+33:18785:x1875360087183744:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 Request processed in 519us (719us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1788483410.257554:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 56 00000100:00100000:1.0:1788483410.263668:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483410.263755:0:25830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087183872 00000100:00100000:2.0:1788483410.263765:0:25830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087183872 00000100:00100000:2.0:1788483410.263822:0:25830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 57 00000100:00100000:2.0:1788483410.263832:0:25830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+33:18785:x1875360087183872:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788483410.263855:0:25830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483410.263897:0:25830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1c711 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e961 expref: -99 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.263959:0:25830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1c711 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e961 expref: 34 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.263973:0:25830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1c711 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e961 expref: 34 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.263993:0:25830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a69ecd6c400) 00010000:00010000:2.0:1788483410.263996:0:25830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788483410.264000:0:25830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f76c00, rc 0) 00000100:00100000:2.0:1788483410.264078:0:25830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+34:18785:x1875360087183872:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 246us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483410.264085:0:25830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 57 00000100:00100000:2.0:1788483410.270430:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483410.270567:0:24773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087184000 00000100:00100000:3.0:1788483410.270576:0:24773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087184000 00000100:00100000:3.0:1788483410.270633:0:24773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 24 00000100:00100000:3.0:1788483410.270642:0:24773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+5:2392:x1875360087184000:12345-192.168.206.54@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788483410.270888:0:24773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+6:2392:x1875360087184000:12345-192.168.206.54@tcp:2:lhsmtool_posix.0 Request processed in 246us (466us total) trans 12884901891 rc 0/0 00000100:00100000:3.0:1788483410.270896:0:24773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 24 00000100:00100000:3.0:1788483410.280324:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483410.280542:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087184256 00000100:00100000:2.0:1788483410.280552:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087184256 00000100:00100000:2.0:1788483410.280607:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 9 00000100:00100000:2.0:1788483410.280619:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+34:18785:x1875360087184256:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788483410.280832:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+35:18785:x1875360087184256:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 Request processed in 215us (517us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1788483410.280841:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 9 00000100:00100000:2.0:1788483410.297073:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483410.297289:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087184512 00000100:00100000:0.0:1788483410.297298:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087184512 00000100:00100000:0.0:1788483410.297358:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 58 00000100:00100000:0.0:1788483410.297368:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+35:18785:x1875360087184512:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788483410.297477:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+35:18785:x1875360087184512:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 Request processed in 110us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483410.297499:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 58 00000100:00100000:0.0:1788483410.300544:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483410.300629:0:25830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087184640 00000100:00100000:2.0:1788483410.300638:0:25830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087184640 00000100:00100000:2.0:1788483410.300692:0:25830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 59 00000100:00100000:2.0:1788483410.300702:0:25830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+35:18785:x1875360087184640:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788483410.300743:0:25830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483410.300761:0:25830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76200/0x1d7ea3d89ea1c718 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e968 expref: -99 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.300825:0:25830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1c71f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.300838:0:25830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1c71f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.300848:0:25830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1c71f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483410.300888:0:25830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788483410.300905:0:25830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1c71f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.300929:0:25830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76200/0x1d7ea3d89ea1c718 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e968 expref: 37 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.300944:0:25830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1c71f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e968 expref: 36 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.300952:0:25830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a69ecd6c400) 00010000:00010000:2.0:1788483410.300954:0:25830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788483410.300957:0:25830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68c1f77800, rc 0) 00000100:00100000:2.0:1788483410.301398:0:25830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+36:18785:x1875360087184640:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 696us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483410.301406:0:25830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 59 00000100:00100000:2.0:1788483410.313326:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483410.313428:0:24298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087184768 00000100:00100000:1.0:1788483410.313437:0:24298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087184768 00000100:00100000:1.0:1788483410.313497:0:24298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 25 00000100:00100000:1.0:1788483410.313508:0:24298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f525e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+6:2392:x1875360087184768:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788483410.313524:0:24298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483410.313544:0:24298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007379a6ae/0x1d7ea3d89ea1c726 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e96f expref: -99 pid: 24298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788483410.313568:0:24298:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9a1751, blocks: 0x0 00010000:00010000:1.0:1788483410.313585:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=702s v=(0 0) 00010000:00010000:1.0:1788483410.313590:0:24298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483410.313600:0:24298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007379a6ae/0x1d7ea3d89ea1c726 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e96f expref: 7 pid: 24298 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.313617:0:24298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007379a6ae/0x1d7ea3d89ea1c726 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e96f expref: 7 pid: 24298 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.313629:0:24298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69f5273a00, rc 0) 00000100:00100000:1.0:1788483410.313675:0:24298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f525e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+7:2392:x1875360087184768:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 169us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483410.313688:0:24298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 25 00000100:00100000:1.0:1788483410.316593:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483410.316761:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087185024 00000100:00100000:0.0:1788483410.316771:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087185024 00000100:00100000:0.0:1788483410.316862:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 60 00000100:00100000:0.0:1788483410.316873:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+36:18785:x1875360087185024:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788483410.316971:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+36:18785:x1875360087185024:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 Request processed in 100us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483410.316978:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 60 00000100:00100000:2.0:1788483410.319587:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483410.319721:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087185152 00000100:00100000:0.0:1788483410.319740:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087185152 00000100:00100000:0.0:1788483410.319789:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 61 00000100:00100000:0.0:1788483410.319798:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+36:18785:x1875360087185152:12345-192.168.206.54@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788483410.321818:0:22768:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:2.0:1788483410.321834:0:22768:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788483410.321881:0:22768:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:1.0:1788483410.321968:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1c57b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.321979:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1c57b lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.321986:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1c57b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.321992:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecf27000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483410.321997:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1c57b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.322004:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1c57b lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.322030:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a68c1c54200) 00010000:00010000:1.0:1788483410.322033:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788483410.322046:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1c57b lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.322053:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecf27000/0x1d7ea3d89ea1c57b lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483410.322233:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+19:18785:x1875360087185152:12345-192.168.206.54@tcp:44:lhsmtool_posix.0 Request processed in 2431us (2649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483410.322242:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 61 00000100:00100000:3.0:1788483410.324744:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788483410.324764:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098836480:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788483410.324822:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483410.324860:0:24773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098836480 00000100:00100000:3.0:1788483410.324866:0:24773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098836480 00000100:00100000:3.0:1788483410.324905:0:24773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788483410.324913:0:24773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098836480:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788483410.325090:0:24773:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788483410.325120:0:24773:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788483410.325124:0:24773:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788483410.325126:0:24773:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788483409 -> 1788483409 00002000:00010000:3.0:1788483410.325129:0:24773:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788483410.325241:0:24773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3621:x1875360098836480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 253us (343us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788483410.325249:0:24773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:3.0:1788483410.325293:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a69fd8f5500/2, rc 0, transno 12884901892 00000100:00100000:3.0:1788483410.325299:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098836480:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788483410.325393:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483410.325451:0:24298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087185280 00000100:00100000:3.0:1788483410.325456:0:24298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087185280 00000100:00100000:3.0:1788483410.325568:0:24298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 27 00000100:00100000:3.0:1788483410.325577:0:24298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+7:2393:x1875360087185280:12345-192.168.206.54@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788483410.325658:0:24298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+7:2393:x1875360087185280:12345-192.168.206.54@tcp:16:lhsmtool_posix.0 Request processed in 81us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483410.325665:0:24298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 27 00010000:00010000:0.0:1788483410.325749:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0000/0x1d7ea3d89ea1c519 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325759:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0000/0x1d7ea3d89ea1c519 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325766:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0000/0x1d7ea3d89ea1c519 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325771:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483410.325776:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0000/0x1d7ea3d89ea1c519 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325782:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0000/0x1d7ea3d89ea1c519 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325805:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a68c1c54000) 00010000:00010000:0.0:1788483410.325809:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483410.325813:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0000/0x1d7ea3d89ea1c519 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325819:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0000/0x1d7ea3d89ea1c519 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325838:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1c520 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325844:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1c520 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325849:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1c520 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325854:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee1a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483410.325857:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1c520 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325862:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1c520 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325868:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a68c1c54200) 00010000:00010000:0.0:1788483410.325871:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483410.325874:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1c520 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325879:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee1a00/0x1d7ea3d89ea1c520 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325900:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76a00/0x1d7ea3d89ea1c60e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325906:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76a00/0x1d7ea3d89ea1c60e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325911:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76a00/0x1d7ea3d89ea1c60e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325916:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76a00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483410.325919:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76a00/0x1d7ea3d89ea1c60e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325924:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76a00/0x1d7ea3d89ea1c60e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325932:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9a69ecd6cc00) 00010000:00010000:0.0:1788483410.325934:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483410.325937:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76a00/0x1d7ea3d89ea1c60e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325942:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76a00/0x1d7ea3d89ea1c60e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325955:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c693 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325961:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c693 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325966:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c693 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325977:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69ecee0200 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483410.325980:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c693 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325985:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c693 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.325993:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a69ecd6c300) 00010000:00010000:0.0:1788483410.325995:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483410.325997:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c693 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.326001:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69ecee0200/0x1d7ea3d89ea1c693 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.326023:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1c70a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.326028:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1c70a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.326034:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1c70a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.326047:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69d0401000 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:0.0:1788483410.326050:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1c70a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.326056:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1c70a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.326074:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a69ecd6c400) 00010000:00010000:0.0:1788483410.326076:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788483410.326079:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1c70a lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.326084:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0401000/0x1d7ea3d89ea1c70a lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483410.329321:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483410.329489:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087185536 00000100:00100000:3.0:1788483410.329497:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087185536 00000100:00100000:3.0:1788483410.329546:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 62 00000100:00100000:3.0:1788483410.329554:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+15:18785:x1875360087185536:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788483410.329602:0:22788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483410.329625:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77800/0x1d7ea3d89ea1c71f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e968 expref: 15 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.329642:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a69ecd6c400) 00010000:00010000:3.0:1788483410.329646:0:22788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788483410.329673:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7e00/0x1d7ea3d89ea1c72d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.329685:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7e00/0x1d7ea3d89ea1c72d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.329694:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7e00/0x1d7ea3d89ea1c72d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788483410.329811:0:22788:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003489480f reply state 0000000005abad19 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7e00/0x1d7ea3d89ea1c72d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.329822:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7e00/0x1d7ea3d89ea1c72d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.329829:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a69ecd6c400) 00010000:00010000:3.0:1788483410.329841:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788483410.329844:0:22788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788483410.329935:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+16:18785:x1875360087185536:12345-192.168.206.54@tcp:36:lhsmtool_posix.0 Request processed in 380us (629us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1788483410.329942:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 62 00000100:00100000:1.0:1788483410.332607:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483410.332677:0:24773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087185664 00000100:00100000:3.0:1788483410.332687:0:24773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087185664 00000100:00100000:3.0:1788483410.332750:0:24773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 28 00000100:00100000:3.0:1788483410.332760:0:24773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+7:18785:x1875360087185664:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788483410.332775:0:24773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483410.332791:0:24773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1c734 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e976 expref: -99 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.332821:0:24773:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007379a6ae/0x1d7ea3d89ea1c726 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e96f expref: 8 pid: 24298 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.332830:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483410.332834:0:24773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483410.332839:0:24773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1c734 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e976 expref: 8 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.332871:0:24773:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007379a6ae/0x1d7ea3d89ea1c726 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e96f expref: 8 pid: 24298 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.332885:0:24773:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007379a6ae/0x1d7ea3d89ea1c726 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e96f expref: 8 pid: 24298 timeout: 802 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483410.332919:0:24773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:24773:1875360098836608:192.168.206.54@tcp:104: 00000100:00100000:3.0:1788483410.333004:0:24773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d786c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483410.336636:0:24773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:24773:1875360098836608:192.168.206.54@tcp:104: 00010000:00010000:3.0:1788483410.336672:0:24773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1c734 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e976 expref: 8 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.336691:0:24773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6a021c6a00, rc 0) 00000100:00100000:3.0:1788483410.336749:0:24773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+8:18785:x1875360087185664:12345-192.168.206.54@tcp:101:lhsmtool_posix.0 Request processed in 3990us (4150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483410.336758:0:24773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 28 00000100:00100000:2.0:1788483410.338818:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483410.338916:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087185792 00000100:00100000:0.0:1788483410.338925:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087185792 00010000:00010000:0.0:1788483410.338963:0:22774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007379a6ae/0x1d7ea3d89ea1c726 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e96f expref: 8 pid: 24298 timeout: 802 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483410.339012:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 19 00000100:00100000:0.0:1788483410.339022:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c59e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+8:2392:x1875360087185792:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483410.339035:0:22774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483410.339065:0:22774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007379a6ae/0x1d7ea3d89ea1c726 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e96f expref: 8 pid: 24298 timeout: 802 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.339078:0:22774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007379a6ae/0x1d7ea3d89ea1c726 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e96f expref: 8 pid: 24298 timeout: 802 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.339137:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007379a6ae/0x1d7ea3d89ea1c726 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e96f expref: 8 pid: 24298 timeout: 802 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.339154:0:22774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483410.339376:0:22774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483410.339384:0:22774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1c734 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e976 expref: 7 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.339394:0:22774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1c734 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e976 expref: 7 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.339440:0:22774:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1c734 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e976 expref: 7 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483410.339454:0:22774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e03e2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:22774:1875360098836736:192.168.206.54@tcp:105: 00000100:00100000:0.0:1788483410.339570:0:22774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a68c342c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788483410.344219:0:22774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e03e2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:22774:1875360098836736:192.168.206.54@tcp:105: 00010000:00010000:0.0:1788483410.344245:0:22774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483410.344291:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c59e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+7:2392:x1875360087185792:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 5269us (5480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483410.344302:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 19 00000100:00100000:1.0:1788483410.344432:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483410.344756:0:24299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087185920 00000100:00100000:3.0:1788483410.344763:0:24299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087185920 00000100:00100000:3.0:1788483410.344817:0:24299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 29 00000100:00100000:3.0:1788483410.344826:0:24299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+7:2393:x1875360087185920:12345-192.168.206.54@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788483410.344956:0:24299:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788483410.344960:0:24299:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788483409 00002000:00010000:3.0:1788483410.344962:0:24299:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788483408 00002000:00010000:3.0:1788483410.344965:0:24299:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788483409 -> 1788483409 00002000:00010000:3.0:1788483410.344967:0:24299:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788483410.345074:0:24299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+8:2393:x1875360087185920:12345-192.168.206.54@tcp:2:lhsmtool_posix.0 Request processed in 183us (576us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788483410.345083:0:24299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 29 00000100:00100000:1.0:1788483410.349744:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483410.349835:0:24300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087186048 00000100:00100000:3.0:1788483410.349854:0:24300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087186048 00000100:00100000:3.0:1788483410.349909:0:24300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 30 00000100:00100000:3.0:1788483410.349918:0:24300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+8:2390:x1875360087186048:12345-192.168.206.54@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788483410.349958:0:24300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000168f66e0/0x1d7ea3d89ea1c73b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.349975:0:24300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1c734 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e976 expref: 8 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.349983:0:24300:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483410.349987:0:24300:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788483410.349991:0:24300:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000168f66e0/0x1d7ea3d89ea1c73b lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.350035:0:24300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1c734 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e976 expref: 8 pid: 24773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.350058:0:24300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1c734 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e976 expref: 8 pid: 24773 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483410.350070:0:24300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24300:1875360098836864:192.168.206.54@tcp:104: 00000100:00100000:3.0:1788483410.350285:0:24300:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c7d786c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483410.354365:0:24300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24300:1875360098836864:192.168.206.54@tcp:104: 00010000:00010000:3.0:1788483410.354395:0:24300:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000168f66e0/0x1d7ea3d89ea1c73b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483410.355172:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483410.355293:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087186176 00000100:00100000:0.0:1788483410.355301:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087186176 00010000:00010000:0.0:1788483410.355333:0:22775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1c734 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e976 expref: 9 pid: 24773 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483410.355373:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 20 00000100:00100000:0.0:1788483410.355383:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6233b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+9:2392:x1875360087186176:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483410.355396:0:22775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483410.355425:0:22775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1c734 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e976 expref: 9 pid: 24773 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.355439:0:22775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1c734 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e976 expref: 9 pid: 24773 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.355460:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004374e4b9/0x1d7ea3d89ea1c734 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e976 expref: 9 pid: 24773 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.355475:0:22775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788483410.355479:0:22775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788483410.355485:0:22775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000168f66e0/0x1d7ea3d89ea1c73b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.355494:0:22775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000168f66e0/0x1d7ea3d89ea1c73b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.355512:0:22775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483410.355628:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6233b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+8:2392:x1875360087186176:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 245us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483410.355637:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 20 00010000:00010000:2.0:1788483410.355737:0:24300:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000168f66e0/0x1d7ea3d89ea1c73b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.355747:0:24300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000168f66e0/0x1d7ea3d89ea1c73b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.355766:0:24300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000168f66e0/0x1d7ea3d89ea1c73b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.355774:0:24300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000168f66e0/0x1d7ea3d89ea1c73b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.355782:0:24300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000168f66e0/0x1d7ea3d89ea1c73b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.355789:0:24300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c7c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483410.355793:0:24300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000168f66e0/0x1d7ea3d89ea1c73b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.355801:0:24300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000168f66e0/0x1d7ea3d89ea1c73b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.355820:0:24300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000168f66e0/0x1d7ea3d89ea1c73b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.355828:0:24300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000168f66e0/0x1d7ea3d89ea1c73b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483410.355874:0:24300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+7:2390:x1875360087186048:12345-192.168.206.54@tcp:1:lhsmtool_posix.0 Request processed in 5957us (6138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483410.355881:0:24300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 30 00000100:00100000:3.0:1788483410.358938:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483410.359004:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087186432 00000100:00100000:1.0:1788483410.359021:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087186432 00000100:00100000:1.0:1788483410.359086:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 63 00000100:00100000:1.0:1788483410.359116:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+16:18785:x1875360087186432:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788483410.359207:0:22790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272c00/0x1d7ea3d89ea1c742 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.359224:0:22790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77a00/0x1d7ea3d89ea1c68c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e937 expref: 16 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.359233:0:22790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272c00/0x1d7ea3d89ea1c742 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.359266:0:22790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77a00/0x1d7ea3d89ea1c68c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e937 expref: 16 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.359280:0:22790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77a00/0x1d7ea3d89ea1c68c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e937 expref: 16 pid: 22789 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483410.359294:0:22790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6231180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22790:1875360098836992:192.168.206.54@tcp:104: 00000100:00100000:1.0:1788483410.359579:0:22790:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f63d9300 going to sleep for 11 seconds 00000100:00100000:1.0:1788483410.362603:0:22790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6231180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22790:1875360098836992:192.168.206.54@tcp:104: 00010000:00010000:1.0:1788483410.362633:0:22790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272c00/0x1d7ea3d89ea1c742 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483410.364046:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:1.0:1788483410.364132:0:23548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087186560 00000100:00100000:1.0:1788483410.364151:0:23548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087186560 00010000:00010000:1.0:1788483410.364198:0:23548:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77a00/0x1d7ea3d89ea1c68c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e937 expref: 17 pid: 22789 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483410.364237:0:23548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 21 00000100:00100000:1.0:1788483410.364246:0:23548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+17:2392:x1875360087186560:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483410.364259:0:23548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483410.364265:0:23548:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77a00/0x1d7ea3d89ea1c68c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e937 expref: 17 pid: 22789 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.364277:0:23548:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77a00/0x1d7ea3d89ea1c68c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e937 expref: 17 pid: 22789 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.364298:0:23548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77a00/0x1d7ea3d89ea1c68c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e937 expref: 17 pid: 22789 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.364314:0:23548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a69ecd6c300) 00010000:00010000:1.0:1788483410.364320:0:23548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1c6a8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e945 expref: 16 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.364328:0:23548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272c00/0x1d7ea3d89ea1c742 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.364335:0:23548:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272c00/0x1d7ea3d89ea1c742 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.364342:0:23548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272c00/0x1d7ea3d89ea1c742 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.364385:0:23548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483410.364449:0:23548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+16:2392:x1875360087186560:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 204us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483410.364456:0:23548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 21 00010000:00010000:2.0:1788483410.364724:0:22790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272c00/0x1d7ea3d89ea1c742 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.364743:0:22790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272c00/0x1d7ea3d89ea1c742 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.364927:0:22790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76800/0x1d7ea3d89ea1c749 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.364939:0:22790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1c711 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e961 expref: 16 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.364948:0:22790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76800/0x1d7ea3d89ea1c749 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.364975:0:22790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1c711 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e961 expref: 16 pid: 25830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.364988:0:22790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1c711 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e961 expref: 16 pid: 25830 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483410.365008:0:22790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22790:1875360098837120:192.168.206.54@tcp:104: 00000100:00100000:2.0:1788483410.365082:0:22790:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd93eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788483410.370265:0:22790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22790:1875360098837120:192.168.206.54@tcp:104: 00010000:00010000:2.0:1788483410.370294:0:22790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76800/0x1d7ea3d89ea1c749 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483410.370933:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:0.0:1788483410.371004:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087186688 00000100:00100000:0.0:1788483410.371016:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087186688 00010000:00010000:0.0:1788483410.371059:0:22775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1c711 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e961 expref: 17 pid: 25830 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483410.371117:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 22 00000100:00100000:0.0:1788483410.371139:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+17:2392:x1875360087186688:12345-192.168.206.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483410.371154:0:22775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483410.371171:0:22775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1c711 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e961 expref: 17 pid: 25830 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.371184:0:22775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1c711 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e961 expref: 17 pid: 25830 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.371204:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76c00/0x1d7ea3d89ea1c711 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e961 expref: 17 pid: 25830 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.371218:0:22775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a69ecd6c400) 00010000:00010000:0.0:1788483410.371222:0:22775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76800/0x1d7ea3d89ea1c749 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.371232:0:22775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76800/0x1d7ea3d89ea1c749 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.371240:0:22775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76800/0x1d7ea3d89ea1c749 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.371268:0:22775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483410.371316:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+16:2392:x1875360087186688:12345-192.168.206.54@tcp:103:ldlm_bl.0 Request processed in 177us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483410.371324:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 22 00010000:00010000:2.0:1788483410.371915:0:22790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76800/0x1d7ea3d89ea1c749 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.371923:0:22790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76800/0x1d7ea3d89ea1c749 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788483410.372033:0:22790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:2.0:1788483410.372187:0:22790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:2.0:1788483410.372221:0:22790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:2.0:1788483410.372287:0:22790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c59e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22790:1875360098837248:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788483410.372329:0:22790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483410.372353:0:22790:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69c2e3f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788483410.372668:0:23530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098837248 00000100:00100000:0.0:1788483410.372673:0:23530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098837248 00000100:00100000:0.0:1788483410.372714:0:23530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788483410.372722:0:23530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69ffefa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22790:x1875360098837248:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788483410.372810:0:23530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69ffefa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22790:x1875360098837248:12345-0@lo:1000:mdt00_002.0 Request processed in 89us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483410.372817:0:23530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788483410.372935:0:22790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c59e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22790:1875360098837248:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788483410.373137:0:22790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:3.0:1788483410.373190:0:22790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22790:1875360098837376:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788483410.373226:0:22790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483410.373246:0:22790:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69fd93e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788483410.373361:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098837376 00000100:00100000:0.0:1788483410.373366:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098837376 00000100:00100000:0.0:1788483410.373396:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788483410.373403:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22790:x1875360098837376:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788483410.373494:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22790:x1875360098837376:12345-0@lo:1000:mdt00_002.0 Request processed in 91us (266us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1788483410.373501:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788483410.373570:0:22790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22790:1875360098837376:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788483410.373600:0:22790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76800/0x1d7ea3d89ea1c749 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.373608:0:22790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76800/0x1d7ea3d89ea1c749 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.373615:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76800/0x1d7ea3d89ea1c749 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.373621:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76800 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483410.373625:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76800/0x1d7ea3d89ea1c749 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.373632:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76800/0x1d7ea3d89ea1c749 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.373646:0:22790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a69ecd6c400) 00010000:00010000:1.0:1788483410.373649:0:22790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788483410.373653:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76800/0x1d7ea3d89ea1c749 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.373659:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76800/0x1d7ea3d89ea1c749 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.373686:0:22790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77e00/0x1d7ea3d89ea1c6a1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.373697:0:22790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77e00/0x1d7ea3d89ea1c6a1 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.373703:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77e00/0x1d7ea3d89ea1c6a1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.373708:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f77e00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483410.373711:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77e00/0x1d7ea3d89ea1c6a1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.373717:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77e00/0x1d7ea3d89ea1c6a1 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.373726:0:22790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a69ecd6c300) 00010000:00010000:1.0:1788483410.373728:0:22790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788483410.373734:0:22790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1c6a8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e945 expref: 19 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.373744:0:22790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1c6a8 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e945 expref: 19 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.373752:0:22790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1c6a8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e945 expref: 19 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.373797:0:22790:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69d0400800/0x1d7ea3d89ea1c6a8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e945 expref: 19 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483410.373808:0:22790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6231180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22790:1875360098837504:192.168.206.54@tcp:105: 00000100:00100000:1.0:1788483410.373874:0:22790:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a69f63d9600 going to sleep for 11 seconds 00000100:00100000:1.0:1788483410.377333:0:22790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6231180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22790:1875360098837504:192.168.206.54@tcp:105: 00010000:00010000:1.0:1788483410.377362:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77e00/0x1d7ea3d89ea1c6a1 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.377372:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f77e00/0x1d7ea3d89ea1c6a1 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.377405:0:22790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5273c00/0x1d7ea3d89ea1c750 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.377418:0:22790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5273c00/0x1d7ea3d89ea1c750 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.377427:0:22790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5273c00/0x1d7ea3d89ea1c750 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.377437:0:22790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5273c00/0x1d7ea3d89ea1c750 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.377442:0:22790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5273c00/0x1d7ea3d89ea1c750 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.377448:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5273c00/0x1d7ea3d89ea1c750 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.377454:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69f5273c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483410.377457:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5273c00/0x1d7ea3d89ea1c750 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.377464:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5273c00/0x1d7ea3d89ea1c750 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.377498:0:22790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a69ecd6c300) 00010000:00010000:1.0:1788483410.377501:0:22790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483410.377504:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5273c00/0x1d7ea3d89ea1c750 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.377510:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5273c00/0x1d7ea3d89ea1c750 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.377520:0:22790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272c00/0x1d7ea3d89ea1c742 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.377526:0:22790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272c00/0x1d7ea3d89ea1c742 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.377536:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272c00/0x1d7ea3d89ea1c742 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.377541:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69f5272c00 already unused, calling callback (ffffffffc1a904f0) 00010000:00010000:1.0:1788483410.377544:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272c00/0x1d7ea3d89ea1c742 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.377550:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272c00/0x1d7ea3d89ea1c742 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.377557:0:22790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a69ecd6c300) 00010000:00010000:1.0:1788483410.377559:0:22790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788483410.377561:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272c00/0x1d7ea3d89ea1c742 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.377566:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69f5272c00/0x1d7ea3d89ea1c742 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483410.377732:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+19:18785:x1875360087186432:12345-192.168.206.54@tcp:57:lhsmtool_posix.0 Request processed in 18636us (18801us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1788483410.377742:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 63 00000020:00080000:1.0:1788483410.377747:0:22790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788483410.377885:0:22826:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788483410.377890:0:22826:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788483410.377906:0:22826:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788483410.377912:0:22826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788483410.382907:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483410.382997:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087186816 00000100:00100000:2.0:1788483410.383006:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087186816 00000100:00100000:2.0:1788483410.383081:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 10 00000100:00100000:2.0:1788483410.383092:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3c69c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+19:18784:x1875360087186816:12345-192.168.206.54@tcp:49:dd.0 00000100:00100000:2.0:1788483410.383260:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3c69c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+19:18784:x1875360087186816:12345-192.168.206.54@tcp:49:dd.0 Request processed in 170us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483410.383280:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 10 00000100:00100000:3.0:1788483410.387219:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:2.0:1788483410.387767:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087187072 00000100:00100000:2.0:1788483410.387777:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087187072 00000100:00100000:2.0:1788483410.387831:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 11 00000100:00100000:2.0:1788483410.387841:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+19:18785:x1875360087187072:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788483410.388151:0:22792:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788483410.388337:0:22792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:2.0:1788483410.388370:0:22792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76600/0x1d7ea3d89ea1c757 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.388386:0:22792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76600/0x1d7ea3d89ea1c757 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.388397:0:22792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76600/0x1d7ea3d89ea1c757 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.388405:0:22792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76600/0x1d7ea3d89ea1c757 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.388411:0:22792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76600/0x1d7ea3d89ea1c757 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.388417:0:22792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76600/0x1d7ea3d89ea1c757 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.388440:0:22792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788483410.388530:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+21:18785:x1875360087187072:12345-192.168.206.54@tcp:35:lhsmtool_posix.0 Request processed in 689us (1318us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1788483410.388538:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 11 00000020:00080000:2.0:1788483410.388553:0:22792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788483410.388622:0:22777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483410.388628:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76600/0x1d7ea3d89ea1c757 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.388635:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68c1f76600 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:0.0:1788483410.388640:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76600/0x1d7ea3d89ea1c757 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.388648:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76600/0x1d7ea3d89ea1c757 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.388659:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a69ecd6c400) 00010000:00010000:0.0:1788483410.388662:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788483410.388666:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76600/0x1d7ea3d89ea1c757 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.388673:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68c1f76600/0x1d7ea3d89ea1c757 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483410.388695:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483410.388697:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483410.388699:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483410.397489:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483410.397570:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087187200 00000100:00100000:3.0:1788483410.397579:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087187200 00000100:00100000:3.0:1788483410.397636:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 64 00000100:00100000:3.0:1788483410.397646:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+21:18784:x1875360087187200:12345-192.168.206.54@tcp:101:dd.0 00010000:00010000:3.0:1788483410.397664:0:22788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483410.397682:0:22788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1c75e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcb24880d3c83e97d expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.397717:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1c765 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.397730:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1c765 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.397740:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1c765 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.397853:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c6400/0x1d7ea3d89ea1c75e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e97d expref: 23 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.397882:0:22788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6a021c7200/0x1d7ea3d89ea1c765 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.54@tcp remote: 0xcb24880d3c83e97d expref: 22 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.397890:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a69ecd6c300) 00010000:00010000:3.0:1788483410.397893:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788483410.397897:0:22788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6a021c7200, rc 0) 00000100:00100000:3.0:1788483410.397954:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+22:18784:x1875360087187200:12345-192.168.206.54@tcp:101:dd.0 Request processed in 309us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483410.397962:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 64 00000100:00100000:1.0:1788483410.426209:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483410.426344:0:24303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087187328 00000100:00100000:3.0:1788483410.426355:0:24303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087187328 00000100:00100000:3.0:1788483410.426430:0:24303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 0 00000100:00100000:3.0:1788483410.426440:0:24303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+7:2390:x1875360087187328:12345-192.168.206.54@tcp:4:dd.0 00002000:00010000:3.0:1788483410.426483:0:24303:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a9a1751, atime: 0x6a9a1750, ctime: 0x6a9a1751, blocks: 0x0 00010000:00010000:3.0:1788483410.426491:0:24303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1c76c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.426506:0:24303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=702s v=(0 0) 00010000:00010000:3.0:1788483410.426511:0:24303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483410.426516:0:24303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1c76c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483410.426541:0:24303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1c76c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483410.434888:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.54@tcp (source: 12345-192.168.206.54@tcp) 00000100:00100000:3.0:1788483410.434965:0:24305:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788483410.434976:0:24305:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788483410.435330:0:24305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360087187456 00000100:00100000:3.0:1788483410.435339:0:24305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360087187456 00000100:00100000:1.0:1788483410.439612:0:25836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.54@tcp, seq: 1 00000100:00100000:1.0:1788483410.439634:0:25836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+9:2391:x1875360087187456:12345-192.168.206.54@tcp:4:dd.0 00010000:00010000:1.0:1788483410.439672:0:25836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6a20355/0x1d7ea3d89ea1c773 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.439690:0:25836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483410.439694:0:25836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483410.439700:0:25836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6a20355/0x1d7ea3d89ea1c773 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483410.439714:0:25836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6a20355/0x1d7ea3d89ea1c773 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788483410.534817:0:24294:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:0.0:1788483410.534833:0:24294:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:2.0:1788483410.535022:0:24303:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1788483410.535027:0:24303:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1788483410.535053:0:24303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1c76c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.535064:0:24303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1c76c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.535073:0:24303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1c76c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.535079:0:24303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6a021c6400 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483410.535084:0:24303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1c76c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.535092:0:24303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1c76c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.535144:0:24303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1c76c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.535153:0:24303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa8d2f86/0x1d7ea3d89ea1c76c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483410.535380:0:24303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+7:2390:x1875360087187328:12345-192.168.206.54@tcp:4:dd.0 Request processed in 108938us (109177us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788483410.535394:0:24303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 0 00000001:00080000:1.0:1788483410.552148:0:24294:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:2.0:1788483410.552418:0:25836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1788483410.552424:0:25836:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1788483410.552438:0:25836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6a20355/0x1d7ea3d89ea1c773 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.552451:0:25836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6a20355/0x1d7ea3d89ea1c773 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.552459:0:25836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6a20355/0x1d7ea3d89ea1c773 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.552516:0:25836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69f5273c00 already unused, calling callback (ffffffffc0e98230) 00010000:00010000:2.0:1788483410.552521:0:25836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6a20355/0x1d7ea3d89ea1c773 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.552530:0:25836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6a20355/0x1d7ea3d89ea1c773 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.552554:0:25836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6a20355/0x1d7ea3d89ea1c773 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483410.552562:0:25836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6a20355/0x1d7ea3d89ea1c773 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483410.552701:0:25836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7da1a6cb-751c-451d-9aac-f6cbb68c7f97+5:2391:x1875360087187456:12345-192.168.206.54@tcp:4:dd.0 Request processed in 113070us (117817us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788483410.552711:0:25836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.54@tcp, seq: 1 00010000:00010000:2.0:1788483410.808297:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788483411.394234:0:22826:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788483411.394244:0:22826:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788483411.394289:0:22826:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788483411.394302:0:22826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788483411.704406:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788483411.704426:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69c6233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098837632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788483411.704487:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483411.704533:0:24302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098837632 00000100:00100000:1.0:1788483411.704540:0:24302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098837632 00000100:00100000:1.0:1788483411.704593:0:24302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788483411.704602:0:24302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69c6232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098837632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788483411.704645:0:24302:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788483411.704689:0:24302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69c6232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875360098837632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483411.704696:0:24302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788483411.704716:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788483411.704763:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69c6233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3620:1875360098837632:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788483411.704958:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098837888:0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.704989:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483411.705021:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69f525e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098838400:0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.705051:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483411.705069:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098838912:0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.705090:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483411.705130:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788483411.705136:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098838016:0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.705168:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483411.705184:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098838528:0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.705203:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483411.705219:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098839040:0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.705238:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483411.705267:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098837888 00000100:00100000:2.0:1788483411.705271:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098837888 00000100:00100000:2.0:1788483411.705297:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098838400 00000100:00100000:2.0:1788483411.705300:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098838400 00000100:00100000:2.0:1788483411.705315:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788483411.705321:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098837888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.705357:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098837888:12345-0@lo:400:kworker.0 Request processed in 36us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483411.705363:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788483411.705375:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788483411.705381:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098838400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.705406:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098838400:12345-0@lo:400:kworker.0 Request processed in 25us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483411.705419:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788483411.705441:0:24299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098838016 00000100:00100000:2.0:1788483411.705444:0:24299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098838016 00000100:00100000:2.0:1788483411.705471:0:24299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098838528 00000100:00100000:2.0:1788483411.705473:0:24299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098838528 00000100:00100000:2.0:1788483411.705493:0:24299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788483411.705499:0:24299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098838016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.705529:0:24299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875360098838016:12345-0@lo:400:kworker.0 Request processed in 31us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483411.705535:0:24299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788483411.705547:0:24299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788483411.705553:0:24299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098838528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.705579:0:24299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098838528:12345-0@lo:400:kworker.0 Request processed in 26us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483411.705584:0:24299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788483411.705603:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098838912 00000100:00100000:2.0:1788483411.705607:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098838912 00000100:00100000:2.0:1788483411.705628:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098839040 00000100:00100000:2.0:1788483411.705631:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098839040 00000100:00100000:2.0:1788483411.705646:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788483411.705652:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098838912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.705680:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875360098838912:12345-0@lo:400:kworker.0 Request processed in 28us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483411.705685:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788483411.705695:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788483411.705701:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098839040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.705733:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875360098839040:12345-0@lo:400:kworker.0 Request processed in 33us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483411.705740:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788483411.705769:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098838144:0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.705805:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483411.705823:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098838656:0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.705842:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483411.705856:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098839168:0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.705875:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483411.705892:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788483411.705897:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3619:1875360098837760:0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.705919:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483411.705941:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69ffefa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098838272:0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.705959:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483411.705972:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a68c3f66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098838784:0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.705988:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483411.706003:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098838656 00000100:00100000:2.0:1788483411.706006:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098838656 00000100:00100000:2.0:1788483411.706022:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098839168 00000100:00100000:2.0:1788483411.706024:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098839168 00000100:00100000:2.0:1788483411.706053:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098838272 00000100:00100000:2.0:1788483411.706056:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098838272 00000100:00100000:2.0:1788483411.706066:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098838784 00000100:00100000:2.0:1788483411.706069:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098838784 00000100:00100000:2.0:1788483411.706082:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788483411.706087:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098838656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.706154:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875360098838656:12345-0@lo:400:kworker.0 Request processed in 65us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483411.706160:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788483411.706173:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788483411.706179:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098839168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.706202:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875360098839168:12345-0@lo:400:kworker.0 Request processed in 24us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483411.706208:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788483411.706218:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788483411.706224:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098838272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.706247:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875360098838272:12345-0@lo:400:kworker.0 Request processed in 23us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483411.706253:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788483411.706262:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788483411.706268:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098838784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.706288:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875360098838784:12345-0@lo:400:kworker.0 Request processed in 21us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483411.706294:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1788483411.706309:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788483411.706312:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788483411.706315:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788483411.706323:0:24299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098838144 00000100:00100000:2.0:1788483411.706326:0:24299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098838144 00000100:00100000:2.0:1788483411.706349:0:24299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788483411.706355:0:24299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c1e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098838144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.706380:0:24299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c1e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098838144:12345-0@lo:400:kworker.0 Request processed in 25us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483411.706393:0:24299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788483411.706408:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788483411.706433:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875360098838272:0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.706443:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3619:1875360098838784:0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.706451:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098838144:0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.706459:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875360098838656:0@lo:400:kworker.0 00010000:00080000:2.0:1788483411.706469:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3f67480 x1875360098839168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483411.706478:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3619:1875360098839168:0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.706509:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:2.0:1788483411.706514:0:3621:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a69fd8f5500, transno 12884901892 00000004:00080000:2.0:1788483411.706524:0:3621:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:2.0:1788483411.706538:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098838016:0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.706549:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098838528:0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.706557:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3621:1875360098839040:0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.706566:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffefbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3621:1875360098837888:0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.706575:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69f525e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098838400:0@lo:400:kworker.0 00010000:00080000:2.0:1788483411.706585:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68c3f65880 x1875360098838912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483411.706593:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a68c3f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3621:1875360098838912:0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.706626:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098837760 00000100:00100000:2.0:1788483411.706630:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098837760 00000100:00100000:2.0:1788483411.706653:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788483411.706659:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68c3664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:3619:x1875360098837760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483411.706695:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68c3664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1+24:3619:x1875360098837760:12345-0@lo:400:kworker.0 Request processed in 36us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483411.706701:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788483411.706730:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69ffef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0887b8eb-0076-4ae4-8c2a-9d3aed7c4be1:3619:1875360098837760:0@lo:400:kworker.0 00000100:00100000:0.0:1788483411.707157:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788483411.707168:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e03e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098839296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788483411.707196:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483411.708442:0:24302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098839296 00000100:00100000:1.0:1788483411.708451:0:24302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098839296 00000100:00100000:1.0:1788483411.708490:0:24302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788483411.708498:0:24302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69e03e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098839296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788483411.708518:0:24302:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788483411.708570:0:24302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69e03e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875360098839296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483411.708576:0:24302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788483411.708616:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e03e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3619:1875360098839296:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788483411.836788:0:23946:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788483412.240265:0:25873:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1788483412.856550:0:22777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483413.752675:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69e03e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098839424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788483413.752747:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483413.758923:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788483413.758943:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a69fd8f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098839552:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788483413.759028:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483413.759071:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098839552 00000100:00100000:3.0:1788483413.759079:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098839552 00000100:00100000:3.0:1788483413.759303:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788483413.759312:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69fd8f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098839552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788483413.759355:0:22793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1788483413.759400:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69fd8f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098839552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483413.759421:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788483413.759473:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69fd8f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098839552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788483413.760747:0:24302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360098839424 00000100:00100000:0.0:1788483413.760757:0:24302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360098839424 00000100:00100000:0.0:1788483413.760816:0:24302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788483413.760827:0:24302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69f73faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098839424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788483413.760850:0:24302:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788483413.760908:0:24302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69f73faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875360098839424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (8161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483413.760915:0:24302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788483413.760954:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a69e03e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3621:1875360098839424:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788483413.761116:0:22784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788483413.883074:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14396 lines, 14396 kept, 0 dropped, 0 bad.